annotated_deep_learning_paper_implementations
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original
About this project
labml.ai Deep Learning Paper Implementations This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations, The website renders these as side-by-side formatted notes. We believe these would help you understand these algorithms better. We are actively maintaining this repo and adding new implementations almost weekly. for updates. Paper Implementations ✨ Transformers JAX implementation Multi-headed attention Triton Flash Attention Transformer building blocks Transformer XL Relative multi-headed attention Rotary Positional Embeddings Attention with Linear Biases (ALiBi) RETRO …
Technologies
Project health
GitHub
Reviews
Built by
Maintain labmlai/annotated_deep_learning_paper_implementations? Claiming verifies admin access through your GitHub account and gives you control of this listing.
