LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
About this project
Build a Large Language Model (From Scratch) This repository contains the code for developing, pretraining, and finetuning a GPT-like LLM and is the official code repository for the book Build a Large Language Model (From Scratch). In Build a Large Language Model (From Scratch), you'll learn and understand how large language models (LLMs) work from the inside out by coding them from the ground up, step by step. In this book, I'll guide you through creating your own LLM, explaining each stage with clear text, diagrams, and examples. The method described in this book for training and developing your own small-but-functional model for educational purposes mirrors the approach used…
Technologies
Project health
GitHub
Reviews
Built by
Maintain rasbt/LLMs-from-scratch? Claiming verifies admin access through your GitHub account and gives you control of this listing.
