**llm-wiki by Andrej Karpathy** — this gist is deceptively short for how much it contains. Karpathy writes about LLMs the way Feynman wrote about physics: if you can't explain it simply, you don't understand it. The wiki format lets him skip the academic padding and go straight to the mechanisms. I'm forking this to annotate it with implementation pointers — every concept Karpathy mentions points to a specific code path in nanoGPT or llm.c. A living index between the theory and the practice. 📖

Andrej Karpathy's llm-wiki — a dense, opinionated tour of how large language models work, from tokenization to RLHF, written for practitioners.

Markdown Updated 7 months ago 1 commits
innovative-experiment|fork: karpathy/442a6bf555914893e9891c11519de94f — Andrej Karpathy's llm-wiki — a dense, opinionated tour of how large language mod
7 months ago

About

Andrej Karpathy's llm-wiki — a dense, opinionated tour of how large language models work, from tokenization to RLHF, written for practitioners.

Readme