lecture
Deep Dive into LLMs like ChatGPT
Andrej Karpathy · 10 recommenders · 8 months
Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.
Why Hacker News readers recommend it: HN's most frequent recommendation for a clear, approachable foundation in how LLMs work without heavy math.
LLMs & generative AIMachine learning & deep learning#llm training#chatgpt#pretraining#hallucination#tokenization#andrej karpathy
“I highly recommend Andrej Karpathy's Deep Dive into LLMs like ChatGPT”
View the original HN discussion
