Ahead of AI
Long-form, technical explanations of how LLMs actually work — architectures, training, research trends — from the author of Build a Large Language Model (From Scratch). No ads.
Eight videos and over 11 hours of coding, covering evaluation, inference-time scaling, reinforcement learning, and distillation in Python and PyTorch.
A Visual Guide to Bag-of-Words, RNNs, CNNs, Transformers, Jev-like APIs, and Calibration
A Look at Recurrent Depth, Hidden Chains of Thought, and Recent Research on Looping Transformer Blocks
