How LLMs Work

A 3-part series.

  1. Part 1

    Intro to Large Language Models

    A plain-English tour of how LLMs work: what they physically are, how they're trained, the OS-like ecosystem around them, and their security issues.
  2. Part 2

    A Deep Dive into How LLMs Are Built

    How a model like ChatGPT is built stage by stage — pretraining, fine-tuning, reinforcement learning — and why it hallucinates and needs tokens to think.
  3. Part 3

    Neural Networks, Transformers, and How LLMs Learn

    The machinery the deep dive skipped: how a neural network and the Transformer work, what loss really means, and how reinforcement learning trains a model.