How a Transformer Really Works: Attention, the KV Cache, and Why Inference Eats Memory
ArchitectureA from-scratch tour of what's actually inside an LLM: how a transformer turns tokens into predictions, what Query, Key, and Value really mean, and how generating text one token at a time builds the KV cache — the growing pool of memory that makes inference so expensive.