Topic
Training Systems.
Trainers, optimizers, recipes, debugging large runs.
July 2026
Every Mask in a Transformer, Untangled
The word "mask" means at least four unrelated things in deep learning — what a token can see, what counts toward the loss, what is hidden to create a task, and what is randomly dropped. One field guide to all of them, with why each exists and what breaks without it.
Intuitive Guide to LoRA: Fine-Tuning a Model by 0.2% of weights
You don't need a massive tech budget or a cluster of high-end GPUs to train your own AI. LoRA allows developers to fine-tune giant models right on a standard laptop. Here is the zero-jargon, first-principles explanation of the clever shortcut that leveled the playing field.