The Library · free, forever

The Library

Long-form, read free

The chambers train you by doing. The Library is where it’s written down — long-form, honest, given away. First on the shelf:

First on the shelf

Ch 1–3 ready

The Opaque Box

Building a Language Model from First Principles

They call AI a black box — sealed, unknowable. But that’s only half true: we have every number, we just can’t read them. The honest word is opaque — fully in your hands, not see-through. This book builds one with you, line by line: a small but real GPT-style model — tokenizer, embeddings, attention, the training loop, the sampler. Nothing imported you don’t understand. You’ll know the machine cold — and meet the part that stays opaque even when you built it yourself: the weights, where the intelligence actually lives.

Ch 1From text to numbers — tokenizationRead → Ch 2Words as directions — embeddings & the input pipelineRead → Ch 3Attention, the whole gameRead →

Ch 4Many eyes — multi-head attentionSoon

Ch 5The transformer blockSoon

Ch 6Assembling the GPTSoon

Ch 7Teaching it to predictSoon

Ch 8Making it speak — samplingSoon

Ch 9Standing on giants — loading GPT-2 weightsSoon

Ch 10Bending it to a task — fine-tuningSoon

An original work — the subject (transformers, attention, BPE) is public math & method; every word, code listing, and analogy is written fresh for the 37th Chamber. Cited where it stands on published research.

More books are coming to the shelf. The Library is free and stays free — the view is not ours alone.