Skip to the lesson

AnatomyLesson 1 of 7

How a language model writes

A working bench machine, drawn part by part. Press play and it explains itself.

Temperature 0.8

Next-token odds

Part 1 of 10

CourseAll lessons Next lessonTokenisation

Every number on this page is computed live by a real toy model: eight tokens, a seven-token window and three attention layers with hand-set weights. Tap any part of the machine to jump to its explanation.