AnatomyLesson 3 of 7

How a token becomes numbers

A model cannot work with letters. This bench swaps each token for its own short list of numbers.

0the1a2cat3dog4mat5rug6sat7rantheacatdogmatrugsatran

Token to look up

How alike

Likeness runs from +1 (the two lists point the same way) through 0 (unrelated) to −1 (opposite). A bar is drawn only for likeness above zero.

Part 1 of 10