ConeheadAI · leftover lesson
SNK3-033 · Curriculum How-to
Token — one definition with a model
L0–L1 · Curious–Hands On (bootstrap — system rebalances) · ~3m
Look for this insight
Tokens are pieces models process — not always whole words. Use that when length/limits confuse you.
Lesson hook
A token is just a chunk of text the model reads — often a piece of a word, not always a whole one. And when you hear about limits, they're usually measured in tokens, not pages.
Do this now
Open any chat tool and paste: 'Explain tokens vs words for a beginner in 3 short bullets with one example of a word that might split into multiple tokens.' You're done with 3 bullets plus one example of a word getting split.
Completion check: three_bullets_example
Conehead-only — no external link
Staff review Sign in