Tokens: AI Reads in Puzzle Pieces
Short words = 1 piece. Long words get chopped: mis|under|stand|ing = 4.
Brain Map: Similar Words Live Close Together
Bigger or fine-tuned models = sharper map = fewer mix-ups.
Prediction: Super Autocomplete
Score every next word β roll a weighted die β add one word β repeat.
Memory Limit: Old Messages Fall Off
AI only sees the last 100 tokens. Add messages β your π and πΌ rules fall off the cliff.
Drift, Pollution & Rot
Watch the π§ orb (AI's focus) get pulled off target.
Training: Guess β Check β Adjust
A model is billions of dials. Each wrong guess nudges them. Repeat trillions of times.
Prompt = today only.
Hide a word: πΌ "approve the Q4 ___"
AI guesses "pizza" β
Right answer: "budget". Measure the miss.
Nudge the dials. Repeat for months.
KV Cache: Don't Re-Read, Remember
AI saves a note for every past word, so each new word is 1 step, not a full re-read.
"Budget"
"$50,000"
Latency is how long you wait before the AI types. KV Cache keeps latency flat and near-zero!
Trade-off: speed costs memory.