ConeheadAI · leftover lesson
SNK3-016 · Curriculum How-to
Context limits — we give you the long text
L0–L2 · Curious–Capable (bootstrap — system rebalances) · ~4m
Look for this insight
Long context has limits; models may invent when the answer is not actually in the text you provided.
Lesson hook
When people say the model 'ran out of context,' they don't mean it got tired — they mean it simply can't see the whole conversation or document at once. Paste in something long, and the middle sections can get fuzzy or even made up.
Do this now
Open any chat tool. Paste the sample text below, then ask: 'What does Section 14 say about parking?' SAMPLE: 'Section 1: Welcome. Section 2: Hours. Section 3: Badges. Section 4: Lunch. Section 5: Visitors. Section 6: Laptops. Section 7: Wi-Fi. Section 8: Printers. Section 9: Travel. Section 10: Expenses. Section 11: PTO. Section 12: Holidays. Section 13: Safety. Section 14: DOES NOT EXIST — there is no parking policy. Section 15: Goodbye.' Now check: did the model invent a parking policy anyway? If yes, you've just caught a classic hallucination in action.
Completion check: invented_or_not
Conehead-only — no external link
Staff review Sign in