How-to · INT · INT.4

Context limits — we give you the long text

Long context has limits; models may invent when the answer is not actually in the text you provided.

Open any chat tool. Paste the sample text below, then ask: 'What does Section 14 say about parking?' SAMPLE: 'Section 1: Welcome. Section 2: Hours. Section 3: Badges. Section 4: Lunch. Section 5: Visitors. Section 6: Laptops. Section 7: Wi-Fi. Section 8: Printers. Section 9: Travel. Section 10: Expenses. Section 11: PTO. Section 12: Holidays. Section 13: Safety. Section 14: DOES NOT EXIST — there is no parking policy. Section 15: Goodbye.' Now check: did the model invent a parking policy anyway? If yes, you've just caught a classic hallucination in action.

Worked example

When people say the model 'ran out of context,' they don't mean it got tired — they mean it simply can't see the whole conversation or document at once. Paste in something long, and the middle sections can get fuzzy or even made up.

← All How-tos