context window

[ KON-tekst WIN-doh ]noun

How much the AI can hold in front of it at one time.

Explanation

Bigger is not free. It costs more, runs slower, and makes the part you actually needed harder to find. The skill is picking what goes in, not piling more in.

Related words

• token — The unit an AI reads and writes: roughly a short word, or a piece of a longer one.
• context rot — When something you said early in a long session quietly stops counting.

Prompts that deal with it

• Cold Handoff — Brief the next session so it does not start over