← Blog
Chatbots & Assistants

What Is Context Packing? (2026): What Goes in the Window, in Order

By Andrew · October 24, 2026

Context packing is the ordered assembly of one request: which instructions, which passages, and which user turn you place in the window, and which pieces you leave out. The window is the limit. The budget is how you split that limit. Packing is the list you actually send, in the order you send it. A packed request that includes a secret the user should not see, or a passage that contradicts the instruction, failed before the model wrote a word.

The limit itself is what a context window is. The split across instructions, retrieval, history, and the reply is what token budgeting is. Shrinking a piece so it fits the split is what prompt compaction is. A repeated prefix you hope to reuse is what a context cache is.

Prices are US list prices excluding tax from directory pages checked October 16, 2026. Published October 24, 2026. This page does not invent a token limit for any chat plan. We did not score which pack produces a better answer.

The order that should be deliberate

SlotWhat you put thereLeave it out when
InstructionsThe task, the refusals, the output shapeThe instruction is a secret policy the user is not allowed to receive back
Tool listThe tools this request may callThis request should not call tools
PassagesThe few chunks you already rankedThe chunk is stale, or it is another customer’s
HistoryThe turns this task still needsThe thread is long and the budget says to compact
User turnThe message you are answeringYou are answering a different question than they asked
Room for the replyEmpty space you reservedThe pack filled the window and the answer will be cut off
flowchart TD
  budget["You already split the token budget"] --> pack["Place instructions, then passages, then the user turn"]
  pack --> fit{"Does the pack fit, with room for the reply?"}
  fit -->|No| shrink["Compact or drop the lowest-ranked passage"]
  shrink --> pack
  fit -->|Yes| send["Send this request. Do not add a piece after the fact"]

Several calls, each with its own pack and a check between them, are what prompt chaining is. Packing is inside one call. Chaining is the sequence of calls. A second pass that reorders passages before you pack them is what retrieval reranking is.

Where the pack is decided

A long handbook in a Project. Claude Pro is $20 a month, or $17 billed annually. The Project can hold the handbook. The request still needs a pack: the pages that matter for this question, not the entire handbook, unless the budget says the handbook fits. The review is Claude review.

A reusable template. ChatGPT Plus at $20 a month, when the instructions are stable and the user pastes the source. Plus includes projects on the directory card. The review is ChatGPT review.

Notes that already live in Google. Gemini on the Google AI Pro plan at $19.99 a month lists Gemini in Docs. Pack the doc you mean. Do not assume the plan pulls every file in the account into the request. The review is Gemini review.

The source page. Notion AI Business is $20 a seat a month when the passage should be a wiki page with an owner, not a chat scroll. The page is the record. The pack cites it.

The hidden instruction slot is what a system prompt is. Packing does not make that slot a place to hide a policy you have not written down. If the instruction matters, it has an owner outside the request.

What a bad pack looks like

The pack includes two passages that disagree, and no line that says which one wins. The pack includes the full thread after the budget said to keep the last decision only. The pack includes another tenant’s text because the retrieval filter was missing. That last failure is what AI multi-tenancy is. The fix is to drop the passage, not to ask the model to ignore it.

FAQ

Is packing the same as stuffing the window?

Stuffing is what happens when every available piece goes in until the limit. Packing is the choice of a short list, in an order, under a budget that still leaves room for the reply. A full window is not a better pack.

Should instructions come first?

On this page, yes: the task and the refusals sit before the passages, so a long passage does not crowd them out of the budget. If your provider’s API documents a different required order, follow that. The point is that the order is chosen, not accidental.

Can compaction replace packing?

Compaction shrinks a piece that is already selected. Packing decides whether the piece is selected. Compact a passage you intend to keep. Drop a passage you should not have included.

Does a cache change the pack?

A cache may make a repeated prefix cheaper to send again. It does not choose the prefix. If the cached block contains a stale policy, you are cheaply repeating a wrong instruction. Decide the pack, then consider the cache.

Last verified

October 16, 2026 for Claude, ChatGPT, Gemini, and Notion AI. Published October 24, 2026.

Sources: Claude pricing, ChatGPT pricing, Gemini subscriptions, Notion pricing.

Published by Andrew for AI Tools Optimizer.

Claude is in the chatbots and assistants directory. Directory pages may use affiliate links. A purchase through them may earn us a commission at no extra cost to you.

Disclosure: this post may contain affiliate links. If you buy through them we may earn a commission at no extra cost to you.

Tools mentioned in this post