Skip to content

Context Windows and the Lost-in-the-Middle Effect

Entry #628 / 700 · Chapter 13 · 13.3 Conversational, multimodal, zero-shot recall · Read in Chinese →
In one sentence

The finding that when a long body of text is placed in a model's context, information at the beginning and the end is retained reliably while material buried in the middle is often overlooked.

Analogy Mental model

A manager hearing ten reports in a day remembers the first presenter and the closing summary, and forgets the fifth, who read from a spreadsheet for half an hour.

In practice What you actually do

Two applications. At page level, place the core verdict, the recommended shortlist, and the key statistics in a summary block at the top, then restate them compactly in a closing verdict and question block. At section level, put the conclusion and the product name in the first sentence, never at word one hundred and fifty.

Where people get burned Pitfalls

The reliable pattern follows from this: heavy at the top, heavy at the end, lists and structure in the middle. Content that hides its value in the middle of an even wall of prose is content that gets summarised incorrectly.

This entry was written in English from the Chinese original, not machine-translated. Read the Chinese version →