Context
Filed under
1 post
The Context Window Is Not Your Friend
A huge context window is not a replacement for retrieval. Recall degrades as the prompt grows, cost scales with every token, and the middle gets skimmed.
A huge context window is not a replacement for retrieval. Recall degrades as the prompt grows, cost scales with every token, and the middle gets skimmed.