Prompt Caching
Filed under
1 post
Prompt Caching on Bedrock: The 90% Discount Most Teams Ignore
Bedrock prompt caching reads a repeated prefix at 90 percent off, but a cache write costs more than not caching. The breakpoint decides which you get.
Bedrock prompt caching reads a repeated prefix at 90 percent off, but a cache write costs more than not caching. The breakpoint decides which you get.