Observability
Filed under
2 posts
One Door to the Models, Part 10: Observability, Governance, and the Numbers
Logging prompts makes the gateway a processor of whatever users typed. Part 10 closes the series on traces, production evals, governance, and the scorecard.
Your LLM Bill Is an Observability Problem
A surprising Bedrock bill is not a pricing problem, it is a visibility one. If you cannot attribute tokens to a feature, tenant, or agent, you cannot manage it.