Evaluation
Filed under
1 post
Evals Before Agents: You Can't Ship What You Can't Score
Without an eval harness, every agent change is a vibe check. Build the scoreboard before the agent, and treat the LLM-as-judge as a component that can be wrong.
Without an eval harness, every agent change is a vibe check. Build the scoreboard before the agent, and treat the LLM-as-judge as a component that can be wrong.