Part 08 · Evaluating LLM Apps
Regression Testing and Benchmarking
Eval in CIPrompt regressionsModel upgradesPublic benchmarks
A small prompt fix can break ten other cases. Running evals in CI, comparing model versions before you switch, and why public benchmark scores rarely match your task.
⏱ 1-2 hours · Station 67 of 92