Part 08 · Evaluating LLM Apps
Monitoring LLM Apps in Production
Online evalsUser feedbackDriftAlerts
Tests pass, users still complain. Sampling live traffic for online evals, collecting feedback, spotting drift, and alerting on quality, not just errors.
⏱ 1-2 hours · Station 68 of 92