KPIsShared across all subject areas

Evaluation regression rate

Share of evaluation cases that previously passed and now fail after a model, prompt or retrieval change.

Formula

Previously passing cases now failing ÷ previously passing cases × 100

Illustrative target

Zero on high-consequence cases

KPI cautions1
  • Evaluation sets grow stale, so regressions are measured against cases that no longer represent real usage.