Model Quality Drift

Model Quality Drift is the measurable decline in AI output quality during real-world operation. A system that performed well at launch can produce weaker results weeks or months later, even when serving the same use case. Common causes include shifts in input data, changing user behavior, prompt template updates, toolchain changes, or upstream model updates from providers. In production, drift often appears first as higher correction effort, more hallucinations, lower classification accuracy, or slower completion in agent workflows. The key point is that drift is not a one-off bug; it is an ongoing operational risk. That is why teams need continuous quality control with explicit metrics such as task success rate, error rate, response consistency, and process-level business KPIs. Mature teams combine offline evaluations on fixed benchmark sets with online monitoring in live traffic. When quality drops beyond defined thresholds, they trigger mitigations such as prompt rollback, guardrail tuning, model routing changes, or targeted fine-tuning. This keeps AI performance governable over time instead of relying on luck.