Deliverable 4g · Performance Measurement & Drift Monitoring
Performance & Drift
KPIs, live performance dashboards, drift detection, and ROI — the GAO Monitoring principle, made operational. Models are watched continuously; when input distributions shift, the framework reacts.
Model performance · trailing 12 months
Drift detection · Mail-Theft Image Classifier
Population Stability Index (PSI) monitored against a 0.2 breach threshold.
What drifted
Peak holiday-season parcel volume introduced high proportions of new poly-mailer and oversized flat packaging types not well-represented in the original training set; the shift in packaging material textures and label placement patterns pushed PSI above the 0.20 breach threshold.
Automated response
Automated drift alert triggered a mandatory human-review escalation for all high-confidence theft flags; a targeted retraining job was queued using 60 days of recently labeled images; the retrained model was validated offline and promoted to production on 2026-04-11, restoring PSI to the stable band.
Return on investment