We track three things: clinical accuracy on a held-out evaluation set, clinician acceptance rate in production, and downstream impact — did the documentation improve, did the prior auth approve, did the discharge plan land.
Aggregate accuracy is the least interesting of the three. We weight production behavior heavily because that's what's actually affecting patients.
Every metric is segmented by care setting, payer type, and demographic group.
