CCAR-F objective 5.5 · Domain 5 · 15% of the exam
Human Review and Confidence Calibration
A confidence score is not a probability of being right until somebody has checked that it tracks correctness, and if it does not, no threshold placed on it separates anything. Measurement against known-correct labels is the only thing that finds a real boundary. The second idea is that an aggregate hides its own composition: 94% overall is consistent with near-perfect handling of the common case and a much worse rate on a rarer one, so automating on the headline figure automates the bad segment. And automation removes the measurement along with the labour, which is why a continuing sample matters afterwards.
5 questions · answers and explanations shown as you go · free, no sign-up
The rest of domain 5: Context Management and Reliability
This domain is 15% of a scored form, about 10 of the 65 questions, spread across 6 objectives. Drill the whole domain or pick another objective below.
One objective is a narrow slice. A full-length timed mock is what tells you whether the whole thing holds together.
Sit a timed mock →