---
title: "Evaluation, Testing & Optimization — CCAR-P questions"
description: "32 CCAR-P practice questions with explanations for domain 4: Evaluation, Testing & Optimization. Worth 16% of a scored form, about 10 of 63 questions."
url: "https://claudearchitectguide.com/drill/4"
image: "https://claudearchitectguide.com/og.png"
---

Domain 4 · 16% of the exam · 10 of 63 questions

# Evaluation, Testing & Optimization

Proving the system works and keeping it working. Defining metrics that are both meaningful and observable, building evaluation sets that include the cases you would rather not think about, running experiments whose results can be attributed to one cause, diagnosing failures to the right layer, and optimising cost and latency after measuring instead of before.

every one of the 32 pool items in this domain · explanations as you go · free

## The 6 objectives in this domain

A real score report grades each of these separately, so a weakness here is addressable at this level rather than by re-reading the whole domain. Each one has its own drill.

- [4.1](https://claudearchitectguide.com/drill/obj/4-1): Define evaluation metrics (accuracy, latency, cost, safety, security) 6 questions
- [4.2](https://claudearchitectguide.com/drill/obj/4-2): Design evaluation datasets and test frameworks using mixed methodologies 5 questions
- [4.3](https://claudearchitectguide.com/drill/obj/4-3): Conduct A/B testing and iterative improvements 5 questions
- [4.4](https://claudearchitectguide.com/drill/obj/4-4): Diagnose system issues (prompt failure, hallucinations, model mismatch) 5 questions
- [4.5](https://claudearchitectguide.com/drill/obj/4-5): Optimize token usage, latency, and cost-performance trade-offs 5 questions
- [4.6](https://claudearchitectguide.com/drill/obj/4-6): Monitor system performance using logging and observability tools 6 questions

## The other 6 domains

- [D1 · 17%Solution Design & Architecture (34)](https://claudearchitectguide.com/drill/1)
- [D2 · 13%Models, Prompting & Context Engineering (26)](https://claudearchitectguide.com/drill/2)
- [D3 · 19%Integration (38)](https://claudearchitectguide.com/drill/3)
- [D5 · 14%Governance, Safety & Risk Management (28)](https://claudearchitectguide.com/drill/5)
- [D6 · 14%Stakeholder Communication & Lifecycle (28)](https://claudearchitectguide.com/drill/6)
- [D7 · 7%Developer Productivity & Enablement (14)](https://claudearchitectguide.com/drill/7)

Drilling one domain tells you about one domain. A full-length timed mock in blueprint proportions is what produces a score you can read.

[Sit a timed mock →](https://claudearchitectguide.com/exam)
