Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 22

Question 210

A single giant context drops older filings and conceals conflicts between reporting periods. How should the design be corrected?

  1. Checkpoint long-running work for replay and recovery
  2. Specify input and output contracts for each subtask
  3. Partition research by source and reconcile conflicts explicitly
  4. Divide work along independently verifiable artifacts

Explanation

Correct Answer

C:

Analyze source partitions separately, retain provenance, and reconcile contradictions through a dedicated synthesis stage; the final synthesis must expose disagreements rather than average them away; verify the repair using conflict detection recall and citation coverage across independently processed source sets.

Incorrect Answers

A:

Checkpointing reduces replay cost but cannot correct a defective classification rubric; durable checkpoints record validated intermediate artifacts and resume at safe boundaries with idempotent side effects; that control is assessed by successful recovery after injected worker failures without duplicated writes or stages; the incident instead requires conflict detection recall and citation coverage across independently processed source sets.

B:

Contracts define allowed shapes and semantics but cannot ensure a source is truthful; typed versioned contracts and compatibility tests let stages evolve while preserving their callers' assumptions; that control is assessed by contract test pass rate for independently upgraded stages and invalid payload rejection; the incident instead requires conflict detection recall and citation coverage across independently processed source sets.

D:

Artifact decomposition controls work structure but does not set the organization-wide release SLA; separate stages with typed artifacts allow validation and targeted reruns at meaningful boundaries; that control is assessed by stage-specific defect localization and repair without redoing previously validated stages; the incident instead requires conflict detection recall and citation coverage across independently processed source sets.

Question 211

A maintenance assistant must decide which diagnostic sources to query based on symptoms that are not known in advance. What is the most targeted architecture choice?

  1. Ground dynamic policy answers with retrieval
  2. Use a single augmented-LLM call for a bounded text transformation
  3. Use a bounded tool-using agent for exploratory investigation
  4. Use a deterministic workflow for known ordered stages

Explanation

Correct Answer

C:

Bounded agentic planning chooses follow-up tools from observed evidence while enforcing time, budget, and tool permissions; the agent must demonstrate flexible discovery without escaping its operational guardrails; evaluate the design with resolution of unseen diagnostic branches within a specified tool-call and time budget.

Incorrect Answers

A:

Retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; retrieval does not create new authoritative policy; it depends on freshness, correct permissions, and source quality; this alternative would measure correct citations to currently effective policy versions across update tests; it does not establish resolution of unseen diagnostic branches within a specified tool-call and time budget for the described use case.

B:

For a fixed transformation, a prompt enriched with only needed context is simpler, cheaper, and easier to evaluate than an agentic loop; a direct call is poor for tasks that require unknown sequences of external discovery or system writes; this alternative would measure summary fidelity and p95 completion time without any unapproved tool invocation; it does not establish resolution of unseen diagnostic branches within a specified tool-call and time budget for the described use case.

D:

Explicit state transitions preserve required order, testing points, and deterministic branch conditions; Claude can supply judgment inside selected stages; a rigid sequence becomes cumbersome when the next action is genuinely unknown until exploratory results arrive; this alternative would measure rate of recommendations backed by all required completed stage checks; it does not establish resolution of unseen diagnostic branches within a specified tool-call and time budget for the described use case.

Question 212

An invoice portal is tested by substituting valid-looking identifiers from another client into otherwise authorized requests. Which result would establish that ownership is checked at the resource boundary?

  1. Zero cross-user CRM record disclosures in permission-matrix tests
  2. Credential-expiry and scope-denial tests after simulated token compromise
  3. Denial of cross-tenant identifier enumeration attempts in direct tool tests
  4. Audit reconstruction of actor, authority, target, and result for sampled mutations
  5. Zero critical network changes without a recorded action-specific approval

Explanation

Correct Answer

C:

Object-level access checks close the horizontal privilege gap that prompt filtering misses; measure denial of cross-tenant identifier enumeration attempts in direct tool tests at the release gate; check the requested resource against the authenticated tenant and role at the data service rather than trusting user-provided identifiers.

Incorrect Answers

A:

User-context tests verify enforcement of the source system's individual access rules; carry an appropriate user-bound authorization context to downstream services and enforce record-level access per request; this tests zero cross-user CRM record disclosures in permission-matrix tests; the actual release condition is denial of cross-tenant identifier enumeration attempts in direct tool tests.

B:

Short validity and minimum scope bound the impact of a leaked credential; prefer tightly scoped, expiring credentials with secure rotation and audited issuance for the precise operation; this tests credential-expiry and scope-denial tests after simulated token compromise; the actual release condition is denial of cross-tenant identifier enumeration attempts in direct tool tests.

D:

End-to-end attribution makes unauthorized use investigable rather than anonymous; propagate authenticated actor, tenant, delegated scope, request ID, and action outcome into tamper-resistant audit records; this tests audit reconstruction of actor, authority, target, and result for sampled mutations; the actual release condition is denial of cross-tenant identifier enumeration attempts in direct tool tests.

E:

Approval-path tests ensure the precise mutation was authorized before execution; bind high-impact actions to a separately verified approval and narrowly scoped execution credential; this tests zero critical network changes without a recorded action-specific approval; the actual release condition is denial of cross-tenant identifier enumeration attempts in direct tool tests.

Question 213

An online catalog assistant is monitored for seasonal changes in products and questions. Which measurement would detect a drift in current customer outcomes even if the original benchmark is still stable?

  1. Percent of failures with a complete trace to the responsible stage
  2. Safety precision/recall and legitimate-task completion before and after the change
  3. Quality delta between recent audited production samples and the launch baseline
  4. Detection lag for injected per-request token inflation

Explanation

Correct Answer

C:

Live sampling reveals degradation that unchanged historical tests cannot see; measure quality delta between recent audited production samples and the launch baseline at the release gate; periodically sample representative production outputs for labeling, segment analysis, and drift signals without retaining unnecessary personal data.

Incorrect Answers

A:

Trace completeness measures incident diagnosability rather than raw log volume; correlation and span IDs across components allow latency and failure attribution along the actual path; this tests percent of failures with a complete trace to the responsible stage; the actual release condition is quality delta between recent audited production samples and the launch baseline.

B:

Paired monitoring distinguishes beneficial safety controls from excessive refusals; monitor both harmful-output violations and false-positive blocks by version and user segment; this tests safety precision/recall and legitimate-task completion before and after the change; the actual release condition is quality delta between recent audited production samples and the launch baseline.

D:

Unit-level telemetry catches runaway expense before invoices provide delayed evidence; monitor input/output tokens, cache reads, per-stage costs, and cost-per-task anomalies with accountable ownership; this tests detection lag for injected per-request token inflation; the actual release condition is quality delta between recent audited production samples and the launch baseline.

Question 214

A multi-agent investigation sometimes circles through the same questions without reaching a stop condition. Which option addresses the immediate design need?

  1. Counter automation bias with visible uncertainty and review
  2. Use claim verification to mitigate confident fabrication
  3. Cap agent steps and resource expenditure
  4. Threat-model prompt injection across lower-trust inputs

Explanation

Correct Answer

C:

Set per-task step, token, cost, and elapsed-time budgets with a clear abort and escalation state; budget stress tests show whether runaway loops fail safely; evaluate the design with maximum resource usage and orderly termination on deliberately unsolvable tasks.

Incorrect Answers

A:

Design review interfaces that expose citations, uncertainty, and targeted challenge checks rather than only an approval button; a nominal human checkpoint is weak when the interface encourages blind confirmation; this alternative would measure reviewer error interception on seeded incorrect recommendations; it does not establish maximum resource usage and orderly termination on deliberately unsolvable tasks for the described use case.

B:

Require support from retrieved source passages and provide an explicit unknown path for unsupported claims; fluency and citation formatting cannot establish factual support on their own; this alternative would measure proportion of numeric claims supported by independently inspected references; it does not establish maximum resource usage and orderly termination on deliberately unsolvable tasks for the described use case.

D:

Model external content as untrusted input, test role spoofing and instruction attempts, and enforce downstream permissions regardless of the prompt; stronger wording in the system prompt is not a complete defense against an authorized dangerous tool; this alternative would measure unauthorized tool-action success rate over injected emails and documents; it does not establish maximum resource usage and orderly termination on deliberately unsolvable tasks for the described use case.

Question 215

An employee asks about policies that change monthly and must receive citations to the currently approved version. Which choice most directly satisfies the documented goal?

  1. Ground dynamic policy answers with retrieval
  2. Use a single augmented-LLM call for a bounded text transformation
  3. Use offline batch processing when immediate interactivity is unnecessary
  4. Embed a small agent inside a controlled workflow

Explanation

Correct Answer

A:

Retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; version-aware citation checks show whether answers rely on authoritative current evidence; evaluate the design with correct citations to currently effective policy versions across update tests.

Incorrect Answers

B:

For a fixed transformation, a prompt enriched with only needed context is simpler, cheaper, and easier to evaluate than an agentic loop; a direct call is poor for tasks that require unknown sequences of external discovery or system writes; this alternative would measure summary fidelity and p95 completion time without any unapproved tool invocation; it does not establish correct citations to currently effective policy versions across update tests for the described use case.

C:

Batch-oriented orchestration handles throughput, retries, and cost planning while preserving consistent model instructions for a noninteractive workload; batch execution is unsuitable when a human must see an answer or authorize action in real time; this alternative would measure completed valid classifications per batch window and cost per accepted record; it does not establish correct citations to currently effective policy versions across update tests for the described use case.

D:

Place bounded exploratory reasoning inside one stage of a deterministic state machine; enforce approval and write permissions outside the agent; a fully autonomous controller is not needed when most transitions and side effects are governed by policy; this alternative would measure disputed-case resolution with every refund still passing the identity and approval gates; it does not establish correct citations to currently effective policy versions across update tests for the described use case.

Question 216

A company is migrating away from a legacy agent endpoint that other teams still call. Which choice most directly satisfies the documented goal?

  1. Set an evidence gate before moving beyond discovery
  2. Run a recurring monitoring-to-improvement loop
  3. Include security and governance checks during design
  4. Plan deprecation and rollback from the start

Explanation

Correct Answer

D:

Inventory consumers, define migration dates and fallback, preserve data obligations, and test the rollback or retirement path; dependency-aware migration tests verify that lifecycle closure is complete; evaluate the design with successful retirement with zero unplanned dependent-system failures.

Incorrect Answers

A:

Require validated problem scope, value hypothesis, data authority, and feasibility evidence before full design commitment; a procurement timeline does not eliminate uncertainty about whether the problem is solvable; this alternative would measure closure of high-risk feasibility questions before design approval; it does not establish successful retirement with zero unplanned dependent-system failures for the described use case.

B:

Feed production samples and feedback into versioned evals, prioritize changes, and release improvements behind regression gates; a one-time launch test cannot guarantee reliability under changing input distributions; this alternative would measure cycle time from detected drift to validated improvement without safety regression; it does not establish successful retirement with zero unplanned dependent-system failures for the described use case.

C:

Incorporate threat modeling, authorization, data processing, and human oversight into architecture acceptance before implementation hardens; post-build security sign-off is costly and may not undo prior unauthorized processing; this alternative would measure resolution of high-severity architecture risks before implementation approval; it does not establish successful retirement with zero unplanned dependent-system failures for the described use case.

Question 217

Calls succeed syntactically but return the wrong data class because schemas and descriptions do not distinguish scope. What is the most direct remediation?

  1. Write unambiguous tool descriptions and input schemas
  2. Offer each agent only the tools required for its role
  3. Decouple read-only retrieval from mutating tools
  4. Audit tool manifests as versioned production configuration

Explanation

Correct Answer

A:

Define task-specific descriptions, typed arguments, required fields, and clear side-effect semantics so tool selection is meaningful; confusion tests exercise the ambiguity that caused misrouting; verify the repair using correct tool-selection rate for ambiguous intents and invalid-argument rejection.

Incorrect Answers

B:

Monitoring a broad tool catalog does not remove the authority to invoke dangerous operations; give the agent a least-capability tool set mapped to the exact tasks it may perform, reducing accidental and adversarial action paths; that control is assessed by unauthorized tool availability and invocation count in hostile transcript tests; the incident instead requires correct tool-selection rate for ambiguous intents and invalid-argument rejection.

C:

A generic read-write interface offers more authority than the reporting workflow requires; expose narrowly scoped read-only capabilities and gate changes through separate authenticated write paths with explicit approvals; that control is assessed by zero mutation permissions for report-only identities across tool contract checks; the incident instead requires correct tool-selection rate for ambiguous intents and invalid-argument rejection.

D:

Ad hoc tool registration lacks the inventory needed to catch capability expansion before deployment; maintain owner-approved manifests with risk classification, contract checks, permission reviews, and change-control gates; that control is assessed by changes rejected when requested tool scopes exceed the approved task manifest; the incident instead requires correct tool-selection rate for ambiguous intents and invalid-argument rejection.

Question 218

A production policy assistant occasionally indexes a revoked document. On-call operators run a rehearsed stale-index containment procedure. Which measure would verify that the documented response can protect users quickly?

  1. Successful containment time in a simulated stale-index incident
  2. Reproducibility of a sampled historical answer using its full manifest
  3. Ability to identify affected decisions after simulated policy and workload changes
  4. Completeness of sensitive-data flow paths identified during security review

Explanation

Correct Answer

A:

A runbook is effective when a different on-call engineer can perform the recovery; measure successful containment time in a simulated stale-index incident at the release gate; maintain runbooks for detection, containment, safe fallback, rollback, and communication with named incident roles.

Incorrect Answers

B:

Versioned provenance enables defensible debugging and rollback; maintain a release manifest linking model configuration, prompt, tool contracts, data versions, and evaluation results; this tests reproducibility of a sampled historical answer using its full manifest; the actual release condition is successful containment time in a simulated stale-index incident.

C:

Assumption-aware ADRs support controlled adaptation rather than accidental drift; record architectural context, alternatives, decision rationale, constraints, and explicit conditions for revisiting choices; this tests ability to identify affected decisions after simulated policy and workload changes; the actual release condition is successful containment time in a simulated stale-index incident.

D:

Architecture diagrams are useful when they expose where protection and authority change; a current diagram should show data classes, flows, processing boundaries, identities, trust zones, and side effects; this tests completeness of sensitive-data flow paths identified during security review; the actual release condition is successful containment time in a simulated stale-index incident.

Question 219

A knowledge base switches embedding model versions while retaining old vectors in the same similarity index. What is the most targeted architecture choice?

  1. Version embeddings and reindex when representation changes
  2. Chunk documents along meaningful structural boundaries
  3. Refresh the index when source content changes
  4. Preserve citation metadata through retrieval and synthesis

Explanation

Correct Answer

A:

Record embedding model and preprocessing versions, re-embed consistently, and use controlled index migration; version-aligned search tests detect vector-compatibility regressions; evaluate the design with retrieval recall before and after a complete embedding-index migration.

Incorrect Answers

B:

Chunk by headings and semantic sections with deliberate overlap where necessary while maintaining parent-document references; arbitrary equal-length chunks may split dependencies despite fitting an embedding model's input limit; this alternative would measure retrieval of both governing clause and exception for labeled contract questions; it does not establish retrieval recall before and after a complete embedding-index migration for the described use case.

C:

Build a monitored ingestion path for adds, updates, deletes, and effective dates, with freshness checks and removal of superseded chunks; a larger context window cannot compensate for documents missing from the index; this alternative would measure publication-to-search freshness lag and absence of withdrawn clauses in results; it does not establish retrieval recall before and after a complete embedding-index migration for the described use case.

D:

Store source IDs, locations, dates, and stable links with chunks and propagate them to answer citation validation; a similarity score is not a source identifier and cannot support a traceable citation; this alternative would measure fraction of material claims linked to resolvable source locations; it does not establish retrieval recall before and after a complete embedding-index migration for the described use case.

Question 220

A customer-service agent uses a write-capable connector with a documented role policy. What is the most defensible next step?

  1. Quantify rate and severity of safety policy violations
  2. Test whether the tool layer denies unauthorized requests
  3. Evaluate whether abstention and escalation are calibrated
  4. Use task-correctness metrics tied to verified labels

Explanation

Correct Answer

B:

Treat backend authorization denial rate and cross-scope access tests as primary security metrics, not merely refusal wording; direct penetration-style checks assess the enforceable security boundary; evaluate the design with unauthorized API requests rejected under role, tenant, and resource attack matrices.

Incorrect Answers

A:

Define safety incident categories, risk-weighted violation rates, and appropriate exposure denominators for adversarial and real traffic; general task correctness does not measure policy-conformance failures on dangerous requests; this alternative would measure severity-weighted policy violation incidence on a reviewed adversarial test set; it does not establish unauthorized API requests rejected under role, tenant, and resource attack matrices for the described use case.

C:

Measure selective risk: error rate on answered items alongside abstention precision, coverage, and escalation cost; high refusal frequency alone can appear safe while making the assistant operationally useless; this alternative would measure correct-answer rate at each supported coverage threshold including no-answer cases; it does not establish unauthorized API requests rejected under role, tenant, and resource attack matrices for the described use case.

D:

Measure the business decision against a labeled reference, with metrics weighted for costly errors and explicit acceptance thresholds; positive conversational tone does not establish that a legally or financially meaningful label is correct; this alternative would measure critical-class precision and recall on independently verified tax-code cases; it does not establish unauthorized API requests rejected under role, tenant, and resource attack matrices for the described use case.

Claude Certified Architect - Professional (CCAR-P) Practice Tests