Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 29

Question 280

A travel-insurance assistant can calculate a settlement but the transfer must be approved by a named financial officer. In a separate network-operations service, risk ranges from harmless diagnostics to disconnecting a critical site. Which TWO approval designs are appropriate to the respective consequences? Choose TWO.

  1. Require named authorization before moving money
  2. Adopt risk-based sampling for low-impact decisions
  3. Require stronger approval paths for exceptional high-impact actions
  4. Escalate binding legal interpretations to qualified reviewers
  5. Capture reviewer overrides as structured improvement signals

Explanation

Correct Answers

A:

Separate recommendation from execution and require an authenticated human approval bound to the exact amount, payee, and transaction; payment simulation tests prove approvals are bound to the exact side effect; its corresponding workstream should be validated by zero disbursements without an auditable transaction-specific approver.

C:

Apply risk-tiered approvals, including dual control or independent sign-off where policy demands, to exceptionally consequential mutations; approval testing must target the cases where one mistake affects many users; its corresponding workstream should be validated by critical-action dual-approval compliance and zero bypasses during staged tests.

Incorrect Answers

B:

Combine automated checks with representative human sampling and exception-based review scaled to risk; universal manual review may be disproportionate when actions are reversible and errors are easily detected; its natural acceptance measure is defect-detection rate and reviewer workload under a risk-tiered sampling policy, which does not satisfy the separate workstreams being assessed.

D:

Define escalation thresholds and route consequential interpretations to qualified legal or compliance owners with source context; a high model confidence estimate cannot replace delegated legal decision authority; its natural acceptance measure is correct escalation of ambiguous legal cases with reviewer attribution, which does not satisfy the separate workstreams being assessed.

E:

Record correction reasons, provenance, and case labels under retention rules to support evaluation and process redesign; counting approval clicks alone does not describe why humans disagreed with the AI; its natural acceptance measure is recurrence rate of categorized, previously corrected error types, which does not satisfy the separate workstreams being assessed.

Question 281

Strict keyword matching misses correct passages even when the concepts are clearly equivalent. Which corrective change best addresses the root cause?

  1. Rerank candidate passages for question relevance
  2. Use lexical search for exact identifiers and literals
  3. Combine lexical and semantic candidates when queries mix both
  4. Use semantic vector search for paraphrased knowledge questions

Explanation

Correct Answer

D:

Vector retrieval can match conceptual similarity between user wording and document text, followed by evidence verification; paraphrase benchmark cases test the capability for which embeddings are chosen; verify the repair using recall on human-authored paraphrases absent from manual headings.

Incorrect Answers

A:

A bigger first-stage candidate set without selection can dilute context and increase cost; apply a query-aware reranker after broad retrieval, respecting freshness and permissions, to prioritize evidence for synthesis; that control is assessed by relevant-procedure rank and end-to-end answer support rate after reranking; the incident instead requires recall on human-authored paraphrases absent from manual headings.

B:

Semantic similarity alone can rank conceptually related but operationally different identifiers; keyword or lexical matching is effective for codes, exact phrases, and terms whose characters carry the meaning; that control is assessed by exact-ID hit rate at the top retrieval ranks; the incident instead requires recall on human-authored paraphrases absent from manual headings.

C:

Either modality alone leaves a known class of mixed-format queries uncovered; hybrid retrieval joins exact-term and semantic evidence, then applies metadata filtering and ranking; that control is assessed by joint exact-identifier accuracy and semantic-symptom recall on mixed queries; the incident instead requires recall on human-authored paraphrases absent from manual headings.

Question 282

A bid-analysis assistant reads supplier attachments containing text that looks like application instructions. In a red-team release test, which outcome would establish that source content cannot change the scoring rules?

  1. Correct type selection on unseen evidence-versus-action pairs
  2. Label accuracy and token use versus a heavier example-based prompt
  3. Correct separation of document claims and application instructions in adversarial input tests
  4. Recall on previously confused boundary examples outside the prompt set

Explanation

Correct Answer

C:

The acceptance set targets role confusion caused by mixed prompt sections; measure correct separation of document claims and application instructions in adversarial input tests at the release gate; use clearly named sections or XML-style tags so Claude can distinguish task policy, input, and supporting documents.

Incorrect Answers

A:

Contrastive tests verify the semantic boundary, not just the presence of a familiar template; show a paired positive and negative example with the decision rule that separates the formats; then test unseen cases; this tests correct type selection on unseen evidence-versus-action pairs; the actual release condition is correct separation of document claims and application instructions in adversarial input tests.

B:

Controlled comparisons show whether added prompt complexity yields a genuine benefit; a concise task statement with precise labels is a defensible baseline when success is readily evaluated and examples add little value; this tests label accuracy and token use versus a heavier example-based prompt; the actual release condition is correct separation of document claims and application instructions in adversarial input tests.

D:

Held-out boundary performance shows whether examples teach the distinction rather than merely echoing training examples; provide a few diverse, accurately labeled counterexamples that illustrate the exact class boundary, then verify against held-out cases; this tests recall on previously confused boundary examples outside the prompt set; the actual release condition is correct separation of document claims and application instructions in adversarial input tests.

Question 283

A public information bot pulls records from several agencies whose source data has different owners and use restrictions. Which readiness measure would show that every necessary integration is approved and feasible?

  1. Agreed p95, availability, and load thresholds exercised in an acceptance environment
  2. Resolution rate of prioritized unknowns through measured prototypes
  3. Signed acceptance criteria mapped to demonstrable tests and named owners
  4. Coverage of approved requirements traced to affected stakeholder groups
  5. Percentage of required sources with approved owners, legal uses, and integration paths

Explanation

Correct Answer

E:

Data ownership completeness measures feasibility before engineering spends effort; measure percentage of required sources with approved owners, legal uses, and integration paths at the release gate; create a source inventory with accountable owners, sensitivity, update rate, and approval dependencies before committing to the design.

Incorrect Answers

A:

Measurable NFRs turn vague expectations into testable architecture constraints; specify capacity, tail latency, availability, privacy, and recovery objectives with measurement windows and ownership; this tests agreed p95, availability, and load thresholds exercised in an acceptance environment; the actual release condition is percentage of required sources with approved owners, legal uses, and integration paths.

B:

Evidence-based discovery reduces commitment to unverified technical assumptions; identify high-risk assumptions and design small feasibility spikes with explicit success and stop criteria; this tests resolution rate of prioritized unknowns through measured prototypes; the actual release condition is percentage of required sources with approved owners, legal uses, and integration paths.

C:

An explicit agreement limits scope drift and creates a common release standard; document in-scope outcomes, exclusions, metrics, responsibilities, and go-live gates for accountable approval; this tests signed acceptance criteria mapped to demonstrable tests and named owners; the actual release condition is percentage of required sources with approved owners, legal uses, and integration paths.

D:

Traceable requirements reveal whether important operational perspectives were omitted; use role-based discovery to capture goals, current workflows, authority boundaries, and failure impacts from relevant stakeholders; this tests coverage of approved requirements traced to affected stakeholder groups; the actual release condition is percentage of required sources with approved owners, legal uses, and integration paths.

Question 284

A support assistant is being rolled out to web and accessible voice channels. Before approving expansion, which result would expose a channel-specific decline masked by overall success rates?

  1. Measured balanced treatment cohorts and clean user-level exposure histories
  2. Shadow-policy agreement and zero write side effects across replayed billing cases
  3. Resolution and safety deltas by channel and accessibility segment
  4. Time from triggered guardrail breach to verified rollback

Explanation

Correct Answer

C:

Segment-aware decisions expose concentrated regressions before full rollout; measure resolution and safety deltas by channel and accessibility segment at the release gate; compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable.

Incorrect Answers

A:

Stable assignments preserve causal interpretation for repeated sessions; assign a stable randomized unit aligned to the behavior being measured and maintain consistent treatment during the experiment; this tests balanced treatment cohorts and clean user-level exposure histories; the actual release condition is resolution and safety deltas by channel and accessibility segment.

B:

Non-mutating evidence reduces risk before enabling operational authority; replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately; this tests shadow-policy agreement and zero write side effects across replayed billing cases; the actual release condition is resolution and safety deltas by channel and accessibility segment.

D:

Operational readiness includes the ability to stop unsafe experiments promptly; establish automated and human-owned rollback triggers tied to critical error and unauthorized-action indicators; this tests time from triggered guardrail breach to verified rollback; the actual release condition is resolution and safety deltas by channel and accessibility segment.

Question 285

An aircraft maintenance assistant searches manuals for exact component identifiers whose suffixes change the approved procedure. Which evidence would show that retrieval preserves identifier precision?

  1. Joint exact-identifier accuracy and semantic-symptom recall on mixed queries
  2. Exact aggregate agreement with a trusted query on authorized records
  3. Conditional-rule accuracy with and without parent-document expansion
  4. Exact-ID hit rate at the top retrieval ranks

Explanation

Correct Answer

D:

Identifier-focused tests reveal errors that a semantic relevance score may ignore; measure exact-ID hit rate at the top retrieval ranks at the release gate; keyword or lexical matching is effective for codes, exact phrases, and terms whose characters carry the meaning.

Incorrect Answers

A:

The evaluation must verify both constraints at once rather than reporting only aggregate relevance; hybrid retrieval joins exact-term and semantic evidence, then applies metadata filtering and ranking; this tests joint exact-identifier accuracy and semantic-symptom recall on mixed queries; the actual release condition is exact-ID hit rate at the top retrieval ranks.

B:

A structured oracle detects missing rows and arithmetic mistakes; use a governed structured query interface with parameter checks and business semantics for exact aggregates; this tests exact aggregate agreement with a trusted query on authorized records; the actual release condition is exact-ID hit rate at the top retrieval ranks.

C:

Context reconstruction tests whether narrow hits are interpreted in their governing scope; use child-chunk retrieval for recall and fetch validated parent context or adjacent governing sections for interpretation; this tests conditional-rule accuracy with and without parent-document expansion; the actual release condition is exact-ID hit rate at the top retrieval ranks.

Question 286

A customer platform introduces tenant-segmented reliability alerts. Reviewers simulate a failure affecting one small client but not global traffic. Which measure would establish that the alerting design works?

  1. Detection time for an injected single-tenant degradation
  2. Trace completeness and correct bottleneck attribution on instrumented fault injections
  3. Error diagnosability with seeded sensitive fields absent from collected logs
  4. Time to detect and stop a simulated unauthorized bulk-write burst

Explanation

Correct Answer

A:

Segmented monitoring finds localized issues that global summary statistics miss; measure detection time for an injected single-tenant degradation at the release gate; break down latency, errors, and tool success by permission-safe tenant and workload dimensions with cardinality controls.

Incorrect Answers

B:

Distributed spans expose ownership boundaries across the whole execution path; end-to-end traces with consistent request and span identifiers identify which service and step consumed time; this tests trace completeness and correct bottleneck attribution on instrumented fault injections; the actual release condition is detection time for an injected single-tenant degradation.

C:

Redaction and observability must be validated together, not traded off blindly; record tool type, status, duration, correlation IDs, and carefully redacted diagnostic fields under controlled retention; this tests error diagnosability with seeded sensitive fields absent from collected logs; the actual release condition is detection time for an injected single-tenant degradation.

D:

Action telemetry and response drills measure whether harmful changes can be contained promptly; monitor write volume, denials, unusual resource patterns, and action-specific thresholds with fast containment routing; this tests time to detect and stop a simulated unauthorized bulk-write burst; the actual release condition is detection time for an injected single-tenant degradation.

Question 287

Operators cannot pause or replace a generated plan when conditions change on the ground. Which intervention targets the defect rather than its symptoms?

  1. Provide a route to challenge significant recommendations
  2. Publish scope, limitations, and residual risks to stakeholders
  3. Test accessibility of generated explanations and interfaces
  4. Expose evidence and decision boundaries to affected users
  5. Design an override path proportionate to consequences

Explanation

Correct Answer

E:

Preserve an authorized override and recovery route scaled to decision consequences, with feedback recorded for evaluation; pre-commit override drills test real controllability rather than retrospective documentation; verify the repair using successful intervention before seeded high-impact incorrect actions are committed.

Incorrect Answers

A:

A fairness dashboard alone cannot remedy individual incorrect records or decisions; provide a contest and correction process with accountable human ownership for significant impacts; that control is assessed by time to resolve substantiated challenges and proportion of cases with documented review; the incident instead requires successful intervention before seeded high-impact incorrect actions are committed.

B:

A generic disclaimer cannot compensate for hidden high-risk use or unavailable oversight; maintain clear documentation of intended use, unsupported scenarios, measured performance, and escalation requirements; that control is assessed by accuracy of user understanding of supported versus unsupported tasks; the incident instead requires successful intervention before seeded high-impact incorrect actions are committed.

C:

Factual accuracy alone does not make the interface usable to everyone; include accessibility requirements, assistive-technology testing, and inclusive content rubrics in evaluation and design; that control is assessed by task completion by users of tested assistive technologies on representative flows; the incident instead requires successful intervention before seeded high-impact incorrect actions are committed.

D:

A polished explanation without provenance may create false confidence in unsupported reasoning; distinguish evidence, uncertainty, and advisory status with accessible citations and a path to authoritative decisions; that control is assessed by user comprehension of advisory status and source-citation validity; the incident instead requires successful intervention before seeded high-impact incorrect actions are committed.

Question 288

A debugging log leak exposes a credential that remains usable across tenants months later. Which corrective change best addresses the root cause?

  1. Confirm tenant ownership of resource identifiers
  2. Issue short-lived scoped credentials for tools
  3. Record the user, tenant, and action in audit trails
  4. Enforce authorization inside the tool backend

Explanation

Correct Answer

B:

Prefer tightly scoped, expiring credentials with secure rotation and audited issuance for the precise operation; short validity and minimum scope bound the impact of a leaked credential; verify the repair using credential-expiry and scope-denial tests after simulated token compromise.

Incorrect Answers

A:

Syntactically valid IDs and a logged-in session do not establish ownership of a resource; check the requested resource against the authenticated tenant and role at the data service rather than trusting user-provided identifiers; that control is assessed by denial of cross-tenant identifier enumeration attempts in direct tool tests; the incident instead requires credential-expiry and scope-denial tests after simulated token compromise.

C:

Logging only a model response cannot attribute which authenticated principal caused a backend change; propagate authenticated actor, tenant, delegated scope, request ID, and action outcome into tamper-resistant audit records; that control is assessed by audit reconstruction of actor, authority, target, and result for sampled mutations; the incident instead requires credential-expiry and scope-denial tests after simulated token compromise.

D:

Prompt-only restrictions can be bypassed and are not an independently audited authorization control; implement enforceable role, amount, and resource checks at the action service, not just in natural-language instructions; that control is assessed by rejection of unauthorized tool calls even when sent outside the model workflow; the incident instead requires credential-expiry and scope-denial tests after simulated token compromise.

Question 289

Following a policy update, a travel-support assistant must answer old and new allowance questions using the correct effective-date rules. What evidence establishes that the deployed approach remains grounded in current authority?

  1. Resolution of unseen diagnostic branches within a specified tool-call and time budget
  2. Completed valid classifications per batch window and cost per accepted record
  3. Rate of recommendations backed by all required completed stage checks
  4. Correct citations to currently effective policy versions across update tests

Explanation

Correct Answer

D:

Version-aware citation checks show whether answers rely on authoritative current evidence; measure correct citations to currently effective policy versions across update tests at the release gate; retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation.

Incorrect Answers

A:

The agent must demonstrate flexible discovery without escaping its operational guardrails; bounded agentic planning chooses follow-up tools from observed evidence while enforcing time, budget, and tool permissions; this tests resolution of unseen diagnostic branches within a specified tool-call and time budget; the actual release condition is correct citations to currently effective policy versions across update tests.

B:

Throughput and unit economics measure the benefit that a user-facing latency metric would miss; batch-oriented orchestration handles throughput, retries, and cost planning while preserving consistent model instructions for a noninteractive workload; this tests completed valid classifications per batch window and cost per accepted record; the actual release condition is correct citations to currently effective policy versions across update tests.

C:

Stage-completion evidence verifies that mandatory controls were not left to agent discretion; explicit state transitions preserve required order, testing points, and deterministic branch conditions; Claude can supply judgment inside selected stages; this tests rate of recommendations backed by all required completed stage checks; the actual release condition is correct citations to currently effective policy versions across update tests.

Question 290

An internal assistant is being selected for peak traffic and variable response deadlines. The enterprise buyer wants performance claims that different vendors can test consistently. Which acceptance evidence best establishes the shared service target?

  1. Signed acceptance criteria mapped to demonstrable tests and named owners
  2. Resolution rate of prioritized unknowns through measured prototypes
  3. Agreed p95, availability, and load thresholds exercised in an acceptance environment
  4. Percentage of required sources with approved owners, legal uses, and integration paths

Explanation

Correct Answer

C:

Measurable NFRs turn vague expectations into testable architecture constraints; measure agreed p95, availability, and load thresholds exercised in an acceptance environment at the release gate; specify capacity, tail latency, availability, privacy, and recovery objectives with measurement windows and ownership.

Incorrect Answers

A:

An explicit agreement limits scope drift and creates a common release standard; document in-scope outcomes, exclusions, metrics, responsibilities, and go-live gates for accountable approval; this tests signed acceptance criteria mapped to demonstrable tests and named owners; the actual release condition is agreed p95, availability, and load thresholds exercised in an acceptance environment.

B:

Evidence-based discovery reduces commitment to unverified technical assumptions; identify high-risk assumptions and design small feasibility spikes with explicit success and stop criteria; this tests resolution rate of prioritized unknowns through measured prototypes; the actual release condition is agreed p95, availability, and load thresholds exercised in an acceptance environment.

D:

Data ownership completeness measures feasibility before engineering spends effort; create a source inventory with accountable owners, sensitivity, update rate, and approval dependencies before committing to the design; this tests percentage of required sources with approved owners, legal uses, and integration paths; the actual release condition is agreed p95, availability, and load thresholds exercised in an acceptance environment.

Claude Certified Architect - Professional (CCAR-P) Practice Tests