Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 15

Question 140

A sales assistant serves multiple account managers whose CRM permissions differ by region. What is the most defensible next step?

  1. Enforce authorization inside the tool backend
  2. Require separate approval for high-impact mutations
  3. Verify tenant ownership of resource identifiers
  4. Use delegated user identity for per-user data access
  5. Record the user, tenant, and action in audit trails
  6. Issue short-lived scoped credentials for tools

Explanation

Correct Answer

D:

Carry an appropriate user-bound authorization context to downstream services and enforce record-level access per request; user-context tests verify enforcement of the source system's individual access rules; evaluate the design with zero cross-user CRM record disclosures in permission-matrix tests.

Incorrect Answers

A:

Implement enforceable role, amount, and resource checks at the action service, not just in natural-language instructions; prompt-only restrictions can be bypassed and are not an independently audited authorization control; this alternative would measure rejection of unauthorized tool calls even when sent outside the model workflow; it does not establish zero cross-user CRM record disclosures in permission-matrix tests for the described use case.

B:

Bind high-impact actions to a separately verified approval and narrowly scoped execution credential; a general sign-in session does not imply user consent to every destructive operation in that session; this alternative would measure zero critical network changes without a recorded action-specific approval; it does not establish zero cross-user CRM record disclosures in permission-matrix tests for the described use case.

C:

Check the requested resource against the authenticated tenant and role at the data service rather than trusting user-provided identifiers; syntactically valid IDs and a logged-in session do not establish ownership of a resource; this alternative would measure denial of cross-tenant identifier enumeration attempts in direct tool tests; it does not establish zero cross-user CRM record disclosures in permission-matrix tests for the described use case.

E:

Propagate authenticated actor, tenant, delegated scope, request ID, and action outcome into tamper-resistant audit records; logging only a model response cannot attribute which authenticated principal caused a backend change; this alternative would measure audit reconstruction of actor, authority, target, and result for sampled mutations; it does not establish zero cross-user CRM record disclosures in permission-matrix tests for the described use case.

F:

Prefer tightly scoped, expiring credentials with secure rotation and audited issuance for the precise operation; encrypting a shared permanent key at rest does not mitigate broad privilege after the key is exposed; this alternative would measure credential-expiry and scope-denial tests after simulated token compromise; it does not establish zero cross-user CRM record disclosures in permission-matrix tests for the described use case.

Question 141

A compliance chatbot repeats a large unchanged handbook for every short user inquiry. Which design decision directly addresses this constraint?

  1. Tune cost using the rate of acceptable outcomes
  2. Reuse expensive stable prefixes through prompt caching
  3. Schedule non-urgent work through bounded batch processing
  4. Parallelize independent retrieval calls on the critical path

Explanation

Correct Answer

B:

Keep a stable eligible prompt prefix and measure cache-read tokens to reduce repeated processing; joint economics and quality checks demonstrate that reuse helps without sacrificing correctness; evaluate the design with cache-read rate, p95 latency, and cost per accepted answer under repeated queries.

Incorrect Answers

A:

Optimize total cost per successful output with floor constraints on completeness, safety, and latency; minimizing token counts without measuring quality can make a workflow more expensive in practice; this alternative would measure all-in cost per accepted summary at a fixed mandatory-section completion rate; it does not establish cache-read rate, p95 latency, and cost per accepted answer under repeated queries for the described use case.

C:

Use suitable batch orchestration and queue control to trade immediate response time for predictable throughput and expense; batch pipelines are inappropriate where a person needs a subsecond answer for an active decision; this alternative would measure cost and successful throughput per nightly processing window; it does not establish cache-read rate, p95 latency, and cost per accepted answer under repeated queries for the described use case.

D:

Parallel retrieval with per-call budgets reduces wall time while preserving authorization and complete aggregation; parallelism adds little if operations depend on each other or contend for the same rate-limited service; this alternative would measure p95 response time with all three source checks present under load; it does not establish cache-read rate, p95 latency, and cost per accepted answer under repeated queries for the described use case.

Question 142

A tool named account_access silently combines inquiry and update operations under one model-visible action. Which intervention targets the defect rather than its symptoms?

  1. Write unambiguous tool descriptions and input schemas
  2. Offer each agent only the tools required for its role
  3. Separate read-only retrieval from mutating tools
  4. Audit tool manifests as versioned production configuration
  5. Stage privileged capabilities only after explicit intent confirmation

Explanation

Correct Answer

C:

Expose narrowly scoped read-only capabilities and gate changes through separate authenticated write paths with explicit approvals; permission tests reveal whether supposedly analytical agents can cause side effects; verify the repair using zero mutation permissions for report-only identities across tool contract checks.

Incorrect Answers

A:

A richer schema improves selection but does not override a backend that ignores caller authorization; define task-specific descriptions, typed arguments, required fields, and clear side-effect semantics so tool selection is meaningful; that control is assessed by correct tool-selection rate for ambiguous intents and invalid-argument rejection; the incident instead requires zero mutation permissions for report-only identities across tool contract checks.

B:

Monitoring a broad tool catalog does not remove the authority to invoke dangerous operations; give the agent a least-capability tool set mapped to the exact tasks it may perform, reducing accidental and adversarial action paths; that control is assessed by unauthorized tool availability and invocation count in hostile transcript tests; the incident instead requires zero mutation permissions for report-only identities across tool contract checks.

D:

Ad hoc tool registration lacks the inventory needed to catch capability expansion before deployment; maintain owner-approved manifests with risk classification, contract checks, permission reviews, and change-control gates; that control is assessed by changes rejected when requested tool scopes exceed the approved task manifest; the incident instead requires zero mutation permissions for report-only identities across tool contract checks.

E:

Hiding a tool in ordinary prompts is a defense-in-depth measure, not sufficient if APIs permit unauthorized direct calls; reveal high-impact tools only within a confirmed, authorized transaction stage; maintain server-side gating independently of model choice; that control is assessed by absence of privileged tool calls before the confirmed transaction stage; the incident instead requires zero mutation permissions for report-only identities across tool contract checks.

Question 143

A warranty assessor must always extract a serial number, verify purchase date, and then draft a recommendation in that order. What is the most defensible next step?

  1. Use a deterministic workflow for known ordered stages
  2. Ground dynamic policy answers with retrieval
  3. Use a single augmented-LLM call for a bounded text transformation
  4. Use offline batch processing when immediate interactivity is unnecessary
  5. Use a bounded tool-using agent for exploratory investigation
  6. Embed a small agent inside a controlled workflow

Explanation

Correct Answer

A:

Explicit state transitions preserve required order, testing points, and deterministic branch conditions; Claude can supply judgment inside selected stages; stage-completion evidence verifies that mandatory controls were not left to agent discretion; evaluate the design with rate of recommendations backed by all required completed stage checks.

Incorrect Answers

B:

Retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; retrieval does not create new authoritative policy; it depends on freshness, correct permissions, and source quality; this alternative would measure correct citations to currently effective policy versions across update tests; it does not establish rate of recommendations backed by all required completed stage checks for the described use case.

C:

For a fixed transformation, a prompt enriched with only needed context is simpler, cheaper, and easier to evaluate than an agentic loop; a direct call is poor for tasks that require unknown sequences of external discovery or system writes; this alternative would measure summary fidelity and p95 completion time without any unapproved tool invocation; it does not establish rate of recommendations backed by all required completed stage checks for the described use case.

D:

Batch-oriented orchestration handles throughput, retries, and cost planning while preserving consistent model instructions for a noninteractive workload; batch execution is unsuitable when a human must see an answer or authorize action in real time; this alternative would measure completed valid classifications per batch window and cost per accepted record; it does not establish rate of recommendations backed by all required completed stage checks for the described use case.

E:

Bounded agentic planning chooses follow-up tools from observed evidence while enforcing time, budget, and tool permissions; agent autonomy adds cost and uncertainty to tasks whose steps are already predictable and linear; this alternative would measure resolution of unseen diagnostic branches within a specified tool-call and time budget; it does not establish rate of recommendations backed by all required completed stage checks for the described use case.

F:

Place bounded exploratory reasoning inside one stage of a deterministic state machine; enforce approval and write permissions outside the agent; a fully autonomous controller is not needed when most transitions and side effects are governed by policy; this alternative would measure disputed-case resolution with every refund still passing the identity and approval gates; it does not establish rate of recommendations backed by all required completed stage checks for the described use case.

Question 144

An assistant can recommend account changes but only an approved service identity may apply them. Which design decision directly addresses this constraint?

  1. Parallelize only truly independent branches
  2. Partition research by source and reconcile conflicts explicitly
  3. Separate planning proposals from privileged execution
  4. Define input and output contracts for each subtask

Explanation

Correct Answer

C:

Use a planning artifact that is reviewed and handed to a distinct authorized executor; never treat proposed tool calls as permission to mutate state; this tests enforcement at the action boundary rather than relying on prose instructions; evaluate the design with unauthorized mutations during plan-only tests, with a target of zero.

Incorrect Answers

A:

Isolate independent tasks, retain separate results, then join only when required dependencies have completed; parallelizing dependent mutations without isolation can increase errors even if raw processing is faster; this alternative would measure correct merged clause counts across repeated parallel execution races; it does not establish unauthorized mutations during plan-only tests, with a target of zero for the described use case.

B:

Analyze source partitions separately, retain provenance, and reconcile contradictions through a dedicated synthesis stage; simple partitioning can preserve conflicting claims unless the merge step includes a reconciliation rule; this alternative would measure conflict detection recall and citation coverage across independently processed source sets; it does not establish unauthorized mutations during plan-only tests, with a target of zero for the described use case.

D:

Typed versioned contracts and compatibility tests let stages evolve while preserving their callers' assumptions; contracts define allowed shapes and semantics but cannot ensure a source is truthful; this alternative would measure contract test pass rate for independently upgraded stages and invalid payload rejection; it does not establish unauthorized mutations during plan-only tests, with a target of zero for the described use case.

Question 145

A global quality metric hides a high denial-guidance error rate for that language group. Which corrective change best addresses the root cause?

  1. Publish scope, limitations, and residual risks to stakeholders
  2. Measure errors across relevant user subgroups
  3. Test accessibility of generated explanations and interfaces
  4. Design an override path proportionate to consequences
  5. Expose evidence and decision boundaries to affected users
  6. Provide a route to challenge significant recommendations

Explanation

Correct Answer

B:

Evaluate suitable subgroup error rates and access outcomes, with privacy-aware sampling and appropriate fairness review; group-specific evaluation reveals concentrated harm masked by pooled scores; verify the repair using quality and escalation parity across predeclared language segments.

Incorrect Answers

A:

A generic disclaimer cannot compensate for hidden high-risk use or unavailable oversight; maintain clear documentation of intended use, unsupported scenarios, measured performance, and escalation requirements; that control is assessed by accuracy of user understanding of supported versus unsupported tasks; the incident instead requires quality and escalation parity across predeclared language segments.

C:

Factual accuracy alone does not make the interface usable to everyone; include accessibility requirements, assistive-technology testing, and inclusive content rubrics in evaluation and design; that control is assessed by task completion by users of tested assistive technologies on representative flows; the incident instead requires quality and escalation parity across predeclared language segments.

D:

Human review after an irreversible action may be too late to prevent harm; preserve an authorized override and recovery route scaled to decision consequences, with feedback recorded for evaluation; that control is assessed by successful intervention before seeded high-impact incorrect actions are committed; the incident instead requires quality and escalation parity across predeclared language segments.

E:

A polished explanation without provenance may create false confidence in unsupported reasoning; distinguish evidence, uncertainty, and advisory status with accessible citations and a path to authoritative decisions; that control is assessed by user comprehension of advisory status and source-citation validity; the incident instead requires quality and escalation parity across predeclared language segments.

F:

A fairness dashboard alone cannot remedy individual incorrect records or decisions; provide a contest and correction process with accountable human ownership for significant impacts; that control is assessed by time to resolve substantiated challenges and proportion of cases with documented review; the incident instead requires quality and escalation parity across predeclared language segments.

Question 146

A document workflow has teams replacing the classifier and extractor independently across releases. Which intervention is most appropriate for this use case?

  1. Define input and output contracts for each subtask
  2. Partition research by source and reconcile conflicts explicitly
  3. Parallelize only truly independent branches
  4. Divide work along independently verifiable artifacts
  5. Separate planning proposals from privileged execution

Explanation

Correct Answer

A:

Typed versioned contracts and compatibility tests let stages evolve while preserving their callers' assumptions; versioned interfaces expose breaking changes before a multi-team deployment; evaluate the design with contract test pass rate for independently upgraded stages and invalid payload rejection.

Incorrect Answers

B:

Analyze source partitions separately, retain provenance, and reconcile contradictions through a dedicated synthesis stage; simple partitioning can preserve conflicting claims unless the merge step includes a reconciliation rule; this alternative would measure conflict detection recall and citation coverage across independently processed source sets; it does not establish contract test pass rate for independently upgraded stages and invalid payload rejection for the described use case.

C:

Isolate independent tasks, retain separate results, then join only when required dependencies have completed; parallelizing dependent mutations without isolation can increase errors even if raw processing is faster; this alternative would measure correct merged clause counts across repeated parallel execution races; it does not establish contract test pass rate for independently upgraded stages and invalid payload rejection for the described use case.

D:

Separate stages with typed artifacts allow validation and targeted reruns at meaningful boundaries; artifact decomposition controls work structure but does not set the organization-wide release SLA; this alternative would measure stage-specific defect localization and repair without redoing previously validated stages; it does not establish contract test pass rate for independently upgraded stages and invalid payload rejection for the described use case.

E:

Use a planning artifact that is reviewed and handed to a distinct authorized executor; never treat proposed tool calls as permission to mutate state; planning/execution separation does not fix whether the recommended plan uses current policy data; this alternative would measure unauthorized mutations during plan-only tests, with a target of zero; it does not establish contract test pass rate for independently upgraded stages and invalid payload rejection for the described use case.

Question 147

During a partial rollout, an agent version begins failing authorization checks above a previously agreed limit. Which observation would prove that the stop condition is operational rather than just documented?

  1. Resolution and safety deltas by channel and accessibility segment
  2. Shadow-policy agreement and zero write side effects across replayed billing cases
  3. Time from triggered guardrail breach to verified rollback
  4. Canary threshold compliance and time to revert a seeded regression

Explanation

Correct Answer

C:

Operational readiness includes the ability to stop unsafe experiments promptly; measure time from triggered guardrail breach to verified rollback at the release gate; establish automated and human-owned rollback triggers tied to critical error and unauthorized-action indicators.

Incorrect Answers

A:

Segment-aware decisions expose concentrated regressions before full rollout; compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable; this tests resolution and safety deltas by channel and accessibility segment; the actual release condition is time from triggered guardrail breach to verified rollback.

B:

Non-mutating evidence reduces risk before enabling operational authority; replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately; this tests shadow-policy agreement and zero write side effects across replayed billing cases; the actual release condition is time from triggered guardrail breach to verified rollback.

D:

Controlled exposure and rollback readiness limit the damage of an unexpected release; deploy to a bounded cohort while observing quality, errors, and tail latency, with predefined stop and rollback thresholds; this tests canary threshold compliance and time to revert a seeded regression; the actual release condition is time from triggered guardrail breach to verified rollback.

Question 148

A service only needs to extract fixed fields from a supplied transcript, yet an agent repeatedly calls tools and searches unrelated sources. Which simpler execution pattern fits this bounded transformation?

  1. Anchor dynamic policy answers with retrieval
  2. Use a bounded tool-using agent for exploratory investigation
  3. Use a single augmented-LLM call for a bounded text transformation
  4. Embed a small agent inside a controlled workflow

Explanation

Correct Answer

C:

For a fixed transformation, a prompt enriched with only needed context is simpler, cheaper, and easier to evaluate than an agentic loop; a bounded call should meet the content rubric without introducing an unnecessary action surface; verify the repair using summary fidelity and p95 completion time without any unapproved tool invocation.

Incorrect Answers

A:

Retrieval does not create new authoritative policy; it depends on freshness, correct permissions, and source quality; retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; that control is assessed by correct citations to currently effective policy versions across update tests; the incident instead requires summary fidelity and p95 completion time without any unapproved tool invocation.

B:

Agent autonomy adds cost and uncertainty to tasks whose steps are already predictable and linear; bounded agentic planning chooses follow-up tools from observed evidence while enforcing time, budget, and tool permissions; that control is assessed by resolution of unseen diagnostic branches within a specified tool-call and time budget; the incident instead requires summary fidelity and p95 completion time without any unapproved tool invocation.

D:

A fully autonomous controller is not needed when most transitions and side effects are governed by policy; place bounded exploratory reasoning inside one stage of a deterministic state machine; enforce approval and write permissions outside the agent; that control is assessed by disputed-case resolution with every refund still passing the identity and approval gates; the incident instead requires summary fidelity and p95 completion time without any unapproved tool invocation.

Question 149

A sales assistant is advertised as an authoritative compliance adviser despite never being evaluated for that role. Which option addresses the immediate design need?

  1. Check accessibility of generated explanations and interfaces
  2. Expose evidence and decision boundaries to affected users
  3. Provide a route to challenge significant recommendations
  4. Publish scope, limitations, and residual risks to stakeholders
  5. Design an override path proportionate to consequences
  6. Measure errors across relevant user subgroups

Explanation

Correct Answer

D:

Maintain clear documentation of intended use, unsupported scenarios, measured performance, and escalation requirements; scenario tests reveal whether disclosures prevent inappropriate reliance; evaluate the design with accuracy of user understanding of supported versus unsupported tasks.

Incorrect Answers

A:

Include accessibility requirements, assistive-technology testing, and inclusive content rubrics in evaluation and design; factual accuracy alone does not make the interface usable to everyone; this alternative would measure task completion by users of tested assistive technologies on representative flows; it does not establish accuracy of user understanding of supported versus unsupported tasks for the described use case.

B:

Distinguish evidence, uncertainty, and advisory status with accessible citations and a path to authoritative decisions; a polished explanation without provenance may create false confidence in unsupported reasoning; this alternative would measure user comprehension of advisory status and source-citation validity; it does not establish accuracy of user understanding of supported versus unsupported tasks for the described use case.

C:

Provide a contest and correction process with accountable human ownership for significant impacts; a fairness dashboard alone cannot remedy individual incorrect records or decisions; this alternative would measure time to resolve substantiated challenges and proportion of cases with documented review; it does not establish accuracy of user understanding of supported versus unsupported tasks for the described use case.

E:

Preserve an authorized override and recovery route scaled to decision consequences, with feedback recorded for evaluation; human review after an irreversible action may be too late to prevent harm; this alternative would measure successful intervention before seeded high-impact incorrect actions are committed; it does not establish accuracy of user understanding of supported versus unsupported tasks for the described use case.

F:

Evaluate suitable subgroup error rates and access outcomes, with privacy-aware sampling and appropriate fairness review; overall accuracy cannot establish comparable treatment for every affected population; this alternative would measure quality and escalation parity across predeclared language segments; it does not establish accuracy of user understanding of supported versus unsupported tasks for the described use case.

Question 150

A generic subagent receives deployment tools while doing read-only documentation analysis. Which corrective change best addresses the root cause?

  1. Keep credentials out of prompts and versioned configuration
  2. Scope MCP connections by project and user identity
  3. Use specialized subagents with bounded tools and instructions
  4. Use deterministic hooks to enforce required developer gates

Explanation

Correct Answer

C:

Give each delegated role explicit objectives, context limits, and tool permissions with clear return artifacts; role-isolation tests prove that decomposition also restricts authority; verify the repair using subagent task completion with zero out-of-scope tool access.

Incorrect Answers

A:

Masking output after committing a secret cannot undo credential exposure or grant least privilege; use approved secret storage, scoped environment access, and redaction while avoiding credentials in repositories, prompts, or logs; that control is assessed by secret-scanning results and blocked exfiltration on seeded repository credentials; the incident instead requires subagent task completion with zero out-of-scope tool access.

B:

A working connection does not prove the assistant is restricted to the user's intended project resources; choose appropriate configuration scope and per-user or service authorization for MCP servers, avoiding shared cross-project secrets; that control is assessed by access denial for cross-project MCP resources under user identity tests; the incident instead requires subagent task completion with zero out-of-scope tool access.

D:

A written instruction alone is best-effort and does not guarantee enforcement of a critical command gate; configure supported hooks for deterministic checks at appropriate lifecycle points, with clear failure behavior and maintenance ownership; that control is assessed by hook execution and blocked noncompliant operations under simulated bypass attempts; the incident instead requires subagent task completion with zero out-of-scope tool access.

Claude Certified Architect - Professional (CCAR-P) Practice Tests