Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 47

Question 460

A malformed generated field reaches a write endpoint and is rejected after an unintended partial update. Which change should the architect recommend first?

  1. Use a queue and asynchronous workers for bursty workloads
  2. Persist workflow state and make retries idempotent
  3. Link each output to source and processing trace IDs
  4. Validate model output against a business schema before side effects

Explanation

Correct Answer

D:

Use structured output parsing, semantic validation, and a separate authorized command handler so generated text is never treated directly as a write instruction; pre-write enforcement proves that the model cannot bypass the target system's integrity contract; verify the repair using invalid write payloads rejected before execution, with zero partial supplier mutations.

Incorrect Answers

A:

Queueing absorbs bursts but does not improve a weak answer rubric or justify a higher-privilege tool set; decouple intake from processing through durable queues, bounded workers, and status callbacks rather than keeping user connections open; that control is assessed by job completion rate and queue age during the peak intake window; the incident instead requires invalid write payloads rejected before execution, with zero partial supplier mutations.

B:

Durable-state control prevents duplicate effects but cannot decide whether a refund is substantively authorized; persist state transitions and use idempotency keys at side-effect boundaries to avoid duplicate transactions across replays; that control is assessed by repeated and interrupted test runs yielding exactly one committed credit per approved case; the incident instead requires invalid write payloads rejected before execution, with zero partial supplier mutations.

C:

Traceability explains decisions after the fact; it is not a replacement for preventing unauthorized source access; correlation IDs, source versions, and stage logs establish end-to-end lineage across extraction, retrieval, inference, and review; that control is assessed by fraction of sampled outputs reproducibly linked to input, model configuration, and reviewer disposition; the incident instead requires invalid write payloads rejected before execution, with zero partial supplier mutations.

Question 461

An IT helpdesk routes routine status inquiries through a lighter model and complex incidents through deeper analysis. Which measurement would show that tiering lowers cost without reducing accepted resolutions?

  1. p95 response time with all three source checks present under load
  2. Accepted resolution rate and cost per case across routed difficulty levels
  3. Cache-read rate, p95 latency, and cost per accepted answer under repeated queries
  4. Cost and successful throughput per nightly processing window

Explanation

Correct Answer

B:

Stratified monitoring confirms economic gains do not displace expensive errors onto users; measure accepted resolution rate and cost per case across routed difficulty levels at the release gate; evaluate a smaller model on straightforward request strata and escalate only where measurable capability is needed.

Incorrect Answers

A:

The acceptance signal guards against a fast but incomplete response; parallel retrieval with per-call budgets reduces wall time while preserving authorization and complete aggregation; this tests p95 response time with all three source checks present under load; the actual release condition is accepted resolution rate and cost per case across routed difficulty levels.

C:

Joint economics and quality checks demonstrate that reuse helps without sacrificing correctness; keep a stable eligible prompt prefix and measure cache-read tokens to reduce repeated processing; this tests cache-read rate, p95 latency, and cost per accepted answer under repeated queries; the actual release condition is accepted resolution rate and cost per case across routed difficulty levels.

D:

Deadline-oriented throughput is the relevant performance objective for noninteractive work; use suitable batch orchestration and queue control to trade immediate response time for predictable throughput and expense; this tests cost and successful throughput per nightly processing window; the actual release condition is accepted resolution rate and cost per case across routed difficulty levels.

Question 462

Reviewers cannot determine whether a wrong recommendation arose in OCR, policy extraction, or interpretation. Which action best removes the underlying failure mode?

  1. Divide work along independently verifiable artifacts
  2. Separate planning proposals from privileged execution
  3. Partition research by source and reconcile conflicts explicitly
  4. Checkpoint long-running work for replay and recovery

Explanation

Correct Answer

A:

Separate stages with typed artifacts allow validation and targeted reruns at meaningful boundaries; a traceable artifact boundary confines error analysis to the failed operation; verify the repair using stage-specific defect localization and repair without redoing previously validated stages.

Incorrect Answers

B:

Planning/execution separation does not fix whether the recommended plan uses current policy data; use a planning artifact that is reviewed and handed to a distinct authorized executor; never treat proposed tool calls as permission to mutate state; that control is assessed by unauthorized mutations during plan-only tests, with a target of zero; the incident instead requires stage-specific defect localization and repair without redoing previously validated stages.

C:

Simple partitioning can preserve conflicting claims unless the merge step includes a reconciliation rule; analyze source partitions separately, retain provenance, and reconcile contradictions through a dedicated synthesis stage; that control is assessed by conflict detection recall and citation coverage across independently processed source sets; the incident instead requires stage-specific defect localization and repair without redoing previously validated stages.

D:

Checkpointing reduces replay cost but cannot correct a defective classification rubric; durable checkpoints record validated intermediate artifacts and resume at safe boundaries with idempotent side effects; that control is assessed by successful recovery after injected worker failures without duplicated writes or stages; the incident instead requires stage-specific defect localization and repair without redoing previously validated stages.

Question 463

A US federal contractor proposes an AI workflow for information requiring a defined cloud authorization baseline. Which approach best meets the stated requirement?

  1. Apply accountable access, deletion, and retention processes
  2. Map data residency commitments to actual processing paths
  3. Validate FedRAMP authorization against exact service boundaries
  4. Minimize personal data and specify retention purpose

Explanation

Correct Answer

C:

Verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; boundary-specific checks prevent assuming certification transfers between unrelated services; evaluate the design with documented authorization-boundary mapping for every service handling regulated data.

Incorrect Answers

A:

Map data copies, implement lifecycle deletion where required, and retain audit evidence of the authorized request and its completion; deleting the original row does not automatically erase embeddings, caches, or observability copies; this alternative would measure deletion-request completion across all inventoried repositories within policy deadlines; it does not establish documented authorization-boundary mapping for every service handling regulated data for the described use case.

B:

Trace storage, inference, retrieval, logs, backups, and subprocessors against contractual and legal location requirements; locating the primary database domestically does not ensure every supporting service processes data there; this alternative would measure verified geographic processing paths for all sensitive request components; it does not establish documented authorization-boundary mapping for every service handling regulated data for the described use case.

D:

Limit processing to necessary authorized fields, define a lawful purpose and retention controls, and document relevant privacy obligations; broad encryption does not justify collecting more personal data than the task needs; this alternative would measure sensitive-field inclusion rate in prompts and retention-policy compliance; it does not establish documented authorization-boundary mapping for every service handling regulated data for the described use case.

Question 464

Following a safety policy revision, ordinary repair guidance is unexpectedly blocked. Which before-and-after evaluation would reveal whether reduced unsafe output has caused unacceptable over-refusal?

  1. Percent of failures with a complete trace to the responsible stage
  2. Detection of version-specific quality regressions in a staged rollout
  3. Reproduction of sampled reviewer defects against their original configuration
  4. Safety precision/recall and legitimate-task completion before and after the change

Explanation

Correct Answer

D:

Paired monitoring distinguishes beneficial safety controls from excessive refusals; measure safety precision/recall and legitimate-task completion before and after the change at the release gate; monitor both harmful-output violations and false-positive blocks by version and user segment.

Incorrect Answers

A:

Trace completeness measures incident diagnosability rather than raw log volume; correlation and span IDs across components allow latency and failure attribution along the actual path; this tests percent of failures with a complete trace to the responsible stage; the actual release condition is safety precision/recall and legitimate-task completion before and after the change.

B:

Release segmentation isolates changes before broad impact; partition traces and scored outcomes by deployed configuration, using release identifiers to support rollback and diagnosis; this tests detection of version-specific quality regressions in a staged rollout; the actual release condition is safety precision/recall and legitimate-task completion before and after the change.

C:

Version-linked labels enable targeted, testable corrections; log consented feedback alongside prompt revision, model route, source version, and case context for reproducible analysis; this tests reproduction of sampled reviewer defects against their original configuration; the actual release condition is safety precision/recall and legitimate-task completion before and after the change.

Question 465

The assistant includes a copied bearer token in its response to a routine diagnostic question. Which corrective change best addresses the root cause?

  1. Delimit retrieved content as untrusted evidence
  2. Keep invariant policy instructions distinct from per-request input
  3. Use a machine-readable output contract and validator
  4. Limit disclosure of secrets and confidential instructions

Explanation

Correct Answer

D:

Redact sensitive fields upstream, prohibit secret reproduction in instructions, and screen outbound content before release; seeded canaries allow a measurable check of unwanted disclosure paths; verify the repair using secret-exposure rate under seeded credential-bearing diagnostic inputs.

Incorrect Answers

A:

Delimiters aid instruction hierarchy but do not sanitize malicious destinations or replace output security controls; clearly separate lower-trust source material from application instructions and enforce permissions at the tool layer as well; that control is assessed by prompt-injection resistance on hostile retrieved snippets without loss of legitimate source use; the incident instead requires secret-exposure rate under seeded credential-bearing diagnostic inputs.

B:

A modular instruction layout does not itself prove that external API permissions are enforced; separate stable system-level policy from user content and tool results, retaining consistent privilege boundaries across requests; that control is assessed by rate of user messages that fail to override defined task boundaries in regression tests; the incident instead requires secret-exposure rate under seeded credential-bearing diagnostic inputs.

C:

Human-readable examples alone do not guarantee that all runtime outputs satisfy machine contracts; request a documented structured format and validate schema, allowed values, and business semantics before downstream use; that control is assessed by valid schema rate and zero unauthorized enum values reaching the consumer; the incident instead requires secret-exposure rate under seeded credential-bearing diagnostic inputs.

Question 466

A publisher needs to process a large archive of text overnight, with no expectation of interactive responses. A mechanical troubleshooting assistant must decide which diagnostic tests to run only after seeing intermediate measurements. Which TWO processing patterns are most suitable? Choose TWO.

  1. Use a deterministic workflow for known ordered stages
  2. Use a bounded tool-using agent for exploratory investigation
  3. Use offline batch processing when immediate interactivity is unnecessary
  4. Ground dynamic policy answers with retrieval
  5. Embed a small agent inside a controlled workflow

Explanation

Correct Answers

B:

Bounded agentic planning chooses follow-up tools from observed evidence while enforcing time, budget, and tool permissions; the agent must demonstrate flexible discovery without escaping its operational guardrails; its corresponding workstream should be validated by resolution of unseen diagnostic branches within a specified tool-call and time budget.

C:

Batch-oriented orchestration handles throughput, retries, and cost planning while preserving consistent model instructions for a noninteractive workload; throughput and unit economics measure the benefit that a user-facing latency metric would miss; its corresponding workstream should be validated by completed valid classifications per batch window and cost per accepted record.

Incorrect Answers

A:

A fixed sequence is appropriate for known, ordered checks, but bulk overnight classification benefits from batch processing, whereas open-ended equipment diagnosis needs bounded adaptive tool selection; a deterministic chain alone meets neither requirement.

D:

Retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; retrieval does not create new authoritative policy; its natural acceptance measure is correct citations to currently effective policy versions across update tests, which does not satisfy the separate workstreams being assessed.

E:

A small agent embedded in a controlled workflow can preserve mandated steps while allowing some exploration, but this paired decision calls for an economical offline batch lane and a separate exploratory diagnostic agent; the hybrid pattern is not the most direct solution to both.

Question 467

Per-request price decreases while the proportion requiring a second run doubles. How should the design be corrected?

  1. Reuse expensive stable prefixes through prompt caching
  2. Reduce context using retrieval and relevance filtering
  3. Tune cost using the rate of acceptable outcomes
  4. Route straightforward requests to a validated economical model

Explanation

Correct Answer

C:

Optimize total cost per successful output with floor constraints on completeness, safety, and latency; quality-constrained unit economics penalizes truncation and repeat work; verify the repair using all-in cost per accepted summary at a fixed mandatory-section completion rate.

Incorrect Answers

A:

Selecting a smaller model alone may reduce price but does not address wasted recomputation of invariant content; keep a stable eligible prompt prefix and measure cache-read tokens to reduce repeated processing; that control is assessed by cache-read rate, p95 latency, and cost per accepted answer under repeated queries; the incident instead requires all-in cost per accepted summary at a fixed mandatory-section completion rate.

B:

Token truncation at arbitrary character positions can remove governing exceptions and worsen accuracy; retrieve relevant excerpts and retain enough surrounding evidence for interpretation rather than indiscriminately filling the context window; that control is assessed by supported-answer rate per input token on labeled audit questions; the incident instead requires all-in cost per accepted summary at a fixed mandatory-section completion rate.

D:

Using the cheapest model universally could impair complex or safety-critical cases; evaluate a smaller model on straightforward request strata and escalate only where measurable capability is needed; that control is assessed by accepted resolution rate and cost per case across routed difficulty levels; the incident instead requires all-in cost per accepted summary at a fixed mandatory-section completion rate.

Question 468

Repeatedly processing unchanged background instructions dominates input cost and slows response startup. How should the design be corrected?

  1. Cache a stable, high-volume prompt prefix
  2. Trace cache effectiveness with token usage counters
  3. Modularize shared task instructions for consistent reuse
  4. Keep dynamic fields out of cached prefix content

Explanation

Correct Answer

A:

Put reusable instructions and reference material in a consistent prefix and use supported prompt-cache controls while placing variable requests afterward; cache-hit telemetry verifies the optimization rather than relying on estimated token savings; verify the repair using cache-read input tokens and end-to-end latency over repeated requests.

Incorrect Answers

B:

A faster model might improve latency but would not explain a missing cache hit on identical prompts; compare cache-creation and cache-read token telemetry and inspect prefix ordering, eligible size, and reuse timing; that control is assessed by sustained cache-read token share under repeated workload replay; the incident instead requires cache-read input tokens and end-to-end latency over repeated requests.

C:

Prompt modularity simplifies governance; it cannot alone guarantee that a sensitive tool call is authorized; maintain a versioned reusable prompt module with explicit parameters and regression tests across consumers; that control is assessed by cross-application prompt-version alignment and regression pass rate; the incident instead requires cache-read input tokens and end-to-end latency over repeated requests.

D:

A cache breakpoint cannot compensate for changes to earlier content in the hashed prefix; move changing metadata after the stable prefix so cache keys remain reusable across otherwise similar requests; that control is assessed by prefix reuse ratio when request metadata changes across calls; the incident instead requires cache-read input tokens and end-to-end latency over repeated requests.

Question 469

An international bank promises that specified customer records stay in an approved geographic jurisdiction. What should the solution architect recommend?

  1. Assess privacy risks and lawful processing grounds early
  2. Map data residency commitments to actual processing paths
  3. Validate FedRAMP authorization against exact service boundaries
  4. Check HIPAA business associate and safeguard requirements
  5. Implement accountable access, deletion, and retention processes

Explanation

Correct Answer

B:

Trace storage, inference, retrieval, logs, backups, and subprocessors against contractual and legal location requirements; a full data-flow audit finds secondary exports that primary-storage checks miss; evaluate the design with verified geographic processing paths for all sensitive request components.

Incorrect Answers

A:

Involve privacy counsel to assess applicable lawful bases, transparency, rights, and whether a data-protection impact assessment is required before release; technical model accuracy does not establish permission to process sensitive personal information; this alternative would measure completion of required privacy assessment and recorded resolution of high risks before go-live; it does not establish verified geographic processing paths for all sensitive request components for the described use case.

C:

Verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; a general government-cloud label or vendor marketing statement is not equivalent to FedRAMP authorization; this alternative would measure documented authorization-boundary mapping for every service handling regulated data; it does not establish verified geographic processing paths for all sensitive request components for the described use case.

D:

Confirm the specific service and contract support relevant HIPAA obligations, including any required business associate agreement and safeguards; a provider security claim alone does not prove that the purchased deployment is contractually suitable for PHI; this alternative would measure approved contracting, access controls, and PHI data-flow verification for the selected service path; it does not establish verified geographic processing paths for all sensitive request components for the described use case.

E:

Map data copies, implement lifecycle deletion where required, and retain audit evidence of the authorized request and its completion; deleting the original row does not automatically erase embeddings, caches, or observability copies; this alternative would measure deletion-request completion across all inventoried repositories within policy deadlines; it does not establish verified geographic processing paths for all sensitive request components for the described use case.

Question 470

A customer-support change increases total resolution but worsens outcomes for users on an accessibility channel. What should the solution architect recommend?

  1. Predefine success criteria and sample-size assumptions
  2. Inspect segment-level effects rather than only global lift
  3. Use shadow evaluation before enabling new side effects
  4. Release canaries with guardrail metrics and rollback conditions

Explanation

Correct Answer

B:

Compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable; segment-aware decisions expose concentrated regressions before full rollout; evaluate the design with resolution and safety deltas by channel and accessibility segment.

Incorrect Answers

A:

Define primary metrics, minimal meaningful effect, sample-size method, and stopping rules before examining results; repeatedly peeking and stopping at a favorable fluctuation inflates false-positive decisions; this alternative would measure pre-registered experiment compliance and interval estimates at the planned sample size; it does not establish resolution and safety deltas by channel and accessibility segment for the described use case.

C:

Replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately; a normal A/B test is inappropriate if experimental behavior can cause unreviewed irreversible changes; this alternative would measure shadow-policy agreement and zero write side effects across replayed billing cases; it does not establish resolution and safety deltas by channel and accessibility segment for the described use case.

D:

Deploy to a bounded cohort while observing quality, errors, and tail latency, with predefined stop and rollback thresholds; a single offline score cannot show all production interactions or blast radius; this alternative would measure canary threshold compliance and time to revert a seeded regression; it does not establish resolution and safety deltas by channel and accessibility segment for the described use case.

Claude Certified Architect - Professional (CCAR-P) Practice Tests