Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 24

Question 230

A platform team allows independent squads to add tools to a shared Claude deployment without review. What is the most defensible next step?

  1. Audit tool manifests as versioned production configuration
  2. Separate read-only retrieval from mutating tools
  3. Write unambiguous tool descriptions and input schemas
  4. Stage privileged capabilities only after explicit intent confirmation

Explanation

Correct Answer

A:

Maintain owner-approved manifests with risk classification, contract checks, permission reviews, and change-control gates; policy-based manifest validation detects excessive authority before runtime exposure; evaluate the design with changes rejected when requested tool scopes exceed the approved task manifest.

Incorrect Answers

B:

Expose narrowly scoped read-only capabilities and gate changes through separate authenticated write paths with explicit approvals; a generic read-write interface offers more authority than the reporting workflow requires; this alternative would measure zero mutation permissions for report-only identities across tool contract checks; it does not establish changes rejected when requested tool scopes exceed the approved task manifest for the described use case.

C:

Define task-specific descriptions, typed arguments, required fields, and clear side-effect semantics so tool selection is meaningful; a richer schema improves selection but does not override a backend that ignores caller authorization; this alternative would measure correct tool-selection rate for ambiguous intents and invalid-argument rejection; it does not establish changes rejected when requested tool scopes exceed the approved task manifest for the described use case.

D:

Reveal high-impact tools only within a confirmed, authorized transaction stage; maintain server-side gating independently of model choice; hiding a tool in ordinary prompts is a defense-in-depth measure, not sufficient if APIs permit unauthorized direct calls; this alternative would measure absence of privileged tool calls before the confirmed transaction stage; it does not establish changes rejected when requested tool scopes exceed the approved task manifest for the described use case.

Question 231

An analyst platform evaluates many unrelated contract provisions concurrently, then merges the results. Which stress-test outcome shows that shared-state races no longer lose findings?

  1. Stage-specific defect localization and repair without redoing previously validated stages
  2. Unauthorized mutations during plan-only tests, with a target of zero
  3. Contract test pass rate for independently upgraded stages and invalid payload rejection
  4. Correct merged clause counts across repeated parallel execution races

Explanation

Correct Answer

D:

Deterministic merge checks measure integrity rather than only wall-clock speed; measure correct merged clause counts across repeated parallel execution races at the release gate; isolate independent tasks, retain separate results, then join only when required dependencies have completed.

Incorrect Answers

A:

A traceable artifact boundary confines error analysis to the failed operation; separate stages with typed artifacts allow validation and targeted reruns at meaningful boundaries; this tests stage-specific defect localization and repair without redoing previously validated stages; the actual release condition is correct merged clause counts across repeated parallel execution races.

B:

This tests enforcement at the action boundary rather than relying on prose instructions; use a planning artifact that is reviewed and handed to a distinct authorized executor; never treat proposed tool calls as permission to mutate state; this tests unauthorized mutations during plan-only tests, with a target of zero; the actual release condition is correct merged clause counts across repeated parallel execution races.

C:

Versioned interfaces expose breaking changes before a multi-team deployment; typed versioned contracts and compatibility tests let stages evolve while preserving their callers' assumptions; this tests contract test pass rate for independently upgraded stages and invalid payload rejection; the actual release condition is correct merged clause counts across repeated parallel execution races.

Question 232

A human-resources team needs to turn a supplied meeting transcript into a standard summary with no external actions. What is the most targeted architecture choice?

  1. Ground dynamic policy answers with retrieval
  2. Use a single augmented-LLM call for a bounded text transformation
  3. Use a deterministic workflow for known ordered stages
  4. Embed a small agent inside a controlled workflow

Explanation

Correct Answer

B:

For a fixed transformation, a prompt enriched with only needed context is simpler, cheaper, and easier to evaluate than an agentic loop; a bounded call should meet the content rubric without introducing an unnecessary action surface; evaluate the design with summary fidelity and p95 completion time without any unapproved tool invocation.

Incorrect Answers

A:

Retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; retrieval does not create new authoritative policy; it depends on freshness, correct permissions, and source quality; this alternative would measure correct citations to currently effective policy versions across update tests; it does not establish summary fidelity and p95 completion time without any unapproved tool invocation for the described use case.

C:

Explicit state transitions preserve required order, testing points, and deterministic branch conditions; Claude can supply judgment inside selected stages; a rigid sequence becomes cumbersome when the next action is genuinely unknown until exploratory results arrive; this alternative would measure rate of recommendations backed by all required completed stage checks; it does not establish summary fidelity and p95 completion time without any unapproved tool invocation for the described use case.

D:

Place bounded exploratory reasoning inside one stage of a deterministic state machine; enforce approval and write permissions outside the agent; a fully autonomous controller is not needed when most transitions and side effects are governed by policy; this alternative would measure disputed-case resolution with every refund still passing the identity and approval gates; it does not establish summary fidelity and p95 completion time without any unapproved tool invocation for the described use case.

Question 233

A support assistant tests two prompt strategies but frequent users are exposed to both, affecting their follow-up behavior. Which approach best meets the stated requirement?

  1. Randomize consistently at the user or account level
  2. Release canaries with guardrail metrics and rollback conditions
  3. Use shadow evaluation before enabling new side effects
  4. Require an explicit rollback trigger for harmful regressions

Explanation

Correct Answer

A:

Assign a stable randomized unit aligned to the behavior being measured and maintain consistent treatment during the experiment; stable assignments preserve causal interpretation for repeated sessions; evaluate the design with balanced treatment cohorts and clean user-level exposure histories.

Incorrect Answers

B:

Deploy to a bounded cohort while observing quality, errors, and tail latency, with predefined stop and rollback thresholds; a single offline score cannot show all production interactions or blast radius; this alternative would measure canary threshold compliance and time to revert a seeded regression; it does not establish balanced treatment cohorts and clean user-level exposure histories for the described use case.

C:

Replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately; a normal A/B test is inappropriate if experimental behavior can cause unreviewed irreversible changes; this alternative would measure shadow-policy agreement and zero write side effects across replayed billing cases; it does not establish balanced treatment cohorts and clean user-level exposure histories for the described use case.

D:

Establish automated and human-owned rollback triggers tied to critical error and unauthorized-action indicators; monitoring without an action threshold can document harm while allowing it to continue; this alternative would measure time from triggered guardrail breach to verified rollback; it does not establish balanced treatment cohorts and clean user-level exposure histories for the described use case.

Question 234

Engineers increase model capability instead of examining the failing search connector. Which intervention targets the defect rather than its symptoms?

  1. Roll back to a known-good tool and prompt release
  2. Reproduce incidents using correlated logs and configuration versions
  3. Distinguish model selection faults from tool execution failures
  4. Replay failures safely with sanitized inputs

Explanation

Correct Answer

C:

Classify tool errors separately from model responses, validate return codes, and probe the failing integration before changing prompts; controlled fault injection tests whether the team diagnoses the failing layer; verify the repair using correct root-cause attribution under injected search timeouts.

Incorrect Answers

A:

Repeated untracked hotfixes can compound an outage and obscure the initial trigger; maintain versioned releases and documented rollback steps for hooks, prompts, model routes, and connector configuration; that control is assessed by time to restore normal operation using an approved previous release; the incident instead requires correct root-cause attribution under injected search timeouts.

B:

A guessed prompt rewrite is unlikely to repair a fault that has not been isolated; collect privacy-safe traces, request IDs, environment details, and exact configuration revisions to establish a reproducible failure case; that control is assessed by reproduction rate of sampled incidents from stored sanitized diagnostic metadata; the incident instead requires correct root-cause attribution under injected search timeouts.

D:

Raw transcript reuse can expose confidential inputs and violate data-handling policies; build redacted, access-controlled replay fixtures preserving relevant syntax and error conditions without unnecessary secrets or personal data; that control is assessed by bug reproduction on sanitized fixtures with no sensitive token disclosure; the incident instead requires correct root-cause attribution under injected search timeouts.

Question 235

The full tool schema catalog consumes a large share of every prompt and causes wrong-tool selection. How should the design be corrected?

  1. Fetch detailed schemas only for shortlisted actions
  2. Preserve stable prefixes while dynamically discovering tools
  3. Load capability groups after intent classification
  4. Use searchable tool discovery for large catalogs

Explanation

Correct Answer

D:

Expose a lean search or discovery interface and load relevant detailed tools only after intent is established; discovery quality must preserve necessary capabilities while shrinking unused schema context; verify the repair using tool-choice accuracy and context-token savings on varied employee requests.

Incorrect Answers

A:

Schema-on-demand still needs strict parameter validation at execution time; keep concise discovery metadata initially and retrieve the precise argument schema when a tool becomes actionable; that control is assessed by schema-token consumption and invalid-argument rate after staged loading; the incident instead requires tool-choice accuracy and context-token savings on varied employee requests.

B:

Progressive discovery can lose its token advantage if dynamic tool definitions repeatedly destroy cache reuse; isolate stable instructions from changing discovery payloads and measure cache behavior when tool inventories vary; that control is assessed by cache-read tokens and total context cost while changing selected tool subsets; the incident instead requires tool-choice accuracy and context-token savings on varied employee requests.

C:

Capability-group routing cannot replace policy enforcement once a sensitive tool is selected; select a bounded task-specific capability group after intent routing with conservative fallback for ambiguous requests; that control is assessed by irrelevant tool exposure per intent with no loss of required task completion; the incident instead requires tool-choice accuracy and context-token savings on varied employee requests.

Question 236

A legal-assistance team has turned reviewer corrections into tracked regression cases. The next model revision must show it no longer drops exceptions identified in previous reviews. Which acceptance measure is most relevant?

  1. Repeated and interrupted test runs yielding exactly one committed credit per approved case
  2. Job completion rate and queue age during the peak intake window
  3. Fraction of sampled outputs reproducibly linked to input, model configuration, and reviewer disposition
  4. Regression pass rate on previously corrected clause-omission cases
  5. Invalid write payloads rejected before execution, with zero partial supplier mutations

Explanation

Correct Answer

D:

Retesting concrete corrections detects whether a release reintroduces known business mistakes; measure regression pass rate on previously corrected clause-omission cases at the release gate; preserve authorized reviewer labels linked to case versions and turn them into regression examples with data-retention controls.

Incorrect Answers

A:

Replay tests directly exercise the failure window that typically creates duplicate writes; persist state transitions and use idempotency keys at side-effect boundaries to avoid duplicate transactions across replays; this tests repeated and interrupted test runs yielding exactly one committed credit per approved case; the actual release condition is regression pass rate on previously corrected clause-omission cases.

B:

Measuring backlog and completion under load tests the exact burst tolerance the design promises; decouple intake from processing through durable queues, bounded workers, and status callbacks rather than keeping user connections open; this tests job completion rate and queue age during the peak intake window; the actual release condition is regression pass rate on previously corrected clause-omission cases.

C:

End-to-end provenance lets reviewers investigate disputed outcomes without assuming the final text is self-evidencing; correlation IDs, source versions, and stage logs establish end-to-end lineage across extraction, retrieval, inference, and review; this tests fraction of sampled outputs reproducibly linked to input, model configuration, and reviewer disposition; the actual release condition is regression pass rate on previously corrected clause-omission cases.

E:

Pre-write enforcement proves that the model cannot bypass the target system's integrity contract; use structured output parsing, semantic validation, and a separate authorized command handler so generated text is never treated directly as a write instruction; this tests invalid write payloads rejected before execution, with zero partial supplier mutations; the actual release condition is regression pass rate on previously corrected clause-omission cases.

Question 237

An agent is being redesigned to propose financial adjustments. The team wants to evaluate its choices on real historical cases without allowing any newly generated write to execute. Which test result establishes safe comparison?

  1. Balanced treatment cohorts and clean user-level exposure histories
  2. Resolution and safety deltas by channel and accessibility segment
  3. Time from triggered guardrail breach to verified rollback
  4. Shadow-policy agreement and zero write side effects across replayed billing cases

Explanation

Correct Answer

D:

Non-mutating evidence reduces risk before enabling operational authority; measure shadow-policy agreement and zero write side effects across replayed billing cases at the release gate; replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately.

Incorrect Answers

A:

Stable assignments preserve causal interpretation for repeated sessions; assign a stable randomized unit aligned to the behavior being measured and maintain consistent treatment during the experiment; this tests balanced treatment cohorts and clean user-level exposure histories; the actual release condition is shadow-policy agreement and zero write side effects across replayed billing cases.

B:

Segment-aware decisions expose concentrated regressions before full rollout; compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable; this tests resolution and safety deltas by channel and accessibility segment; the actual release condition is shadow-policy agreement and zero write side effects across replayed billing cases.

C:

Operational readiness includes the ability to stop unsafe experiments promptly; establish automated and human-owned rollback triggers tied to critical error and unauthorized-action indicators; this tests time from triggered guardrail breach to verified rollback; the actual release condition is shadow-policy agreement and zero write side effects across replayed billing cases.

Question 238

A revised search stack is introduced to a limited tenant cohort while engineers inject a performance regression. Which result would prove that the canary gate and reversal procedure protect remaining customers?

  1. Measured shadow-policy agreement and zero write side effects across replayed billing cases
  2. Resolution and safety deltas by channel and accessibility segment
  3. Time from triggered guardrail breach to verified rollback
  4. Canary threshold compliance and time to revert a seeded regression

Explanation

Correct Answer

D:

Controlled exposure and rollback readiness limit the damage of an unexpected release; measure canary threshold compliance and time to revert a seeded regression at the release gate; deploy to a bounded cohort while observing quality, errors, and tail latency, with predefined stop and rollback thresholds.

Incorrect Answers

A:

Non-mutating evidence reduces risk before enabling operational authority; replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately; this tests shadow-policy agreement and zero write side effects across replayed billing cases; the actual release condition is canary threshold compliance and time to revert a seeded regression.

B:

Segment-aware decisions expose concentrated regressions before full rollout; compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable; this tests resolution and safety deltas by channel and accessibility segment; the actual release condition is canary threshold compliance and time to revert a seeded regression.

C:

Operational readiness includes the ability to stop unsafe experiments promptly; establish automated and human-owned rollback triggers tied to critical error and unauthorized-action indicators; this tests time from triggered guardrail breach to verified rollback; the actual release condition is canary threshold compliance and time to revert a seeded regression.

Question 239

A European employee assistant copies full HR dossiers into every model request to answer short benefits questions. What action best fits the business and technical boundary?

  1. Check HIPAA business associate and safeguard requirements
  2. Validate FedRAMP authorization against exact service boundaries
  3. Map data residency commitments to actual processing paths
  4. Minimize personal data and specify retention purpose
  5. Implement accountable access, deletion, and retention processes

Explanation

Correct Answer

D:

Limit processing to necessary authorized fields, define a lawful purpose and retention controls, and document relevant privacy obligations; data-flow sampling checks actual minimization rather than relying only on a policy statement; evaluate the design with sensitive-field inclusion rate in prompts and retention-policy compliance.

Incorrect Answers

A:

Confirm the specific service and contract support relevant HIPAA obligations, including any required business associate agreement and safeguards; a provider security claim alone does not prove that the purchased deployment is contractually suitable for PHI; this alternative would measure approved contracting, access controls, and PHI data-flow verification for the selected service path; it does not establish sensitive-field inclusion rate in prompts and retention-policy compliance for the described use case.

B:

Verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; a general government-cloud label or vendor marketing statement is not equivalent to FedRAMP authorization; this alternative would measure documented authorization-boundary mapping for every service handling regulated data; it does not establish sensitive-field inclusion rate in prompts and retention-policy compliance for the described use case.

C:

Trace storage, inference, retrieval, logs, backups, and subprocessors against contractual and legal location requirements; locating the primary database domestically does not ensure every supporting service processes data there; this alternative would measure verified geographic processing paths for all sensitive request components; it does not establish sensitive-field inclusion rate in prompts and retention-policy compliance for the described use case.

E:

Map data copies, implement lifecycle deletion where required, and retain audit evidence of the authorized request and its completion; deleting the original row does not automatically erase embeddings, caches, or observability copies; this alternative would measure deletion-request completion across all inventoried repositories within policy deadlines; it does not establish sensitive-field inclusion rate in prompts and retention-policy compliance for the described use case.

Question 240

A catalog assistant receives many repeated public product questions while underlying SKUs change only at managed publish times. What is the most defensible next step?

  1. Use a safe limited answer when the deadline would otherwise be missed
  2. Cache safe, version-keyed retrieval responses
  3. Move slow operations into asynchronous jobs with progress states
  4. Route expensive reasoning to high-uncertainty cases
  5. Rerank a short candidate set for ambiguous retrieval queries

Explanation

Correct Answer

B:

Use a cache keyed by query, permissions where relevant, and content version, with invalidation tied to source updates; freshness and authorization checks are essential alongside speed gains; evaluate the design with repeated-query latency with zero stale or cross-scope cache responses after updates.

Incorrect Answers

A:

Keep the critical verified signal independent and return a clearly limited result when optional enrichment exceeds its budget; silently presenting an unverified enriched conclusion would violate accuracy requirements despite meeting a timer; this alternative would measure deadline compliance and correct indication of omitted enrichment; it does not establish repeated-query latency with zero stale or cross-scope cache responses after updates for the described use case.

C:

Acknowledge an asynchronous job, persist its state, and let the client poll or receive authorized completion notifications; a longer synchronous timeout would still tie up request resources and expose users to unreliable waits; this alternative would measure job completion reliability and duplicate-submission rate during slow-system simulations; it does not establish repeated-query latency with zero stale or cross-scope cache responses after updates for the described use case.

D:

Use an evaluated routing policy that sends straightforward lookups to a light path and escalates uncertain cases to more capable reasoning; uniform deep reasoning does not add value to deterministic records and may increase response time; this alternative would measure accuracy by difficulty segment and unit cost under p95 constraints; it does not establish repeated-query latency with zero stale or cross-scope cache responses after updates for the described use case.

E:

Retrieve a bounded candidate set and rerank against the actual question to concentrate useful evidence without feeding all candidates to the model; taking every retrieved hit into context may raise token cost and distraction without raising answer quality; this alternative would measure grounded-answer accuracy and retrieval-stage p95 latency at several rerank depths; it does not establish repeated-query latency with zero stale or cross-scope cache responses after updates for the described use case.

Claude Certified Architect - Professional (CCAR-P) Practice Tests