Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 30

Question 290

An internal assistant is being selected for peak traffic and variable response deadlines. The enterprise buyer wants performance claims that different vendors can test consistently. Which acceptance evidence best establishes the shared service target?

  1. Signed acceptance criteria mapped to demonstrable tests and named owners
  2. Resolution rate of prioritized unknowns through measured prototypes
  3. Agreed p95, availability, and load thresholds exercised in an acceptance environment
  4. Percentage of required sources with approved owners, legal uses, and integration paths

Explanation

Correct Answer

C:

Measurable NFRs turn vague expectations into testable architecture constraints; measure agreed p95, availability, and load thresholds exercised in an acceptance environment at the release gate; specify capacity, tail latency, availability, privacy, and recovery objectives with measurement windows and ownership.

Incorrect Answers

A:

An explicit agreement limits scope drift and creates a common release standard; document in-scope outcomes, exclusions, metrics, responsibilities, and go-live gates for accountable approval; this tests signed acceptance criteria mapped to demonstrable tests and named owners; the actual release condition is agreed p95, availability, and load thresholds exercised in an acceptance environment.

B:

Evidence-based discovery reduces commitment to unverified technical assumptions; identify high-risk assumptions and design small feasibility spikes with explicit success and stop criteria; this tests resolution rate of prioritized unknowns through measured prototypes; the actual release condition is agreed p95, availability, and load thresholds exercised in an acceptance environment.

D:

Data ownership completeness measures feasibility before engineering spends effort; create a source inventory with accountable owners, sensitivity, update rate, and approval dependencies before committing to the design; this tests percentage of required sources with approved owners, legal uses, and integration paths; the actual release condition is agreed p95, availability, and load thresholds exercised in an acceptance environment.

Question 291

A new retrieval stack improves benchmark accuracy but may affect only one tenant's latency. What is the most defensible next step?

  1. Review segment-level effects rather than only global lift
  2. Randomize consistently at the user or account level
  3. Release canaries with guardrail metrics and rollback conditions
  4. Predefine success criteria and sample-size assumptions

Explanation

Correct Answer

C:

Deploy to a bounded cohort while observing quality, errors, and tail latency, with predefined stop and rollback thresholds; controlled exposure and rollback readiness limit the damage of an unexpected release; evaluate the design with canary threshold compliance and time to revert a seeded regression.

Incorrect Answers

A:

Compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable; a positive overall average does not guarantee every relevant user group benefits; this alternative would measure resolution and safety deltas by channel and accessibility segment; it does not establish canary threshold compliance and time to revert a seeded regression for the described use case.

B:

Assign a stable randomized unit aligned to the behavior being measured and maintain consistent treatment during the experiment; request-by-request randomization can be invalid when outcomes depend on ongoing user interactions; this alternative would measure balanced treatment cohorts and clean user-level exposure histories; it does not establish canary threshold compliance and time to revert a seeded regression for the described use case.

D:

Define primary metrics, minimal meaningful effect, sample-size method, and stopping rules before examining results; repeatedly peeking and stopping at a favorable fluctuation inflates false-positive decisions; this alternative would measure pre-registered experiment compliance and interval estimates at the planned sample size; it does not establish canary threshold compliance and time to revert a seeded regression for the described use case.

Question 292

A refund question receives shipping, catalog-editing, and accounting tools before its intent is understood. Which intervention targets the defect rather than its symptoms?

  1. Load capability groups after intent classification
  2. Load detailed reference material only when it is needed
  3. Fetch detailed schemas only for shortlisted actions
  4. Preserve stable prefixes while dynamically discovering tools

Explanation

Correct Answer

A:

Select a bounded task-specific capability group after intent routing with conservative fallback for ambiguous requests; exposure and completion metrics together reveal whether dynamic loading is too aggressive; verify the repair using irrelevant tool exposure per intent with no loss of required task completion.

Incorrect Answers

B:

Reference discovery without source-version checks can still supply outdated interface information; discover resource summaries first and fetch the specific authoritative documentation section at the point of need; that control is assessed by correct endpoint contract use with lower documentation-token overhead; the incident instead requires irrelevant tool exposure per intent with no loss of required task completion.

C:

Schema-on-demand still needs strict parameter validation at execution time; keep concise discovery metadata initially and retrieve the precise argument schema when a tool becomes actionable; that control is assessed by schema-token consumption and invalid-argument rate after staged loading; the incident instead requires irrelevant tool exposure per intent with no loss of required task completion.

D:

Progressive discovery can lose its token advantage if dynamic tool definitions repeatedly destroy cache reuse; isolate stable instructions from changing discovery payloads and measure cache behavior when tool inventories vary; that control is assessed by cache-read tokens and total context cost while changing selected tool subsets; the incident instead requires irrelevant tool exposure per intent with no loss of required task completion.

Question 293

An onboarding knowledge portal is tested with questions written by new employees who do not use the manuals' formal terminology. Which result would prove that concept-level retrieval generalizes to paraphrases?

  1. Joint exact-identifier accuracy and semantic-symptom recall on mixed queries
  2. Exact aggregate agreement with a trusted query on authorized records
  3. Recall on human-authored paraphrases absent from manual headings
  4. Conditional-rule accuracy with and without parent-document expansion

Explanation

Correct Answer

C:

Paraphrase benchmark cases test the capability for which embeddings are chosen; measure recall on human-authored paraphrases absent from manual headings at the release gate; vector retrieval can match conceptual similarity between user wording and document text, followed by evidence verification.

Incorrect Answers

A:

The evaluation must verify both constraints at once rather than reporting only aggregate relevance; hybrid retrieval joins exact-term and semantic evidence, then applies metadata filtering and ranking; this tests joint exact-identifier accuracy and semantic-symptom recall on mixed queries; the actual release condition is recall on human-authored paraphrases absent from manual headings.

B:

A structured oracle detects missing rows and arithmetic mistakes; use a governed structured query interface with parameter checks and business semantics for exact aggregates; this tests exact aggregate agreement with a trusted query on authorized records; the actual release condition is recall on human-authored paraphrases absent from manual headings.

D:

Context reconstruction tests whether narrow hits are interpreted in their governing scope; use child-chunk retrieval for recall and fetch validated parent context or adjacent governing sections for interpretation; this tests conditional-rule accuracy with and without parent-document expansion; the actual release condition is recall on human-authored paraphrases absent from manual headings.

Question 294

A coding assistant's new hook configuration blocks every developer commit shortly after deployment. Which strategy should be prioritized for this requirement?

  1. Re-create incidents from correlated logs and configuration versions
  2. Replay failures safely with sanitized inputs
  3. Distinguish model selection faults from tool execution failures
  4. Roll back to a known-good tool and prompt release

Explanation

Correct Answer

D:

Maintain versioned releases and documented rollback steps for hooks, prompts, model routes, and connector configuration; a rollback drill verifies that recovery does not depend on the original developer being online; evaluate the design with time to restore normal operation using an approved previous release.

Incorrect Answers

A:

Collect privacy-safe traces, request IDs, environment details, and exact configuration revisions to establish a reproducible failure case; a guessed prompt rewrite is unlikely to repair a fault that has not been isolated; this alternative would measure reproduction rate of sampled incidents from stored sanitized diagnostic metadata; it does not establish time to restore normal operation using an approved previous release for the described use case.

B:

Build redacted, access-controlled replay fixtures preserving relevant syntax and error conditions without unnecessary secrets or personal data; raw transcript reuse can expose confidential inputs and violate data-handling policies; this alternative would measure bug reproduction on sanitized fixtures with no sensitive token disclosure; it does not establish time to restore normal operation using an approved previous release for the described use case.

C:

Classify tool errors separately from model responses, validate return codes, and probe the failing integration before changing prompts; a more capable model cannot read data from a tool that never returns successfully; this alternative would measure correct root-cause attribution under injected search timeouts; it does not establish time to restore normal operation using an approved previous release for the described use case.

Question 295

A developer changes local Claude Code settings to bypass the security team’s approved command-permission policy. Which centrally governed configuration layer can prevent the override?

  1. Version team-wide CLAUDE.md guidance with the repository
  2. Limit MCP connections by project and user identity
  3. Use managed configuration to constrain dangerous permissions
  4. Use specialized subagents with bounded tools and instructions

Explanation

Correct Answer

C:

Use organization-managed policy and supported permission configuration so enforced restrictions cannot be casually overridden by per-user convenience settings; policy precedence tests validate that enterprise controls remain effective; verify the repair using denial of prohibited commands after attempts to override local and project configuration.

Incorrect Answers

A:

A documentation file guides behavior but cannot enforce operating-system permissions or replace CI tests; put reviewed repository-specific guidance in a shared CLAUDE.md file with appropriate scope and code review; that control is assessed by consistency of generated changes with repository build and test conventions across fresh sessions; the incident instead requires denial of prohibited commands after attempts to override local and project configuration.

B:

A working connection does not prove the assistant is restricted to the user's intended project resources; choose appropriate configuration scope and per-user or service authorization for MCP servers, avoiding shared cross-project secrets; that control is assessed by access denial for cross-project MCP resources under user identity tests; the incident instead requires denial of prohibited commands after attempts to override local and project configuration.

D:

Delegation without role scoping merely multiplies the number of powerful agents; give each delegated role explicit objectives, context limits, and tool permissions with clear return artifacts; that control is assessed by subagent task completion with zero out-of-scope tool access; the incident instead requires denial of prohibited commands after attempts to override local and project configuration.

Question 296

Case reviewers increasingly accept confident Claude recommendations without checking evidence. What is the most targeted architecture choice?

  1. Cap agent steps and resource expenditure
  2. Validate tool-result provenance and semantics
  3. Counter automation bias with visible uncertainty and review
  4. Use claim verification to mitigate confident fabrication

Explanation

Correct Answer

C:

Design review interfaces that expose citations, uncertainty, and targeted challenge checks rather than only an approval button; the review test measures meaningful human oversight, not click-through compliance; evaluate the design with reviewer error interception on seeded incorrect recommendations.

Incorrect Answers

A:

Set per-task step, token, cost, and elapsed-time budgets with a clear abort and escalation state; asking the model to 'be efficient' does not guarantee bounded autonomous execution; this alternative would measure maximum resource usage and orderly termination on deliberately unsolvable tasks; it does not establish reviewer error interception on seeded incorrect recommendations for the described use case.

B:

Preserve source identity and trust level, validate schemas, and separate observed facts from authoritative approval signals; a successful HTTP status does not mean returned data has decision authority; this alternative would measure zero external-result fields promoted to internal approvals in test cases; it does not establish reviewer error interception on seeded incorrect recommendations for the described use case.

D:

Require support from retrieved source passages and provide an explicit unknown path for unsupported claims; fluency and citation formatting cannot establish factual support on their own; this alternative would measure proportion of numeric claims supported by independently inspected references; it does not establish reviewer error interception on seeded incorrect recommendations for the described use case.

Question 297

A benefits assistant is redesigned to send only the fields essential to the user's question and to limit retained records. Which evidence would prove both data minimization and adherence to the retention policy?

  1. Approved contracting, access controls, and PHI data-flow verification for the selected service path
  2. Deletion-request completion across all inventoried repositories within policy deadlines
  3. Sensitive-field inclusion rate in prompts and retention-policy compliance
  4. Verified geographic processing paths for all sensitive request components

Explanation

Correct Answer

C:

Data-flow sampling checks actual minimization rather than relying only on a policy statement; measure sensitive-field inclusion rate in prompts and retention-policy compliance at the release gate; limit processing to necessary authorized fields, define a lawful purpose and retention controls, and document relevant privacy obligations.

Incorrect Answers

A:

Compliance verification must match the actual product configuration and agreement; confirm the specific service and contract support relevant HIPAA obligations, including any required business associate agreement and safeguards; this tests approved contracting, access controls, and PHI data-flow verification for the selected service path; the actual release condition is sensitive-field inclusion rate in prompts and retention-policy compliance.

B:

End-to-end lifecycle tests verify more than the source system's delete operation; map data copies, implement lifecycle deletion where required, and retain audit evidence of the authorized request and its completion; this tests deletion-request completion across all inventoried repositories within policy deadlines; the actual release condition is sensitive-field inclusion rate in prompts and retention-policy compliance.

D:

A full data-flow audit finds secondary exports that primary-storage checks miss; trace storage, inference, retrieval, logs, backups, and subprocessors against contractual and legal location requirements; this tests verified geographic processing paths for all sensitive request components; the actual release condition is sensitive-field inclusion rate in prompts and retention-policy compliance.

Question 298

A corporate policy assistant has thousands of pages but individual questions usually depend on one section. Which option addresses the immediate design need?

  1. Retrieve only relevant material instead of full archives
  2. Attach provenance metadata to selected context
  3. Compact extended sessions without discarding commitments
  4. Persist operational decisions outside transient chat history

Explanation

Correct Answer

A:

Apply query-driven retrieval and evidence selection before prompting Claude, retaining citations and permission filters; relevance per token measures whether context compression preserves the needed evidence; evaluate the design with answer support and retrieved-token volume on a sampled policy-question set.

Incorrect Answers

B:

Supply source identity, version, effective date, and retrieval relevance alongside each chunk so the model can attribute evidence correctly; provenance metadata does not guarantee the upstream search selected the right document in the first place; this alternative would measure citation correctness by effective-date version in temporal regression questions; it does not establish answer support and retrieved-token volume on a sampled policy-question set for the described use case.

C:

Store a structured, reviewable summary of decisions, open issues, and provenance; inject it at checkpoints rather than replaying every chat turn; blind summarization can lose critical exceptions unless durable commitments are explicitly represented; this alternative would measure retention of signed-off requirements after long simulated conversations; it does not establish answer support and retrieved-token volume on a sampled policy-question set for the described use case.

D:

Store approvals and workflow state in an authoritative durable system; treat chat history as context, not a transaction ledger; long context alone cannot provide transactional durability or a trustworthy authorization trail; this alternative would measure correct recovery of approvals and pending actions after forced session reset; it does not establish answer support and retrieved-token volume on a sampled policy-question set for the described use case.

Question 299

A new agent policy is deployed to 10% of traffic and its tool-denial error rate rises sharply. What should the solution architect recommend?

  1. Require an explicit rollback trigger for harmful regressions
  2. Predefine success criteria and sample-size assumptions
  3. Release canaries with guardrail metrics and rollback conditions
  4. Randomize consistently at the user or account level

Explanation

Correct Answer

A:

Establish automated and human-owned rollback triggers tied to critical error and unauthorized-action indicators; operational readiness includes the ability to stop unsafe experiments promptly; evaluate the design with time from triggered guardrail breach to verified rollback.

Incorrect Answers

B:

Define primary metrics, minimal meaningful effect, sample-size method, and stopping rules before examining results; repeatedly peeking and stopping at a favorable fluctuation inflates false-positive decisions; this alternative would measure pre-registered experiment compliance and interval estimates at the planned sample size; it does not establish time from triggered guardrail breach to verified rollback for the described use case.

C:

Deploy to a bounded cohort while observing quality, errors, and tail latency, with predefined stop and rollback thresholds; a single offline score cannot show all production interactions or blast radius; this alternative would measure canary threshold compliance and time to revert a seeded regression; it does not establish time from triggered guardrail breach to verified rollback for the described use case.

D:

Assign a stable randomized unit aligned to the behavior being measured and maintain consistent treatment during the experiment; request-by-request randomization can be invalid when outcomes depend on ongoing user interactions; this alternative would measure balanced treatment cohorts and clean user-level exposure histories; it does not establish time from triggered guardrail breach to verified rollback for the described use case.

Question 300

An insurance operations pilot now handles both ordinary and disputed claims. Finance wants to know whether the proposed assistant improves actual adjudication rather than merely generating drafts quickly. What measured comparison would justify the business case?

  1. Passing the acceptance gate on a representative pilot cohort including difficult exceptions
  2. Agreement between domain reviewers on a rubric and pass rate against a labeled acceptance set
  3. Accepted cases per reviewer-hour with exception share tracked separately
  4. Percentage of required fields with validated owners, quality checks, and approved processing purposes
  5. Change in verified minutes and rework per adjudicated claim versus the documented baseline

Explanation

Correct Answer

E:

Comparing complete case outcomes includes downstream corrections rather than rewarding only faster draft generation; measure change in verified minutes and rework per adjudicated claim versus the documented baseline at the release gate; a baseline separates real business improvement from attractive demos; use completed cases, reviewer effort, errors, and exception handling as measurable comparators.

Incorrect Answers

A:

A bounded deployment can prove business fitness before a large enterprise-wide dependency is created; a narrow pilot validates one representative flow and pre-agreed quality, latency, and escalation thresholds before scaling to other workflows; this tests passing the acceptance gate on a representative pilot cohort including difficult exceptions; the actual release condition is change in verified minutes and rework per adjudicated claim versus the documented baseline.

B:

Consistent scoring makes a go-live decision defensible rather than impressionistic; convert vague requests into observable task outcomes, rubric-based quality dimensions, and failure thresholds that stakeholders can agree to test; this tests agreement between domain reviewers on a rubric and pass rate against a labeled acceptance set; the actual release condition is change in verified minutes and rework per adjudicated claim versus the documented baseline.

C:

Counting both throughput and escalations prevents a fast happy path from hiding a costly exception queue; select a high-frequency, well-described task with measurable work reduction and explicit escalation for ambiguous records; this tests accepted cases per reviewer-hour with exception share tracked separately; the actual release condition is change in verified minutes and rework per adjudicated claim versus the documented baseline.

D:

Measured coverage of eligible sources exposes blockers that a high demo score conceals; data-readiness and usage-rights mapping identifies legitimate inputs, owners, quality gaps, and prohibited transfers before committing to an implementation; this tests percentage of required fields with validated owners, quality checks, and approved processing purposes; the actual release condition is change in verified minutes and rework per adjudicated claim versus the documented baseline.

Claude Certified Architect - Professional (CCAR-P) Practice Tests