Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 63

Question 620

Operators discover that summaries are being treated as final eligibility determinations without authorized review. How should the design be corrected?

  1. Define which decisions remain with people
  2. Quantify the current manual task before choosing automation
  3. Prioritize a repetitive step with bounded exceptions
  4. Map available data and its permitted uses before solution selection

Explanation

Correct Answer

A:

Explicit decision-rights boundaries distinguish advisory generation from actions requiring a credentialed human or deterministic policy engine; an auditable decision trail demonstrates that AI outputs remained advisory where policy requires it; verify the repair using share of binding decisions showing the required named approver and rationale.

Incorrect Answers

B:

Process measurement establishes value, not the identity, data-permission, or runtime architecture of a Claude application; a baseline separates real business improvement from attractive demos; use completed cases, reviewer effort, errors, and exception handling as measurable comparators; that control is assessed by change in verified minutes and rework per adjudicated claim versus the documented baseline; the incident instead requires share of binding decisions showing the required named approver and rationale.

C:

Prioritization improves initial return and feasibility; it does not directly supply output-validation code or tenant isolation; select a high-frequency, well-described task with measurable work reduction and explicit escalation for ambiguous records; that control is assessed by accepted cases per reviewer-hour with exception share tracked separately; the incident instead requires share of binding decisions showing the required named approver and rationale.

D:

A data inventory does not alone identify target SLOs or decide whether an orchestration loop is necessary; data-readiness and usage-rights mapping identifies legitimate inputs, owners, quality gaps, and prohibited transfers before committing to an implementation; that control is assessed by percentage of required fields with validated owners, quality checks, and approved processing purposes; the incident instead requires share of binding decisions showing the required named approver and rationale.

Question 621

A compliance assistant checks unrelated contract clauses while the final risk score depends on every completed check. Which intervention is most appropriate for this use case?

  1. Divide work along independently verifiable artifacts
  2. Checkpoint long-running work for replay and recovery
  3. Parallelize only truly independent branches
  4. Specify input and output contracts for each subtask
  5. Partition research by source and reconcile conflicts explicitly

Explanation

Correct Answer

C:

Isolate independent tasks, retain separate results, then join only when required dependencies have completed; deterministic merge checks measure integrity rather than only wall-clock speed; evaluate the design with correct merged clause counts across repeated parallel execution races.

Incorrect Answers

A:

Separate stages with typed artifacts allow validation and targeted reruns at meaningful boundaries; artifact decomposition controls work structure but does not set the organization-wide release SLA; this alternative would measure stage-specific defect localization and repair without redoing previously validated stages; it does not establish correct merged clause counts across repeated parallel execution races for the described use case.

B:

Durable checkpoints record validated intermediate artifacts and resume at safe boundaries with idempotent side effects; checkpointing reduces replay cost but cannot correct a defective classification rubric; this alternative would measure successful recovery after injected worker failures without duplicated writes or stages; it does not establish correct merged clause counts across repeated parallel execution races for the described use case.

D:

Typed versioned contracts and compatibility tests let stages evolve while preserving their callers' assumptions; contracts define allowed shapes and semantics but cannot ensure a source is truthful; this alternative would measure contract test pass rate for independently upgraded stages and invalid payload rejection; it does not establish correct merged clause counts across repeated parallel execution races for the described use case.

E:

Analyze source partitions separately, retain provenance, and reconcile contradictions through a dedicated synthesis stage; simple partitioning can preserve conflicting claims unless the merge step includes a reconciliation rule; this alternative would measure conflict detection recall and citation coverage across independently processed source sets; it does not establish correct merged clause counts across repeated parallel execution races for the described use case.

Question 622

A public assistance portal is audited with screen readers and other assistive technology on real end-to-end tasks. Which acceptance measure would show that the service is practically usable?

  1. Task completion by users of tested assistive technologies on representative flows
  2. Measured successful intervention before seeded high-impact incorrect actions are committed
  3. Quality and escalation parity across predeclared language segments
  4. Time to resolve substantiated challenges and proportion of cases with documented review

Explanation

Correct Answer

A:

Direct accessibility testing measures practical use rather than formal content correctness only; measure task completion by users of tested assistive technologies on representative flows at the release gate; include accessibility requirements, assistive-technology testing, and inclusive content rubrics in evaluation and design.

Incorrect Answers

B:

Pre-commit override drills test real controllability rather than retrospective documentation; preserve an authorized override and recovery route scaled to decision consequences, with feedback recorded for evaluation; this tests successful intervention before seeded high-impact incorrect actions are committed; the actual release condition is task completion by users of tested assistive technologies on representative flows.

C:

Group-specific evaluation reveals concentrated harm masked by pooled scores; evaluate suitable subgroup error rates and access outcomes, with privacy-aware sampling and appropriate fairness review; this tests quality and escalation parity across predeclared language segments; the actual release condition is task completion by users of tested assistive technologies on representative flows.

D:

Remedy effectiveness measures whether affected people can obtain meaningful reconsideration; provide a contest and correction process with accountable human ownership for significant impacts; this tests time to resolve substantiated challenges and proportion of cases with documented review; the actual release condition is task completion by users of tested assistive technologies on representative flows.

Question 623

A sales copilot invokes retrieval, a CRM connector, and Claude before returning recommendations. Which choice most directly satisfies the documented goal?

  1. Monitor safety policy events across product updates
  2. Instrument end-to-end execution spans for causal debugging
  3. Associate human corrections with exact release versions
  4. Alert on unexpected token and cost anomalies

Explanation

Correct Answer

B:

Correlation and span IDs across components allow latency and failure attribution along the actual path; trace completeness measures incident diagnosability rather than raw log volume; evaluate the design with percent of failures with a complete trace to the responsible stage.

Incorrect Answers

A:

Monitor both harmful-output violations and false-positive blocks by version and user segment; a falling count of harmful completions can coexist with an unusable overrestrictive assistant; this alternative would measure safety precision/recall and legitimate-task completion before and after the change; it does not establish percent of failures with a complete trace to the responsible stage for the described use case.

C:

Log consented feedback alongside prompt revision, model route, source version, and case context for reproducible analysis; aggregate thumbs-down counts without version linkage cannot identify regressions or prove a fix; this alternative would measure reproduction of sampled reviewer defects against their original configuration; it does not establish percent of failures with a complete trace to the responsible stage for the described use case.

D:

Monitor input/output tokens, cache reads, per-stage costs, and cost-per-task anomalies with accountable ownership; request-volume alerts alone miss a sudden rise in tokens per individual workflow; this alternative would measure detection lag for injected per-request token inflation; it does not establish percent of failures with a complete trace to the responsible stage for the described use case.

Question 624

A retrieved employee page orders the assistant to reveal unrelated account records and the model treats it as an instruction. Which change should the architect recommend first?

  1. Adopt a machine-readable output contract and validator
  2. Delimit retrieved content as untrusted evidence
  3. Limit disclosure of secrets and confidential instructions
  4. Keep invariant policy instructions distinct from per-request input

Explanation

Correct Answer

B:

Clearly separate lower-trust source material from application instructions and enforce permissions at the tool layer as well; adversarial retrieval tests exercise the trust boundary rather than only neutral documents; verify the repair using prompt-injection resistance on hostile retrieved snippets without loss of legitimate source use.

Incorrect Answers

A:

Human-readable examples alone do not guarantee that all runtime outputs satisfy machine contracts; request a documented structured format and validate schema, allowed values, and business semantics before downstream use; that control is assessed by valid schema rate and zero unauthorized enum values reaching the consumer; the incident instead requires prompt-injection resistance on hostile retrieved snippets without loss of legitimate source use.

C:

A prohibition in the prompt alone cannot make exposed credentials safe or replace upstream data minimization; redact sensitive fields upstream, prohibit secret reproduction in instructions, and screen outbound content before release; that control is assessed by secret-exposure rate under seeded credential-bearing diagnostic inputs; the incident instead requires prompt-injection resistance on hostile retrieved snippets without loss of legitimate source use.

D:

A modular instruction layout does not itself prove that external API permissions are enforced; separate stable system-level policy from user content and tool results, retaining consistent privilege boundaries across requests; that control is assessed by rate of user messages that fail to override defined task boundaries in regression tests; the incident instead requires prompt-injection resistance on hostile retrieved snippets without loss of legitimate source use.

Question 625

A due-diligence assistant needs separate financial, legal, and environmental checks with different data scopes. Which approach best meets the stated requirement?

  1. Delegate specialist subtasks only when they produce a demonstrable benefit
  2. Use a coordinator to route distinct specialist tasks
  3. Run independent specialists in parallel with a merge contract
  4. Version the handoff artifacts between agents

Explanation

Correct Answer

B:

A coordinator can dispatch scoped subagents and merge their typed outputs while restricting each specialist's context and tools; routing correctness must include scope enforcement, not just readable final reports; evaluate the design with completed reports with correctly scoped evidence and no cross-specialty data leakage.

Incorrect Answers

A:

Introduce a specialist only when its independent expertise, tool scope, or parallelism beats a simpler call on representative evaluations; more agents by themselves do not provide additional knowledge, authority, or better outcomes; this alternative would measure marginal quality improvement per added specialist against its incremental cost and latency; it does not establish completed reports with correctly scoped evidence and no cross-specialty data leakage for the described use case.

C:

Parallel fan-out followed by deterministic aggregation can shorten wall-clock time if each branch has its own contract and errors are handled; parallel fan-out is unsafe when tasks mutate the same state or depend on each other's evolving outputs; this alternative would measure p95 end-to-end latency and deterministic merge completeness under one-branch failures; it does not establish completed reports with correctly scoped evidence and no cross-specialty data leakage for the described use case.

D:

Immutable, versioned handoff artifacts and typed schemas prevent one agent from consuming ambiguous or mismatched intermediate state; artifact versioning governs exchange correctness, not whether the underlying market facts were researched accurately; this alternative would measure zero stale-artifact merges across concurrent revision and retry scenarios; it does not establish completed reports with correctly scoped evidence and no cross-specialty data leakage for the described use case.

Question 626

An A/B experiment is stopped whenever one dashboard briefly shows a positive lift. What is the most targeted architecture choice?

  1. Require an explicit rollback trigger for harmful regressions
  2. Predefine success criteria and sample-size assumptions
  3. Inspect segment-level effects rather than only global lift
  4. Use shadow evaluation before enabling new side effects

Explanation

Correct Answer

B:

Define primary metrics, minimal meaningful effect, sample-size method, and stopping rules before examining results; sound statistical procedure distinguishes stable benefit from random variance; evaluate the design with pre-registered experiment compliance and interval estimates at the planned sample size.

Incorrect Answers

A:

Establish automated and human-owned rollback triggers tied to critical error and unauthorized-action indicators; monitoring without an action threshold can document harm while allowing it to continue; this alternative would measure time from triggered guardrail breach to verified rollback; it does not establish pre-registered experiment compliance and interval estimates at the planned sample size for the described use case.

C:

Compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable; a positive overall average does not guarantee every relevant user group benefits; this alternative would measure resolution and safety deltas by channel and accessibility segment; it does not establish pre-registered experiment compliance and interval estimates at the planned sample size for the described use case.

D:

Replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately; a normal A/B test is inappropriate if experimental behavior can cause unreviewed irreversible changes; this alternative would measure shadow-policy agreement and zero write side effects across replayed billing cases; it does not establish pre-registered experiment compliance and interval estimates at the planned sample size for the described use case.

Question 627

An internal HR assistant should explain policy without interpreting protected employee records beyond its authorized scope. Which choice most directly satisfies the documented goal?

  1. Write explicit roles, scope, and prohibited operations
  2. Limit disclosure of secrets and confidential instructions
  3. Keep invariant policy instructions distinct from per-request input
  4. Define an explicit abstention path for insufficient evidence

Explanation

Correct Answer

A:

Define the assistant's permitted tasks, out-of-scope handling, and escalation behavior in stable application-level instructions, backed by independent access enforcement; boundary tests demonstrate task scoping rather than only fluent responses on ordinary requests; evaluate the design with out-of-scope refusal and handoff accuracy on a policy-boundary test set.

Incorrect Answers

B:

Redact sensitive fields upstream, prohibit secret reproduction in instructions, and screen outbound content before release; a prohibition in the prompt alone cannot make exposed credentials safe or replace upstream data minimization; this alternative would measure secret-exposure rate under seeded credential-bearing diagnostic inputs; it does not establish out-of-scope refusal and handoff accuracy on a policy-boundary test set for the described use case.

C:

Separate stable system-level policy from user content and tool results, retaining consistent privilege boundaries across requests; a modular instruction layout does not itself prove that external API permissions are enforced; this alternative would measure rate of user messages that fail to override defined task boundaries in regression tests; it does not establish out-of-scope refusal and handoff accuracy on a policy-boundary test set for the described use case.

D:

Tell the assistant when to identify missing evidence, ask for clarification, or escalate, and reinforce this with evidence validation; a fallback message cannot repair a poor retrieval index; it only prevents unsupported certainty; this alternative would measure unsupported-answer rate and appropriate abstention precision on no-answer cases; it does not establish out-of-scope refusal and handoff accuracy on a policy-boundary test set for the described use case.

Question 628

A product owner says an internal assistant should be fast and dependable but has not specified load, tail latency, or downtime limits. A claims program has heard only from its sponsor and not the operating, legal, and data teams. Which TWO requirements practices close these distinct discovery gaps? Choose TWO.

  1. Document the owner and authority of every required data source
  2. Validate risky assumptions through narrow experiments
  3. Obtain sign-off on explicit acceptance criteria and exclusions
  4. Interview each role that owns a distinct outcome or risk
  5. Record nonfunctional requirements as measurable thresholds

Explanation

Correct Answers

D:

Use role-based discovery to capture goals, current workflows, authority boundaries, and failure impacts from relevant stakeholders; traceable requirements reveal whether important operational perspectives were omitted; its corresponding workstream should be validated by coverage of approved requirements traced to affected stakeholder groups.

E:

Specify capacity, tail latency, availability, privacy, and recovery objectives with measurement windows and ownership; measurable NFRs turn vague expectations into testable architecture constraints; its corresponding workstream should be validated by agreed p95, availability, and load thresholds exercised in an acceptance environment.

Incorrect Answers

A:

A source-ownership inventory is crucial before connecting unapproved datasets, but this project needs measurable service-level targets for the first workstream and requirements gathered from adjusters, legal reviewers, and data owners for the second; inventory alone is insufficient.

B:

Identify high-risk assumptions and design small feasibility spikes with explicit success and stop criteria; detailed architecture diagrams do not prove uncertain input quality or model capability; its natural acceptance measure is resolution rate of prioritized unknowns through measured prototypes, which does not satisfy the separate workstreams being assessed.

C:

Document in-scope outcomes, exclusions, metrics, responsibilities, and go-live gates for accountable approval; informal meeting consensus may not survive staff changes or new deployment expectations; its natural acceptance measure is signed acceptance criteria mapped to demonstrable tests and named owners, which does not satisfy the separate workstreams being assessed.

Question 629

Private records accumulate in logs although only one non-sensitive eligibility field is required. Which corrective change best addresses the root cause?

  1. Check FedRAMP authorization against exact service boundaries
  2. Minimize personal data and specify retention purpose
  3. Assess privacy risks and lawful processing grounds early
  4. Check HIPAA business associate and safeguard requirements

Explanation

Correct Answer

B:

Limit processing to necessary authorized fields, define a lawful purpose and retention controls, and document relevant privacy obligations; data-flow sampling checks actual minimization rather than relying only on a policy statement; verify the repair using sensitive-field inclusion rate in prompts and retention-policy compliance.

Incorrect Answers

A:

A general government-cloud label or vendor marketing statement is not equivalent to FedRAMP authorization; verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; that control is assessed by documented authorization-boundary mapping for every service handling regulated data; the incident instead requires sensitive-field inclusion rate in prompts and retention-policy compliance.

C:

Technical model accuracy does not establish permission to process sensitive personal information; involve privacy counsel to assess applicable lawful bases, transparency, rights, and whether a data-protection impact assessment is required before release; that control is assessed by completion of required privacy assessment and recorded resolution of high risks before go-live; the incident instead requires sensitive-field inclusion rate in prompts and retention-policy compliance.

D:

A provider security claim alone does not prove that the purchased deployment is contractually suitable for PHI; confirm the specific service and contract support relevant HIPAA obligations, including any required business associate agreement and safeguards; that control is assessed by approved contracting, access controls, and PHI data-flow verification for the selected service path; the incident instead requires sensitive-field inclusion rate in prompts and retention-policy compliance.

Question 630

A market-analysis report contains precise figures and citations, but reviewers suspect several amounts are unsupported by the underlying documents. Which audit measure would establish factual traceability for numeric claims?

  1. Blocked unauthorized destinations and absence of confidential fields in egress logs
  2. Proportion of numeric claims supported by independently inspected references
  3. Maximum resource usage and orderly termination on deliberately unsolvable tasks
  4. Unauthorized tool-action success rate over injected emails and documents

Explanation

Correct Answer

B:

Grounding tests detect confident fabrication at the statement level; measure proportion of numeric claims supported by independently inspected references at the release gate; require support from retrieved source passages and provide an explicit unknown path for unsupported claims.

Incorrect Answers

A:

Network- and tool-level evidence catches leakage not visible in user-facing text; restrict egress destinations, data classes, and tool arguments at the network and application layers, with audit trails; this tests blocked unauthorized destinations and absence of confidential fields in egress logs; the actual release condition is proportion of numeric claims supported by independently inspected references.

C:

Budget stress tests show whether runaway loops fail safely; set per-task step, token, cost, and elapsed-time budgets with a clear abort and escalation state; this tests maximum resource usage and orderly termination on deliberately unsolvable tasks; the actual release condition is proportion of numeric claims supported by independently inspected references.

D:

A realistic attack corpus exercises both model behavior and execution controls; model external content as untrusted input, test role spoofing and instruction attempts, and enforce downstream permissions regardless of the prompt; this tests unauthorized tool-action success rate over injected emails and documents; the actual release condition is proportion of numeric claims supported by independently inspected references.

Claude Certified Architect - Professional (CCAR-P) Practice Tests