Anthropic CCAR-P (Claude Certified Architect - Professional) Practice Test 69

Question 680

A customer-support connector is exercised with forged roles, altered tenant identifiers, and unauthorized resource targets. Which result would demonstrate that backend authorization operates independently of polite model responses?

  1. Fully loaded cost per correctly completed document
  2. Unauthorized API requests rejected under role, tenant, and resource attack matrices
  3. Correct-answer rate at each supported coverage threshold including no-answer cases
  4. p95 time from user submission to fully validated answer under load

Explanation

Correct Answer

B:

Direct penetration-style checks assess the enforceable security boundary; measure unauthorized API requests rejected under role, tenant, and resource attack matrices at the release gate; treat backend authorization denial rate and cross-scope access tests as primary security metrics, not merely refusal wording.

Incorrect Answers

A:

This metric includes rework rather than rewarding low-quality cheap drafts; relate full inference and review costs to accepted outcomes that meet the task rubric, not to requests attempted; this tests fully loaded cost per correctly completed document; the actual release condition is unauthorized API requests rejected under role, tenant, and resource attack matrices.

C:

Coverage-risk curves expose the tradeoff between reliability and unnecessary handoffs; measure selective risk: error rate on answered items alongside abstention precision, coverage, and escalation cost; this tests correct-answer rate at each supported coverage threshold including no-answer cases; the actual release condition is unauthorized API requests rejected under role, tenant, and resource attack matrices.

D:

Measuring the completed workflow captures actual end-user waiting, including downstream services; report p95 or p99 end-to-end latency over representative traffic rather than relying only on averages or raw model runtime; this tests p95 time from user submission to fully validated answer under load; the actual release condition is unauthorized API requests rejected under role, tenant, and resource attack matrices.

Question 681

Letting an agent control the entire refund process allows it to bypass the mandatory identity gate. What is the most direct remediation?

  1. Anchor dynamic policy answers with retrieval
  2. Use a deterministic workflow for known ordered stages
  3. Embed a small agent inside a controlled workflow
  4. Use offline batch processing when immediate interactivity is unnecessary

Explanation

Correct Answer

C:

Place bounded exploratory reasoning inside one stage of a deterministic state machine; enforce approval and write permissions outside the agent; this tests flexible investigation and deterministic control at the same time; verify the repair using disputed-case resolution with every refund still passing the identity and approval gates.

Incorrect Answers

A:

Retrieval does not create new authoritative policy; it depends on freshness, correct permissions, and source quality; retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; that control is assessed by correct citations to currently effective policy versions across update tests; the incident instead requires disputed-case resolution with every refund still passing the identity and approval gates.

B:

A rigid sequence becomes cumbersome when the next action is genuinely unknown until exploratory results arrive; explicit state transitions preserve required order, testing points, and deterministic branch conditions; Claude can supply judgment inside selected stages; that control is assessed by rate of recommendations backed by all required completed stage checks; the incident instead requires disputed-case resolution with every refund still passing the identity and approval gates.

D:

Batch execution is unsuitable when a human must see an answer or authorize action in real time; batch-oriented orchestration handles throughput, retries, and cost planning while preserving consistent model instructions for a noninteractive workload; that control is assessed by completed valid classifications per batch window and cost per accepted record; the incident instead requires disputed-case resolution with every refund still passing the identity and approval gates.

Question 682

A single freeform answer hides a missed exception behind a confident total risk score. Which corrective change best addresses the root cause?

  1. Break multi-step reasoning into checkable intermediate outputs
  2. Chain prompts when one result is a prerequisite for another
  3. Add few-shot examples for difficult boundary cases
  4. Use contrastive examples when two outputs look similar
  5. Start with clear zero-shot instructions for unambiguous tasks

Explanation

Correct Answer

A:

Require explicit intermediate evidence and structured rule checks that can be independently validated; avoid treating verbose reasoning text as proof; checkable milestones provide evidence of reasoning quality beyond rhetorical fluency; verify the repair using intermediate artifact validity and final score agreement with a policy-engine oracle.

Incorrect Answers

B:

Chaining every trivial substep increases latency without improving reliability for simple independent tasks; use a staged prompt chain where a verified intermediate classification is required before the next generation step; that control is assessed by explanations generated only for records that passed the eligibility stage; the incident instead requires intermediate artifact validity and final score agreement with a policy-engine oracle.

C:

Examples are not a substitute for a clean class definition or representative test labels; provide a few diverse, accurately labeled counterexamples that illustrate the exact class boundary, then verify against held-out cases; that control is assessed by recall on previously confused boundary examples outside the prompt set; the incident instead requires intermediate artifact validity and final score agreement with a policy-engine oracle.

D:

Adding examples without highlighting the differentiating condition can reinforce superficial formatting only; show a paired positive and negative example with the decision rule that separates the formats; then test unseen cases; that control is assessed by correct type selection on unseen evidence-versus-action pairs; the incident instead requires intermediate artifact validity and final score agreement with a policy-engine oracle.

E:

Zero-shot prompting may fail where domain edge cases or specialized formatting rules are not expressible clearly in prose; a concise task statement with precise labels is a defensible baseline when success is readily evaluated and examples add little value; that control is assessed by label accuracy and token use versus a heavier example-based prompt; the incident instead requires intermediate artifact validity and final score agreement with a policy-engine oracle.

Question 683

The same agent repeats confident unsupported claims while 'reviewing' its own unexamined draft. Which action best removes the underlying failure mode?

  1. Bound handoffs, retries, and recursion across agents
  2. Delegate only specialized subtasks that add measurable value
  3. Version the handoff artifacts between agents
  4. Use a coordinator to route distinct specialist tasks
  5. Run independent specialists in parallel with a merge contract
  6. Separate independent critique from generation

Explanation

Correct Answer

F:

A distinct verifier with a rubric and evidence access can challenge unsupported assertions before an external document is released; targeted seeded errors test whether critique catches defects rather than merely rewriting prose; verify the repair using verified claim support rate after independent critique on seeded unsupported drafts.

Incorrect Answers

A:

Recursive collaboration is not inherently self-terminating and cannot be made safe only by asking agents to cooperate; enforce maximum depth, handoff count, timeouts, and explicit unresolved-case escalation in the orchestrator; that control is assessed by zero unbounded cycles under adversarial unresolved tasks while retaining a useful escalation record; the incident instead requires verified claim support rate after independent critique on seeded unsupported drafts.

B:

More agents by themselves do not provide additional knowledge, authority, or better outcomes; introduce a specialist only when its independent expertise, tool scope, or parallelism beats a simpler call on representative evaluations; that control is assessed by marginal quality improvement per added specialist against its incremental cost and latency; the incident instead requires verified claim support rate after independent critique on seeded unsupported drafts.

C:

Artifact versioning governs exchange correctness, not whether the underlying market facts were researched accurately; immutable, versioned handoff artifacts and typed schemas prevent one agent from consuming ambiguous or mismatched intermediate state; that control is assessed by zero stale-artifact merges across concurrent revision and retry scenarios; the incident instead requires verified claim support rate after independent critique on seeded unsupported drafts.

D:

Specialist routing adds handoffs and can be wasteful for one small, homogeneous transformation; a coordinator can dispatch scoped subagents and merge their typed outputs while restricting each specialist's context and tools; that control is assessed by completed reports with correctly scoped evidence and no cross-specialty data leakage; the incident instead requires verified claim support rate after independent critique on seeded unsupported drafts.

E:

Parallel fan-out is unsafe when tasks mutate the same state or depend on each other's evolving outputs; parallel fan-out followed by deterministic aggregation can shorten wall-clock time if each branch has its own contract and errors are handled; that control is assessed by p95 end-to-end latency and deterministic merge completeness under one-branch failures; the incident instead requires verified claim support rate after independent critique on seeded unsupported drafts.

Question 684

A low mean response time masks slow outliers that repeatedly interrupt consultations. Which action best removes the underlying failure mode?

  1. Use task-correctness metrics tied to verified labels
  2. Test whether the tool layer denies unauthorized requests
  3. Use tail-latency indicators for interactive promises
  4. Measure rate and severity of safety policy violations

Explanation

Correct Answer

C:

Report p95 or p99 end-to-end latency over representative traffic rather than relying only on averages or raw model runtime; measuring the completed workflow captures actual end-user waiting, including downstream services; verify the repair using p95 time from user submission to fully validated answer under load.

Incorrect Answers

A:

Positive conversational tone does not establish that a legally or financially meaningful label is correct; measure the business decision against a labeled reference, with metrics weighted for costly errors and explicit acceptance thresholds; that control is assessed by critical-class precision and recall on independently verified tax-code cases; the incident instead requires p95 time from user submission to fully validated answer under load.

B:

Model refusal scores can be high even when the underlying API is vulnerable; treat backend authorization denial rate and cross-scope access tests as primary security metrics, not merely refusal wording; that control is assessed by unauthorized API requests rejected under role, tenant, and resource attack matrices; the incident instead requires p95 time from user submission to fully validated answer under load.

D:

General task correctness does not measure policy-conformance failures on dangerous requests; define safety incident categories, risk-weighted violation rates, and appropriate exposure denominators for adversarial and real traffic; that control is assessed by severity-weighted policy violation incidence on a reviewed adversarial test set; the incident instead requires p95 time from user submission to fully validated answer under load.

Question 685

Before a lending copilot connects to production records, an architecture board requires evidence that the requested customer attributes can lawfully and reliably flow from each upstream system. Which readiness measure best supports approval?

  1. Measured change in verified minutes and rework per adjudicated claim versus the documented baseline
  2. Passing the acceptance gate on a representative pilot cohort including difficult exceptions
  3. Percentage of required fields with validated owners, quality checks, and approved processing purposes
  4. Share of binding decisions showing the required named approver and rationale
  5. Agreement between domain reviewers on a rubric and pass rate against a labeled acceptance set

Explanation

Correct Answer

C:

Measured coverage of eligible sources exposes blockers that a high demo score conceals; measure percentage of required fields with validated owners, quality checks, and approved processing purposes at the release gate; data-readiness and usage-rights mapping identifies legitimate inputs, owners, quality gaps, and prohibited transfers before committing to an implementation.

Incorrect Answers

A:

Comparing complete case outcomes includes downstream corrections rather than rewarding only faster draft generation; a baseline separates real business improvement from attractive demos; use completed cases, reviewer effort, errors, and exception handling as measurable comparators; this tests change in verified minutes and rework per adjudicated claim versus the documented baseline; the actual release condition is percentage of required fields with validated owners, quality checks, and approved processing purposes.

B:

A bounded deployment can prove business fitness before a large enterprise-wide dependency is created; a narrow pilot validates one representative flow and pre-agreed quality, latency, and escalation thresholds before scaling to other workflows; this tests passing the acceptance gate on a representative pilot cohort including difficult exceptions; the actual release condition is percentage of required fields with validated owners, quality checks, and approved processing purposes.

D:

An auditable decision trail demonstrates that AI outputs remained advisory where policy requires it; explicit decision-rights boundaries distinguish advisory generation from actions requiring a credentialed human or deterministic policy engine; this tests share of binding decisions showing the required named approver and rationale; the actual release condition is percentage of required fields with validated owners, quality checks, and approved processing purposes.

E:

Consistent scoring makes a go-live decision defensible rather than impressionistic; convert vague requests into observable task outcomes, rubric-based quality dimensions, and failure thresholds that stakeholders can agree to test; this tests agreement between domain reviewers on a rubric and pass rate against a labeled acceptance set; the actual release condition is percentage of required fields with validated owners, quality checks, and approved processing purposes.

Question 686

Developers use different workstations but a single locked build pipeline for AI-assisted patches. Which clean-environment result would demonstrate that successful local tests remain reproducible in CI?

  1. CI pass reproducibility on clean builds with locked dependencies
  2. Review time and ability to localize defects for each change set
  3. Detection of seeded authorization regressions during peer review and CI
  4. Checklist completeness across independent sessions using the reviewed Skill version

Explanation

Correct Answer

A:

Independent automation prevents environmental drift from masquerading as code correctness; measure cI pass reproducibility on clean builds with locked dependencies at the release gate; execute standardized linting, type checks, tests, and security scanning in versioned CI environments before merges.

Incorrect Answers

B:

Small-batch evidence shows whether modernization remains controlled and reversible; use small scoped changes, compatibility checkpoints, and separate pull requests tied to specific tests; this tests review time and defect localization per incremental change set; the actual release condition is cI pass reproducibility on clean builds with locked dependencies.

C:

Diff-focused review finds changes that ordinary output fluency cannot reveal; require focused code review of the actual diff, threat-relevant tests, and approval before merging sensitive changes; this tests detection of seeded authorization regressions during peer review and CI; the actual release condition is cI pass reproducibility on clean builds with locked dependencies.

D:

Reuse tests verify that essential steps are consistently available; maintain task-scoped reusable Skills or playbooks with versioning, ownership, and documented prerequisites; this tests checklist completeness across independent sessions using the reviewed Skill version; the actual release condition is cI pass reproducibility on clean builds with locked dependencies.

Question 687

A customer service portal promises quick answers to nearly all sessions while infrequent slow calls are causing abandonment. Which choice most directly satisfies the documented goal?

  1. Translate response-time expectations into a percentile SLO
  2. Quantify productivity after correction and escalation
  3. Use a control group to establish incremental business impact
  4. Choose model and architecture tiers by case impact

Explanation

Correct Answer

A:

Define a p95 or p99 target against real end-to-end requests, including retrieval and tools, rather than reporting an average model time; tail measurement detects the bad experiences that averages can obscure; evaluate the design with end-to-end p95 latency and error rate against the agreed service objective.

Incorrect Answers

B:

Measure net time saved after review, appeals, and escalations, segmented by complexity, before claiming productivity; counting drafts as completed outcomes overlooks downstream human effort and defect consequences; this alternative would measure end-to-end completed cases per paid work-hour with rework and appeal volumes; it does not establish end-to-end p95 latency and error rate against the agreed service objective for the described use case.

C:

Use matched baselines, controlled rollout, or appropriate difference-in-differences analysis to isolate contribution under plausible confounders; before-after counts without a credible comparison group may misattribute unrelated changes to the model; this alternative would measure incremental resolution lift compared with a comparable non-assisted cohort; it does not establish end-to-end p95 latency and error rate against the agreed service objective for the described use case.

D:

Route by validated task complexity and consequence, using stronger reasoning or human review where evidence justifies the incremental spend; a uniformly premium model can raise cost without proportionate value on simple, low-risk tasks; this alternative would measure quality and total cost segmented by request risk tier under a fixed accuracy floor; it does not establish end-to-end p95 latency and error rate against the agreed service objective for the described use case.

Question 688

A crafted prompt adds an unapproved recipient and includes internal notes in the outbound message. Which change should the architect recommend first?

  1. Treat retrieved instructions as untrusted data
  2. Screen unsafe outputs in proportion to the use case
  3. Enforce least privilege where tool actions execute
  4. Allowlist generated fields and destinations before external calls

Explanation

Correct Answer

D:

Validate destinations, argument types, sensitive fields, and authorization before dispatch; reject values outside the approved contract; contract-level checks demonstrate control over the actual data leaving the system; verify the repair using zero unapproved recipients or fields accepted by the outbound service.

Incorrect Answers

A:

Assuming retrieved text is authoritative because it came from a connector opens a prompt-injection path; keep source contents in a lower-trust evidence role and prevent embedded commands from crossing into tool authority; that control is assessed by attack success rate on adversarial web pages and zero unauthorized egress calls; the incident instead requires zero unapproved recipients or fields accepted by the outbound service.

B:

An input-only filter cannot detect every unsafe completion, especially when harm arises from the generated detail; evaluate output safety against a documented risk rubric and use appropriate escalation or refusal for high-risk claims; that control is assessed by harmful-completion detection on labeled outputs with false-positive monitoring; the incident instead requires zero unapproved recipients or fields accepted by the outbound service.

C:

Natural-language reminders do not remove capabilities exposed by the API or bearer token; enforce role and scope in the backend execution service using credentials that cannot perform the forbidden action; that control is assessed by zero payment writes when tested with the analytics identity and forged instructions; the incident instead requires zero unapproved recipients or fields accepted by the outbound service.

Question 689

A claims insurer wants an AI proposal but has no baseline for processing time, error rates, or appeal volume. Which intervention is most appropriate for this use case?

  1. Favor a repetitive step with bounded exceptions
  2. Define which decisions remain with people
  3. Translate vague accuracy demands into task-specific criteria
  4. Measure the current manual task before choosing automation

Explanation

Correct Answer

D:

A baseline separates real business improvement from attractive demos; use completed cases, reviewer effort, errors, and exception handling as measurable comparators; comparing complete case outcomes includes downstream corrections rather than rewarding only faster draft generation; evaluate the design with change in verified minutes and rework per adjudicated claim versus the documented baseline.

Incorrect Answers

A:

Select a high-frequency, well-described task with measurable work reduction and explicit escalation for ambiguous records; prioritization improves initial return and feasibility; it does not directly supply output-validation code or tenant isolation; this alternative would measure accepted cases per reviewer-hour with exception share tracked separately; it does not establish change in verified minutes and rework per adjudicated claim versus the documented baseline for the described use case.

B:

Explicit decision-rights boundaries distinguish advisory generation from actions requiring a credentialed human or deterministic policy engine; decision ownership is an authorization and accountability control; it does not fix missing input records or prompt-token waste; this alternative would measure share of binding decisions showing the required named approver and rationale; it does not establish change in verified minutes and rework per adjudicated claim versus the documented baseline for the described use case.

C:

Convert vague requests into observable task outcomes, rubric-based quality dimensions, and failure thresholds that stakeholders can agree to test; a clear success rubric evaluates outcomes but cannot on its own implement retrieval access controls; this alternative would measure agreement between domain reviewers on a rubric and pass rate against a labeled acceptance set; it does not establish change in verified minutes and rework per adjudicated claim versus the documented baseline for the described use case.

Question 690

A team assumes a generic SaaS subscription is sufficient to transmit PHI without checking contractual and security terms. What is the most direct remediation?

  1. Assess privacy risks and lawful processing grounds early
  2. Implement accountable access, deletion, and retention processes
  3. Validate FedRAMP authorization against exact service boundaries
  4. Check HIPAA business associate and safeguard requirements
  5. Minimize personal data and specify retention purpose

Explanation

Correct Answer

D:

Confirm the specific service and contract support relevant HIPAA obligations, including any required business associate agreement and safeguards; compliance verification must match the actual product configuration and agreement; verify the repair using approved contracting, access controls, and PHI data-flow verification for the selected service path.

Incorrect Answers

A:

Technical model accuracy does not establish permission to process sensitive personal information; involve privacy counsel to assess applicable lawful bases, transparency, rights, and whether a data-protection impact assessment is required before release; that control is assessed by completion of required privacy assessment and recorded resolution of high risks before go-live; the incident instead requires approved contracting, access controls, and PHI data-flow verification for the selected service path.

B:

Deleting the original row does not automatically erase embeddings, caches, or observability copies; map data copies, implement lifecycle deletion where required, and retain audit evidence of the authorized request and its completion; that control is assessed by deletion-request completion across all inventoried repositories within policy deadlines; the incident instead requires approved contracting, access controls, and PHI data-flow verification for the selected service path.

C:

A general government-cloud label or vendor marketing statement is not equivalent to FedRAMP authorization; verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; that control is assessed by documented authorization-boundary mapping for every service handling regulated data; the incident instead requires approved contracting, access controls, and PHI data-flow verification for the selected service path.

E:

Broad encryption does not justify collecting more personal data than the task needs; limit processing to necessary authorized fields, define a lawful purpose and retention controls, and document relevant privacy obligations; that control is assessed by sensitive-field inclusion rate in prompts and retention-policy compliance; the incident instead requires approved contracting, access controls, and PHI data-flow verification for the selected service path.

Claude Certified Architect - Professional (CCAR-P) Practice Tests