Question 440
An enterprise helpdesk gets thirty plausible retrieved articles for each query, many covering obsolete or adjacent workflows. Which approach best meets the stated requirement?
- Rerank candidate passages for question relevance
- Use semantic vector search for paraphrased knowledge questions
- Combine lexical and semantic candidates when queries mix both
- Query structured data through authorized SQL or typed APIs
Explanation
Correct Answer
A:Apply a query-aware reranker after broad retrieval, respecting freshness and permissions, to prioritize evidence for synthesis; rank-sensitive evaluation tests whether useful evidence reaches the final context window; evaluate the design with relevant-procedure rank and end-to-end answer support rate after reranking.
Incorrect Answers
B:Vector retrieval can match conceptual similarity between user wording and document text, followed by evidence verification; semantic search is not guaranteed to respect exact version strings, numerals, or access boundaries without additional controls; this alternative would measure recall on human-authored paraphrases absent from manual headings; it does not establish relevant-procedure rank and end-to-end answer support rate after reranking for the described use case.
C:Hybrid retrieval joins exact-term and semantic evidence, then applies metadata filtering and ranking; either modality alone leaves a known class of mixed-format queries uncovered; this alternative would measure joint exact-identifier accuracy and semantic-symptom recall on mixed queries; it does not establish relevant-procedure rank and end-to-end answer support rate after reranking for the described use case.
D:Use a governed structured query interface with parameter checks and business semantics for exact aggregates; unstructured document retrieval cannot ensure completeness or mathematical correctness for database totals; this alternative would measure exact aggregate agreement with a trusted query on authorized records; it does not establish relevant-procedure rank and end-to-end answer support rate after reranking for the described use case.
Question 441
A classification prompt performs well on clear examples but repeatedly mistakes nuanced, borderline narratives. Which prompt improvement would expose the exact classification boundary?
- Break multi-step reasoning into checkable intermediate outputs
- Use contrastive examples when two outputs look similar
- Separate instructions and source regions with clear tags
- Add few-shot examples for difficult boundary cases
Explanation
Correct Answer
D:Provide a few diverse, accurately labeled counterexamples that illustrate the exact class boundary, then verify against held-out cases; held-out boundary performance shows whether examples teach the distinction rather than merely echoing training examples; verify the repair using recall on previously confused boundary examples outside the prompt set.
Incorrect Answers
A:Requesting longer explanations without validation can make unsupported conclusions appear more persuasive; require explicit intermediate evidence and structured rule checks that can be independently validated; avoid treating verbose reasoning text as proof; that control is assessed by intermediate artifact validity and final score agreement with a policy-engine oracle; the incident instead requires recall on previously confused boundary examples outside the prompt set.
B:Adding examples without highlighting the differentiating condition can reinforce superficial formatting only; show a paired positive and negative example with the decision rule that separates the formats; then test unseen cases; that control is assessed by correct type selection on unseen evidence-versus-action pairs; the incident instead requires recall on previously confused boundary examples outside the prompt set.
C:Tagged presentation cannot replace authenticating a source or enforcing repository access rights; use clearly named sections or XML-style tags so Claude can distinguish task policy, input, and supporting documents; that control is assessed by correct separation of document claims and application instructions in adversarial input tests; the incident instead requires recall on previously confused boundary examples outside the prompt set.
Question 442
The integration is blocked after implementation because nobody approved access to one required repository. Which intervention targets the defect rather than its symptoms?
- Interview each role that owns a distinct outcome or risk
- Obtain sign-off on explicit acceptance criteria and exclusions
- Map the owner and authority of every required data source
- Check risky assumptions through narrow experiments
Explanation
Correct Answer
C:Create a source inventory with accountable owners, sensitivity, update rate, and approval dependencies before committing to the design; data ownership completeness measures feasibility before engineering spends effort; verify the repair using percentage of required sources with approved owners, legal uses, and integration paths.
Incorrect Answers
A:A sponsor's high-level vision does not fully describe operational controls or edge cases; use role-based discovery to capture goals, current workflows, authority boundaries, and failure impacts from relevant stakeholders; that control is assessed by coverage of approved requirements traced to affected stakeholder groups; the incident instead requires percentage of required sources with approved owners, legal uses, and integration paths.
B:Informal meeting consensus may not survive staff changes or new deployment expectations; document in-scope outcomes, exclusions, metrics, responsibilities, and go-live gates for accountable approval; that control is assessed by signed acceptance criteria mapped to demonstrable tests and named owners; the incident instead requires percentage of required sources with approved owners, legal uses, and integration paths.
D:Detailed architecture diagrams do not prove uncertain input quality or model capability; identify high-risk assumptions and design small feasibility spikes with explicit success and stop criteria; that control is assessed by resolution rate of prioritized unknowns through measured prototypes; the incident instead requires percentage of required sources with approved owners, legal uses, and integration paths.
Question 443
Downstream prompts treat a tax amount as a total because input extraction has no canonical schema. What design correction resolves the reported failure?
- Link each output to source and processing trace IDs
- Validate model output against a business schema before side effects
- Normalize incoming documents into a validated input contract
- Use a queue and asynchronous workers for bursty workloads
Explanation
Correct Answer
C:An input-adapter layer validates document type, field types, provenance, and required metadata before the model reasons over values; a schema-conformance gate reveals extraction failures before they can contaminate reasoning; verify the repair using percentage of ingested documents meeting schema checks before any Claude call.
Incorrect Answers
A:Traceability explains decisions after the fact; it is not a replacement for preventing unauthorized source access; correlation IDs, source versions, and stage logs establish end-to-end lineage across extraction, retrieval, inference, and review; that control is assessed by fraction of sampled outputs reproducibly linked to input, model configuration, and reviewer disposition; the incident instead requires percentage of ingested documents meeting schema checks before any Claude call.
B:Output parsing constrains generated data but does not by itself manage retry idempotency or transport durability; use structured output parsing, semantic validation, and a separate authorized command handler so generated text is never treated directly as a write instruction; that control is assessed by invalid write payloads rejected before execution, with zero partial supplier mutations; the incident instead requires percentage of ingested documents meeting schema checks before any Claude call.
D:Queueing absorbs bursts but does not improve a weak answer rubric or justify a higher-privilege tool set; decouple intake from processing through durable queues, bounded workers, and status callbacks rather than keeping user connections open; that control is assessed by job completion rate and queue age during the peak intake window; the incident instead requires percentage of ingested documents meeting schema checks before any Claude call.
Question 444
A legal review application has correct evidence retrieval but struggles to reconcile conflicting contractual provisions. Which controlled comparison would establish that a stronger reasoning configuration solves the remaining error?
- Schema error rate across multiline, null, and unusual-field edge cases
- Correct conflict resolution with fixed retrieved evidence across candidate reasoning configurations
- Supported-claim rate on source-checked summaries with seeded unsupported numbers
- Correct 'unknown' handling and no false denials during injected API failures
Explanation
Correct Answer
B:Controlled component isolation determines whether the bottleneck is reasoning rather than retrieval; measure correct conflict resolution with fixed retrieved evidence across candidate reasoning configurations at the release gate; hold evidence constant and compare validated model capabilities or staged reasoning designs on the failed complexity class.
Incorrect Answers
A:Edge-specific parser tests identify contract failures separately from content comprehension; inspect instruction clarity, output-schema validation, and edge-case examples before assuming a core model reasoning failure; this tests schema error rate across multiline, null, and unusual-field edge cases; the actual release condition is correct conflict resolution with fixed retrieved evidence across candidate reasoning configurations.
C:Claim-level verification targets hallucinations that ordinary coherence checks miss; compare material claims against cited evidence and flag unsupported statements for abstention or review; this tests supported-claim rate on source-checked summaries with seeded unsupported numbers; the actual release condition is correct conflict resolution with fixed retrieved evidence across candidate reasoning configurations.
D:Fault injection distinguishes tool availability from genuine absence of data; propagate typed tool errors, retries, and unknown states instead of converting transport failures into negative facts; this tests correct 'unknown' handling and no false denials during injected API failures; the actual release condition is correct conflict resolution with fixed retrieved evidence across candidate reasoning configurations.
Question 445
A record-extraction agent must return valid dates, required fields, and approved enum values. Which option addresses the immediate design need?
- Incorporate hostile prompt-injection and no-answer probes
- Protect a separate holdout set for regression decisions
- Use deterministic code checks for objective output contracts
- Measure human annotator consistency before trusting labels
Explanation
Correct Answer
C:Apply fast programmatic validators for JSON shape, type constraints, allowed values, and deterministic business rules; executable contract tests deliver reproducible feedback at scale; evaluate the design with zero schema violations accepted by the downstream consumer across generated cases.
Incorrect Answers
A:Add adversarial retrieved text, invalid queries, ambiguous requests, and missing-evidence cases with expected safe behavior; testing normal prompts alone cannot estimate resilience to malicious or unsatisfiable requests; this alternative would measure attack success rate and safe handling of intentionally unanswerable prompts; it does not establish zero schema violations accepted by the downstream consumer across generated cases for the described use case.
B:Maintain untouched holdout cases and periodic refreshes representing real traffic, with clear version and leakage controls; reusing a public tuning set as the sole release gate invites overfitting rather than generalization; this alternative would measure holdout quality stability across successive prompt versions; it does not establish zero schema violations accepted by the downstream consumer across generated cases for the described use case.
D:Use calibration sessions, disagreement analysis, adjudication rules, and documented label provenance before relying on the data as ground truth; more test volume does not fix unreliable or undefined labels; this alternative would measure inter-annotator agreement and unresolved-label rate after adjudication; it does not establish zero schema violations accepted by the downstream consumer across generated cases for the described use case.
Question 446
A public-service assistant is deployed through a mobile portal used by people with varied assistive technologies. What action best fits the business and technical boundary?
- Quantify errors across relevant user subgroups
- Design an override path proportionate to consequences
- Test accessibility of generated explanations and interfaces
- Publish scope, limitations, and residual risks to stakeholders
- Provide a route to challenge significant recommendations
- Expose evidence and decision boundaries to affected users
Explanation
Correct Answer
C:Include accessibility requirements, assistive-technology testing, and inclusive content rubrics in evaluation and design; direct accessibility testing measures practical use rather than formal content correctness only; evaluate the design with task completion by users of tested assistive technologies on representative flows.
Incorrect Answers
A:Evaluate suitable subgroup error rates and access outcomes, with privacy-aware sampling and appropriate fairness review; overall accuracy cannot establish comparable treatment for every affected population; this alternative would measure quality and escalation parity across predeclared language segments; it does not establish task completion by users of tested assistive technologies on representative flows for the described use case.
B:Preserve an authorized override and recovery route scaled to decision consequences, with feedback recorded for evaluation; human review after an irreversible action may be too late to prevent harm; this alternative would measure successful intervention before seeded high-impact incorrect actions are committed; it does not establish task completion by users of tested assistive technologies on representative flows for the described use case.
D:Maintain clear documentation of intended use, unsupported scenarios, measured performance, and escalation requirements; a generic disclaimer cannot compensate for hidden high-risk use or unavailable oversight; this alternative would measure accuracy of user understanding of supported versus unsupported tasks; it does not establish task completion by users of tested assistive technologies on representative flows for the described use case.
E:Provide a contest and correction process with accountable human ownership for significant impacts; a fairness dashboard alone cannot remedy individual incorrect records or decisions; this alternative would measure time to resolve substantiated challenges and proportion of cases with documented review; it does not establish task completion by users of tested assistive technologies on representative flows for the described use case.
F:Distinguish evidence, uncertainty, and advisory status with accessible citations and a path to authoritative decisions; a polished explanation without provenance may create false confidence in unsupported reasoning; this alternative would measure user comprehension of advisory status and source-citation validity; it does not establish task completion by users of tested assistive technologies on representative flows for the described use case.
Question 447
A board member cannot judge a proposed Claude rollout because the presentation consists mainly of model settings and token counts. Meanwhile, integration teams disagree about which of several revised policy and tool decisions remains current. Which TWO communication and governance artifacts solve these separate problems? Choose TWO.
- Keep a risk register with controls and accountable owners
- Compare options on a shared multi-dimensional scorecard
- Keep a versioned decision and change history
- Present executive decisions through outcomes, cost, and risk
- Record alternatives and rationale in an architecture decision record
Explanation
Correct Answers
C:Maintain a version-controlled decision log linked to implementation and review milestones, including superseded guidance; version-aware retrieval prevents implementation against outdated agreements; its corresponding workstream should be validated by correct retrieval of active decisions and their supersession chain during review.
D:Summarize business value, alternatives, cost envelope, measured evidence, and requested decisions in concise nontechnical terms; decision-focused review checks whether the audience can act on the information; its corresponding workstream should be validated by sponsor comprehension of expected outcomes, decision options, and risk ownership.
Incorrect Answers
A:Record probability and impact where appropriate, control owners, evidence, residual risk, and required approvals; a high-level statement that AI has risks does not create an actionable governance plan; its natural acceptance measure is completion and ownership of high-severity mitigations before the release gate, which does not satisfy the separate workstreams being assessed.
B:A weighted scorecard helps compare architecture alternatives when quality and cost goals conflict, yet these workstreams ask for an executive-level explanation of investment outcomes and a living record of superseded decisions; scoring candidates alone supplies neither artifact.
E:An architecture decision record documents trade-offs and rejected alternatives, but it does not on its own turn an investment presentation into decision-ready business language or preserve every active change and supersession in a cross-team release history.
Question 448
An employee productivity copilot processes externally authored mail and attachments. Security tests add instructions that imitate internal commands and seek unauthorized actions. Which metric would demonstrate resistance to that attack path?
- Maximum resource usage and orderly termination on deliberately unsolvable tasks
- Proportion of numeric claims supported by independently inspected references
- Unauthorized tool-action success rate over injected emails and documents
- Reviewer error interception on seeded incorrect recommendations
Explanation
Correct Answer
C:A realistic attack corpus exercises both model behavior and execution controls; measure unauthorized tool-action success rate over injected emails and documents at the release gate; model external content as untrusted input, test role spoofing and instruction attempts, and enforce downstream permissions regardless of the prompt.
Incorrect Answers
A:Budget stress tests show whether runaway loops fail safely; set per-task step, token, cost, and elapsed-time budgets with a clear abort and escalation state; this tests maximum resource usage and orderly termination on deliberately unsolvable tasks; the actual release condition is unauthorized tool-action success rate over injected emails and documents.
B:Grounding tests detect confident fabrication at the statement level; require support from retrieved source passages and provide an explicit unknown path for unsupported claims; this tests proportion of numeric claims supported by independently inspected references; the actual release condition is unauthorized tool-action success rate over injected emails and documents.
D:The review test measures meaningful human oversight, not click-through compliance; design review interfaces that expose citations, uncertainty, and targeted challenge checks rather than only an approval button; this tests reviewer error interception on seeded incorrect recommendations; the actual release condition is unauthorized tool-action success rate over injected emails and documents.
Question 449
A regional banking assistant uses inference, document retrieval, analytics logging, and backup services. Which verification result would substantiate a contractual claim that protected records stay in an approved jurisdiction?
- Verified geographic processing paths for all sensitive request components
- Documented authorization-boundary mapping for every service handling regulated data
- Completion of required privacy assessment and recorded resolution of high risks before go-live
- Approved contracting, access controls, and PHI data-flow verification for the selected service path
Explanation
Correct Answer
A:A full data-flow audit finds secondary exports that primary-storage checks miss; measure verified geographic processing paths for all sensitive request components at the release gate; trace storage, inference, retrieval, logs, backups, and subprocessors against contractual and legal location requirements.
Incorrect Answers
B:Boundary-specific checks prevent assuming certification transfers between unrelated services; verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; this tests documented authorization-boundary mapping for every service handling regulated data; the actual release condition is verified geographic processing paths for all sensitive request components.
C:Compliance readiness must be demonstrated upstream of irreversible data processing; involve privacy counsel to assess applicable lawful bases, transparency, rights, and whether a data-protection impact assessment is required before release; this tests completion of required privacy assessment and recorded resolution of high risks before go-live; the actual release condition is verified geographic processing paths for all sensitive request components.
D:Compliance verification must match the actual product configuration and agreement; confirm the specific service and contract support relevant HIPAA obligations, including any required business associate agreement and safeguards; this tests approved contracting, access controls, and PHI data-flow verification for the selected service path; the actual release condition is verified geographic processing paths for all sensitive request components.
Question 450
The model treats a narrow exception as a blanket rule because the surrounding conditions were omitted. Which action best removes the underlying failure mode?
- Combine lexical and semantic candidates when queries mix both
- Adopt semantic vector search for paraphrased knowledge questions
- Query structured data through authorized SQL or typed APIs
- Rerank candidate passages for question relevance
- Retrieve parent context after finding a specific chunk
Explanation
Correct Answer
E:Use child-chunk retrieval for recall and fetch validated parent context or adjacent governing sections for interpretation; context reconstruction tests whether narrow hits are interpreted in their governing scope; verify the repair using conditional-rule accuracy with and without parent-document expansion.
Incorrect Answers
A:Either modality alone leaves a known class of mixed-format queries uncovered; hybrid retrieval joins exact-term and semantic evidence, then applies metadata filtering and ranking; that control is assessed by joint exact-identifier accuracy and semantic-symptom recall on mixed queries; the incident instead requires conditional-rule accuracy with and without parent-document expansion.
B:Semantic search is not guaranteed to respect exact version strings, numerals, or access boundaries without additional controls; vector retrieval can match conceptual similarity between user wording and document text, followed by evidence verification; that control is assessed by recall on human-authored paraphrases absent from manual headings; the incident instead requires conditional-rule accuracy with and without parent-document expansion.
C:Unstructured document retrieval cannot ensure completeness or mathematical correctness for database totals; use a governed structured query interface with parameter checks and business semantics for exact aggregates; that control is assessed by exact aggregate agreement with a trusted query on authorized records; the incident instead requires conditional-rule accuracy with and without parent-document expansion.
D:A bigger first-stage candidate set without selection can dilute context and increase cost; apply a query-aware reranker after broad retrieval, respecting freshness and permissions, to prioritize evidence for synthesis; that control is assessed by relevant-procedure rank and end-to-end answer support rate after reranking; the incident instead requires conditional-rule accuracy with and without parent-document expansion.