Question 460
A malformed generated field reaches a write endpoint and is rejected after an unintended partial update. Which change should the architect recommend first?
- Use a queue and asynchronous workers for bursty workloads
- Persist workflow state and make retries idempotent
- Link each output to source and processing trace IDs
- Validate model output against a business schema before side effects
Explanation
Correct Answer
D:Use structured output parsing, semantic validation, and a separate authorized command handler so generated text is never treated directly as a write instruction; pre-write enforcement proves that the model cannot bypass the target system's integrity contract; verify the repair using invalid write payloads rejected before execution, with zero partial supplier mutations.
Incorrect Answers
A:Queueing absorbs bursts but does not improve a weak answer rubric or justify a higher-privilege tool set; decouple intake from processing through durable queues, bounded workers, and status callbacks rather than keeping user connections open; that control is assessed by job completion rate and queue age during the peak intake window; the incident instead requires invalid write payloads rejected before execution, with zero partial supplier mutations.
B:Durable-state control prevents duplicate effects but cannot decide whether a refund is substantively authorized; persist state transitions and use idempotency keys at side-effect boundaries to avoid duplicate transactions across replays; that control is assessed by repeated and interrupted test runs yielding exactly one committed credit per approved case; the incident instead requires invalid write payloads rejected before execution, with zero partial supplier mutations.
C:Traceability explains decisions after the fact; it is not a replacement for preventing unauthorized source access; correlation IDs, source versions, and stage logs establish end-to-end lineage across extraction, retrieval, inference, and review; that control is assessed by fraction of sampled outputs reproducibly linked to input, model configuration, and reviewer disposition; the incident instead requires invalid write payloads rejected before execution, with zero partial supplier mutations.
Question 461
An IT helpdesk routes routine status inquiries through a lighter model and complex incidents through deeper analysis. Which measurement would show that tiering lowers cost without reducing accepted resolutions?
- p95 response time with all three source checks present under load
- Accepted resolution rate and cost per case across routed difficulty levels
- Cache-read rate, p95 latency, and cost per accepted answer under repeated queries
- Cost and successful throughput per nightly processing window
Explanation
Correct Answer
B:Stratified monitoring confirms economic gains do not displace expensive errors onto users; measure accepted resolution rate and cost per case across routed difficulty levels at the release gate; evaluate a smaller model on straightforward request strata and escalate only where measurable capability is needed.
Incorrect Answers
A:The acceptance signal guards against a fast but incomplete response; parallel retrieval with per-call budgets reduces wall time while preserving authorization and complete aggregation; this tests p95 response time with all three source checks present under load; the actual release condition is accepted resolution rate and cost per case across routed difficulty levels.
C:Joint economics and quality checks demonstrate that reuse helps without sacrificing correctness; keep a stable eligible prompt prefix and measure cache-read tokens to reduce repeated processing; this tests cache-read rate, p95 latency, and cost per accepted answer under repeated queries; the actual release condition is accepted resolution rate and cost per case across routed difficulty levels.
D:Deadline-oriented throughput is the relevant performance objective for noninteractive work; use suitable batch orchestration and queue control to trade immediate response time for predictable throughput and expense; this tests cost and successful throughput per nightly processing window; the actual release condition is accepted resolution rate and cost per case across routed difficulty levels.
Question 462
Reviewers cannot determine whether a wrong recommendation arose in OCR, policy extraction, or interpretation. Which action best removes the underlying failure mode?
- Divide work along independently verifiable artifacts
- Separate planning proposals from privileged execution
- Partition research by source and reconcile conflicts explicitly
- Checkpoint long-running work for replay and recovery
Explanation
Correct Answer
A:Separate stages with typed artifacts allow validation and targeted reruns at meaningful boundaries; a traceable artifact boundary confines error analysis to the failed operation; verify the repair using stage-specific defect localization and repair without redoing previously validated stages.
Incorrect Answers
B:Planning/execution separation does not fix whether the recommended plan uses current policy data; use a planning artifact that is reviewed and handed to a distinct authorized executor; never treat proposed tool calls as permission to mutate state; that control is assessed by unauthorized mutations during plan-only tests, with a target of zero; the incident instead requires stage-specific defect localization and repair without redoing previously validated stages.
C:Simple partitioning can preserve conflicting claims unless the merge step includes a reconciliation rule; analyze source partitions separately, retain provenance, and reconcile contradictions through a dedicated synthesis stage; that control is assessed by conflict detection recall and citation coverage across independently processed source sets; the incident instead requires stage-specific defect localization and repair without redoing previously validated stages.
D:Checkpointing reduces replay cost but cannot correct a defective classification rubric; durable checkpoints record validated intermediate artifacts and resume at safe boundaries with idempotent side effects; that control is assessed by successful recovery after injected worker failures without duplicated writes or stages; the incident instead requires stage-specific defect localization and repair without redoing previously validated stages.
Question 463
A US federal contractor proposes an AI workflow for information requiring a defined cloud authorization baseline. Which approach best meets the stated requirement?
- Apply accountable access, deletion, and retention processes
- Map data residency commitments to actual processing paths
- Validate FedRAMP authorization against exact service boundaries
- Minimize personal data and specify retention purpose
Explanation
Correct Answer
C:Verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; boundary-specific checks prevent assuming certification transfers between unrelated services; evaluate the design with documented authorization-boundary mapping for every service handling regulated data.
Incorrect Answers
A:Map data copies, implement lifecycle deletion where required, and retain audit evidence of the authorized request and its completion; deleting the original row does not automatically erase embeddings, caches, or observability copies; this alternative would measure deletion-request completion across all inventoried repositories within policy deadlines; it does not establish documented authorization-boundary mapping for every service handling regulated data for the described use case.
B:Trace storage, inference, retrieval, logs, backups, and subprocessors against contractual and legal location requirements; locating the primary database domestically does not ensure every supporting service processes data there; this alternative would measure verified geographic processing paths for all sensitive request components; it does not establish documented authorization-boundary mapping for every service handling regulated data for the described use case.
D:Limit processing to necessary authorized fields, define a lawful purpose and retention controls, and document relevant privacy obligations; broad encryption does not justify collecting more personal data than the task needs; this alternative would measure sensitive-field inclusion rate in prompts and retention-policy compliance; it does not establish documented authorization-boundary mapping for every service handling regulated data for the described use case.
Question 464
Following a safety policy revision, ordinary repair guidance is unexpectedly blocked. Which before-and-after evaluation would reveal whether reduced unsafe output has caused unacceptable over-refusal?
- Percent of failures with a complete trace to the responsible stage
- Detection of version-specific quality regressions in a staged rollout
- Reproduction of sampled reviewer defects against their original configuration
- Safety precision/recall and legitimate-task completion before and after the change
Explanation
Correct Answer
D:Paired monitoring distinguishes beneficial safety controls from excessive refusals; measure safety precision/recall and legitimate-task completion before and after the change at the release gate; monitor both harmful-output violations and false-positive blocks by version and user segment.
Incorrect Answers
A:Trace completeness measures incident diagnosability rather than raw log volume; correlation and span IDs across components allow latency and failure attribution along the actual path; this tests percent of failures with a complete trace to the responsible stage; the actual release condition is safety precision/recall and legitimate-task completion before and after the change.
B:Release segmentation isolates changes before broad impact; partition traces and scored outcomes by deployed configuration, using release identifiers to support rollback and diagnosis; this tests detection of version-specific quality regressions in a staged rollout; the actual release condition is safety precision/recall and legitimate-task completion before and after the change.
C:Version-linked labels enable targeted, testable corrections; log consented feedback alongside prompt revision, model route, source version, and case context for reproducible analysis; this tests reproduction of sampled reviewer defects against their original configuration; the actual release condition is safety precision/recall and legitimate-task completion before and after the change.
Question 465
The assistant includes a copied bearer token in its response to a routine diagnostic question. Which corrective change best addresses the root cause?
- Delimit retrieved content as untrusted evidence
- Keep invariant policy instructions distinct from per-request input
- Use a machine-readable output contract and validator
- Limit disclosure of secrets and confidential instructions
Explanation
Correct Answer
D:Redact sensitive fields upstream, prohibit secret reproduction in instructions, and screen outbound content before release; seeded canaries allow a measurable check of unwanted disclosure paths; verify the repair using secret-exposure rate under seeded credential-bearing diagnostic inputs.
Incorrect Answers
A:Delimiters aid instruction hierarchy but do not sanitize malicious destinations or replace output security controls; clearly separate lower-trust source material from application instructions and enforce permissions at the tool layer as well; that control is assessed by prompt-injection resistance on hostile retrieved snippets without loss of legitimate source use; the incident instead requires secret-exposure rate under seeded credential-bearing diagnostic inputs.
B:A modular instruction layout does not itself prove that external API permissions are enforced; separate stable system-level policy from user content and tool results, retaining consistent privilege boundaries across requests; that control is assessed by rate of user messages that fail to override defined task boundaries in regression tests; the incident instead requires secret-exposure rate under seeded credential-bearing diagnostic inputs.
C:Human-readable examples alone do not guarantee that all runtime outputs satisfy machine contracts; request a documented structured format and validate schema, allowed values, and business semantics before downstream use; that control is assessed by valid schema rate and zero unauthorized enum values reaching the consumer; the incident instead requires secret-exposure rate under seeded credential-bearing diagnostic inputs.
Question 466
A publisher needs to process a large archive of text overnight, with no expectation of interactive responses. A mechanical troubleshooting assistant must decide which diagnostic tests to run only after seeing intermediate measurements. Which TWO processing patterns are most suitable? Choose TWO.
- Use a deterministic workflow for known ordered stages
- Use a bounded tool-using agent for exploratory investigation
- Use offline batch processing when immediate interactivity is unnecessary
- Ground dynamic policy answers with retrieval
- Embed a small agent inside a controlled workflow
Explanation
Correct Answers
B:Bounded agentic planning chooses follow-up tools from observed evidence while enforcing time, budget, and tool permissions; the agent must demonstrate flexible discovery without escaping its operational guardrails; its corresponding workstream should be validated by resolution of unseen diagnostic branches within a specified tool-call and time budget.
C:Batch-oriented orchestration handles throughput, retries, and cost planning while preserving consistent model instructions for a noninteractive workload; throughput and unit economics measure the benefit that a user-facing latency metric would miss; its corresponding workstream should be validated by completed valid classifications per batch window and cost per accepted record.
Incorrect Answers
A:A fixed sequence is appropriate for known, ordered checks, but bulk overnight classification benefits from batch processing, whereas open-ended equipment diagnosis needs bounded adaptive tool selection; a deterministic chain alone meets neither requirement.
D:Retrieval from a versioned, access-filtered source grounds answers in current documents and can expose the authoritative citation; retrieval does not create new authoritative policy; its natural acceptance measure is correct citations to currently effective policy versions across update tests, which does not satisfy the separate workstreams being assessed.
E:A small agent embedded in a controlled workflow can preserve mandated steps while allowing some exploration, but this paired decision calls for an economical offline batch lane and a separate exploratory diagnostic agent; the hybrid pattern is not the most direct solution to both.
Question 467
Per-request price decreases while the proportion requiring a second run doubles. How should the design be corrected?
- Reuse expensive stable prefixes through prompt caching
- Reduce context using retrieval and relevance filtering
- Tune cost using the rate of acceptable outcomes
- Route straightforward requests to a validated economical model
Explanation
Correct Answer
C:Optimize total cost per successful output with floor constraints on completeness, safety, and latency; quality-constrained unit economics penalizes truncation and repeat work; verify the repair using all-in cost per accepted summary at a fixed mandatory-section completion rate.
Incorrect Answers
A:Selecting a smaller model alone may reduce price but does not address wasted recomputation of invariant content; keep a stable eligible prompt prefix and measure cache-read tokens to reduce repeated processing; that control is assessed by cache-read rate, p95 latency, and cost per accepted answer under repeated queries; the incident instead requires all-in cost per accepted summary at a fixed mandatory-section completion rate.
B:Token truncation at arbitrary character positions can remove governing exceptions and worsen accuracy; retrieve relevant excerpts and retain enough surrounding evidence for interpretation rather than indiscriminately filling the context window; that control is assessed by supported-answer rate per input token on labeled audit questions; the incident instead requires all-in cost per accepted summary at a fixed mandatory-section completion rate.
D:Using the cheapest model universally could impair complex or safety-critical cases; evaluate a smaller model on straightforward request strata and escalate only where measurable capability is needed; that control is assessed by accepted resolution rate and cost per case across routed difficulty levels; the incident instead requires all-in cost per accepted summary at a fixed mandatory-section completion rate.
Question 468
Repeatedly processing unchanged background instructions dominates input cost and slows response startup. How should the design be corrected?
- Cache a stable, high-volume prompt prefix
- Trace cache effectiveness with token usage counters
- Modularize shared task instructions for consistent reuse
- Keep dynamic fields out of cached prefix content
Explanation
Correct Answer
A:Put reusable instructions and reference material in a consistent prefix and use supported prompt-cache controls while placing variable requests afterward; cache-hit telemetry verifies the optimization rather than relying on estimated token savings; verify the repair using cache-read input tokens and end-to-end latency over repeated requests.
Incorrect Answers
B:A faster model might improve latency but would not explain a missing cache hit on identical prompts; compare cache-creation and cache-read token telemetry and inspect prefix ordering, eligible size, and reuse timing; that control is assessed by sustained cache-read token share under repeated workload replay; the incident instead requires cache-read input tokens and end-to-end latency over repeated requests.
C:Prompt modularity simplifies governance; it cannot alone guarantee that a sensitive tool call is authorized; maintain a versioned reusable prompt module with explicit parameters and regression tests across consumers; that control is assessed by cross-application prompt-version alignment and regression pass rate; the incident instead requires cache-read input tokens and end-to-end latency over repeated requests.
D:A cache breakpoint cannot compensate for changes to earlier content in the hashed prefix; move changing metadata after the stable prefix so cache keys remain reusable across otherwise similar requests; that control is assessed by prefix reuse ratio when request metadata changes across calls; the incident instead requires cache-read input tokens and end-to-end latency over repeated requests.
Question 469
An international bank promises that specified customer records stay in an approved geographic jurisdiction. What should the solution architect recommend?
- Assess privacy risks and lawful processing grounds early
- Map data residency commitments to actual processing paths
- Validate FedRAMP authorization against exact service boundaries
- Check HIPAA business associate and safeguard requirements
- Implement accountable access, deletion, and retention processes
Explanation
Correct Answer
B:Trace storage, inference, retrieval, logs, backups, and subprocessors against contractual and legal location requirements; a full data-flow audit finds secondary exports that primary-storage checks miss; evaluate the design with verified geographic processing paths for all sensitive request components.
Incorrect Answers
A:Involve privacy counsel to assess applicable lawful bases, transparency, rights, and whether a data-protection impact assessment is required before release; technical model accuracy does not establish permission to process sensitive personal information; this alternative would measure completion of required privacy assessment and recorded resolution of high risks before go-live; it does not establish verified geographic processing paths for all sensitive request components for the described use case.
C:Verify the specific service, region, impact level, boundary, and agency authorization requirements with security officials before selection; a general government-cloud label or vendor marketing statement is not equivalent to FedRAMP authorization; this alternative would measure documented authorization-boundary mapping for every service handling regulated data; it does not establish verified geographic processing paths for all sensitive request components for the described use case.
D:Confirm the specific service and contract support relevant HIPAA obligations, including any required business associate agreement and safeguards; a provider security claim alone does not prove that the purchased deployment is contractually suitable for PHI; this alternative would measure approved contracting, access controls, and PHI data-flow verification for the selected service path; it does not establish verified geographic processing paths for all sensitive request components for the described use case.
E:Map data copies, implement lifecycle deletion where required, and retain audit evidence of the authorized request and its completion; deleting the original row does not automatically erase embeddings, caches, or observability copies; this alternative would measure deletion-request completion across all inventoried repositories within policy deadlines; it does not establish verified geographic processing paths for all sensitive request components for the described use case.
Question 470
A customer-support change increases total resolution but worsens outcomes for users on an accessibility channel. What should the solution architect recommend?
- Predefine success criteria and sample-size assumptions
- Inspect segment-level effects rather than only global lift
- Use shadow evaluation before enabling new side effects
- Release canaries with guardrail metrics and rollback conditions
Explanation
Correct Answer
B:Compare treatment effects across predeclared critical segments and require safeguards where harm would be unacceptable; segment-aware decisions expose concentrated regressions before full rollout; evaluate the design with resolution and safety deltas by channel and accessibility segment.
Incorrect Answers
A:Define primary metrics, minimal meaningful effect, sample-size method, and stopping rules before examining results; repeatedly peeking and stopping at a favorable fluctuation inflates false-positive decisions; this alternative would measure pre-registered experiment compliance and interval estimates at the planned sample size; it does not establish resolution and safety deltas by channel and accessibility segment for the described use case.
C:Replay or mirror representative inputs through a non-mutating shadow path, compare decisions, then gate any live actions separately; a normal A/B test is inappropriate if experimental behavior can cause unreviewed irreversible changes; this alternative would measure shadow-policy agreement and zero write side effects across replayed billing cases; it does not establish resolution and safety deltas by channel and accessibility segment for the described use case.
D:Deploy to a bounded cohort while observing quality, errors, and tail latency, with predefined stop and rollback thresholds; a single offline score cannot show all production interactions or blast radius; this alternative would measure canary threshold compliance and time to revert a seeded regression; it does not establish resolution and safety deltas by channel and accessibility segment for the described use case.