A claims-support team is preparing to introduce Claude in two very different places. One service classifies thousands of low-risk customer messages, then routes them to the right queue. The other examines disputed claims, compares contractual evidence and prepares a recommendation that a human reviewer may approve. Both use language models. They should not automatically use the same model, inference platform, error policy or latency budget.
The architecture decision begins before picking an appealing model name. What evidence does each task require? How serious is an unsupported recommendation? Which systems hold regulated information? Is the application allowed to take action or only prepare a draft? Once those boundaries are clear, model capability and deployment choice become testable engineering decisions rather than marketing preferences.
Separate model selection from platform selection
A Claude model is the reasoning and generation component. A deployment platform supplies an API endpoint, billing and identity integration, capacity limits, networking arrangements, operational support and data-processing terms. Selecting one does not settle the other. An excellent model delivered through an endpoint that cannot satisfy a mandatory data-handling requirement is still the wrong architecture.
| Decision | Questions to answer | Evidence worth collecting |
|---|---|---|
| Model capability | Can it extract, reason, use tools and abstain on the actual workload? | Held-out task evaluations and error classifications |
| Responsiveness | What is the acceptable first-response time and completed-workflow latency? | p50/p95 total path timings including retrieval and review |
| Economics | What does a successful case cost, including retries and verification? | Input/output usage, cache behavior, tool spend, human escalations |
| Deployment boundary | Who processes the data, where, under which agreement and access controls? | Provider documentation, endpoint configuration, approved contract |
| Operating resilience | What happens when the inference endpoint, tool or policy source fails? | Timeout traces, fallback drill, recovery and idempotency tests |
This separation matters for the Anthropic Claude Certified Architect – Foundations candidate because the strongest design answer normally defends constraints, not a brand-name shortcut. The exam’s architecture focus is better served by an evidence-led comparison than by memorizing whichever model happens to top a benchmark today.
Use a capability ladder, not a universal “best” model
Anthropic offers Claude models with different capability, latency and pricing profiles. A faster, less expensive option may classify routine messages accurately enough; a more capable model may improve difficult evidence reconciliation. Those are hypotheses until evaluated on the actual application. Model lists, IDs, pricing and availability evolve, so a production architecture should record the approved snapshot and review it before rollout or migration.
For the claims team, build two distinct evaluation sets. The queue-routing set includes simple intent labels, mixed-language descriptions, messages with two possible destinations and empty or adversarial inputs. The disputed-claim set includes amended policies, contradictory attachments, withdrawn evidence and cases in which the correct outcome is cannot determine without review. A model that is superb at short classification can still give unjustified certainty when documents conflict.
Test the least expensive candidate that meets the required capabilities, then compare stronger candidates on the cases that actually fail. An efficiency-first trial can be sensible for predictable classification. For the disputed cases, beginning with a more capable model and later optimizing downward may reduce the risk of designing a workflow around poor early answers. Neither starting point is an immutable ranking; use the recorded errors and operating requirements to choose.
Generation effort, maximum output limits, available tools and context requirements may also change the result. If a supported effort setting improves hard-case reasoning without switching models, measure that option rather than assuming every quality issue requires a different model family. Do not generalize a setting that helps complex reconciliation to latency-sensitive labels without testing it separately.
Define failure costs before you compare quality scores
Average accuracy hides consequential errors. Suppose an assistant handles 100 illustrative disputed claims and correctly summarizes most straightforward ones but invents a decisive exclusion in three amended policies. The raw success percentage might look attractive. The costly error is that a reviewer receives a plausible, unsupported recommendation. Your evaluation must count false confident decisions, evidence attribution, false escalation and safe abstention separately, not bury them in one composite score.
For each evaluation case, store a synthetic case identifier, reference documents, controlling policy revision, permitted tool results, expected evidence state and acceptable next action. Mark whether the model cited the actual controlling clause, recognized conflicts and stopped rather than authorizing a payment. Require the same evaluation protocol across all candidate models and versions. The architecture changes only after you can explain what improved and which important error class did not.
This is also why structured output cannot certify the decision. The model may produce valid JSON containing recommended_action, policy_revision, evidence_refs and needs_review, yet choose the wrong revision. The structured-output validation problem is separate from model selection: a schema guarantees shape constraints only where supported, while source checks and business policy must establish meaning and authority.
When model routing helps—and when it introduces a hidden failure
The team might route routine message classification to a faster model, while sending evidence-heavy cases to a more capable one. Routing can reduce cost or latency only if the rule that separates tasks is itself reliable. A dangerous design asks the first model whether its answer is “confident” and uses that uncalibrated statement as the sole escalation signal. Many unsupported answers sound certain.
Prefer explicit inputs to the routing rule: case type, availability of a signed policy, conflicting document versions, known high-consequence categories and whether tools returned verifiable sources. A cheap first pass can identify the document class and mandatory evidence, then a more capable review can handle defined exceptions. The business application—not a model’s persuasive explanation—retains the authority to choose which cases can proceed without review.
Test routing on ambiguous and adversarial cases. If the supposedly simple queue includes messages involving fraud, disputed liability or a regulatory notice, the inexpensive path must not swallow those cases merely because it generated a concise label. Track routing errors as their own metric, not simply as failures of whichever model was ultimately selected.
The same Claude model can carry different platform obligations
Claude can be accessed through Anthropic’s first-party API and through supported cloud offerings. In an AWS environment, distinguish the Anthropic-operated Claude Platform on AWS from Claude in Amazon Bedrock, where AWS operates the inference stack. An AWS bill does not by itself tell you which organization processes inference data. Google Cloud and Microsoft Foundry offerings have their own endpoint, identity, geography and feature considerations. Availability and operating details must be checked for the exact service, region and model snapshot.
| Deployment route | Architectural question | Common mistaken assumption |
|---|---|---|
| Direct Claude API | Does the organization’s Anthropic agreement and network/identity arrangement satisfy the workload? | That direct API access automatically meets every locality or retention requirement |
| Claude Platform on AWS | Do Anthropic-operated inference and AWS marketplace identity/billing fit the data-processing policy? | That it is identical to AWS-operated Bedrock because both are reached through AWS |
| Claude in Amazon Bedrock | Are the required AWS processing, endpoint, IAM and region characteristics available? | That any region or endpoint mode preserves the same residency guarantees |
| Claude through Google Cloud | Which endpoint type, feature set and Google Cloud governance controls apply? | That a supported model always has identical capability and release timing on every platform |
| Claude through Microsoft Foundry | What hosting mode, data processor, geographic option and Azure identity arrangement govern this deployment? | That an Azure subscription alone defines where inference occurs |
Check the actual contracts and product documentation. Network location, workspace storage location, inference location and billing region can be independent. A platform can offer global routing for availability and an alternative regional or geographic configuration for residency, sometimes with different cost or model support. Declaring compliance based solely on the cloud provider’s marketing label would be an architecture mistake.
Data-retention arrangements also deserve separate examination. A zero-data-retention program can have eligibility conditions and may not cover every tool or feature automatically. The relevant question is which organization processes the prompt and result for the selected product, what is retained, what is excluded, and how that fits the approved policy. A provider policy that supports one integration must not be copied to another without verification.
Plan migration and fallback as operational changes
Switching platforms is not necessarily a one-line change to an API base URL. The identity method, SDK client, model identifier, supported API surface, feature availability, endpoint limits, rate policies and response handling may differ. An application that silently assumes the old model ID or tool behavior applies everywhere can fail at launch or, worse, produce a subtly different workflow.
For a proposed migration, build a compatibility register covering authentication, allowed model snapshot, tool support, structured-output behavior, context limits, error codes, request logging, quota behavior and geography. Replay a held-out subset of claims against the new setup and compare not just the final text but the evidence sources, tool calls, abstentions, latencies and costs. Record the conditions under which the old path remains available for rollback.
Failover needs even more care when tools cause side effects. A timeout after an external update leaves uncertain state; routing the same work to another inference platform may duplicate a transaction. Maintain a stable operation identifier and verify the external state before retrying. An agent that can resume a research task is not thereby authorized to replay a payment. These are the same agent-versus-workflow boundaries that shape a defensible Foundations architecture.
Cost the completed business workflow, not a single response
Token rates matter, but end-to-end economics include prompt preparation, retrieval, cached prefixes, model turns, validation, tool retries, reviewer time and rejected cases. A model with a lower published token rate can still be more expensive per accepted case if it repeatedly requests tools, fails to cite sources or produces more escalations. Conversely, a stronger model may be cost-effective for a narrow class of high-consequence exceptions if it reduces expensive manual rework.
Measure cost per verified completed case, not only cost per API request. Log usage by case category without storing unnecessary personal information. Compare success and cost at representative production volumes, and include occasional traffic spikes rather than sizing solely for average load. The broader professional observability discussion handles production telemetry at enterprise scale; a Foundations architect should at least show how model and routing decisions would be tested and monitored for one bounded application.
Write an architecture decision record that can be challenged
For the illustrative claims service, a defensible provisional design is a narrow, low-latency model for well-defined queue labels, a stronger evidence-review path for complex disputes, and an independent business policy gate before any financial action. Choose the inference platform only after the company’s processor, geography, identity and retention requirements have been approved. Keep the source policy and claims records in authorized systems; the model receives only the evidence required for its current task.
| Decision recorded | Provisional choice | Change it when… |
|---|---|---|
| Routine classification | Fast candidate, held-out evaluation and clear abstention states | Exception routing or class recall misses material cases |
| Disputed-claim review | More capable candidate with evidence citation and human approval | Alternative model/effort improves held-out outcomes at acceptable cost |
| Deployment provider | One specifically approved processing and geographic boundary | Legal requirements, provider terms or operational constraints change |
| Side effects | No direct model authority; idempotent application-side approval and execution | Business policy formally delegates a bounded operation with enforceable controls |
| Rollback and monitoring | Tracked model/endpoint snapshots, outcome and latency measures | Observed drift, incidents, unacceptable p95 or a new capability requirement |
Finally, rehearse the uncomfortable case: the cheap model misclassifies a regulatory complaint, the stronger model cites an outdated policy and the preferred endpoint becomes unavailable. A useful architecture shows which check catches each failure and what the user sees while the system cannot safely proceed. If the answer is merely “use the best model in the cloud,” the most important design decisions remain unresolved.
Continue exploring the technologies and certification concepts that matter most to you.