Launch briefing
Stage

An agent architecture challenge

Build the agent fleet.
Defend every boundary.

Design a production support agent on Amazon EKS. Every choice changes latency, cost, isolation, or operational load.

Always on customer support 3 agents orders · inventory · returns Untrusted generated code 3 model paths managed · EKS · fallback
6 platform decisions 5 isolation incidents Session architecture guidance Deterministic score model
Customers support requests
Edge + auth Cognito + ingress
Amazon EKS
Agent tier supervisor + specialists
AI gateway one model API
Models Bedrock + vLLM
MCP toolsactions
Memorysession + RAG
Agent using a sandboxisolated task execution
Agent in a sandboxisolated agent session
Telemetryagent + gateway traces

Round 1 of 6

Choose how the agent lives

Launch contract The runtime matches how customers actually use the agent.
Latency
50
Cost
50
Isolation
50
Operability
50
AnyCompany Agent Platform · Amazon EKS
Awaiting architecture decisions
OUTSIDE THE CLUSTER
Customers support traffic
Edge + auth Cognito + ingress
Amazon EKS
PRIMARY REQUEST PATH
Agent tier shape undecided
AI gateway not configured
Models direct clients
PLATFORM CAPABILITIES
MCP tools reusable services
Agent using a sandbox isolated task execution
Memory session + RAG
Agent in a sandbox isolated agent session
Telemetry agent + gateway traces
RUNTIMEUndecided
TOOLS + MEMORYEmbedded
CODEShared identity
COORDINATIONSingle agent
MODEL + POLICYDirect clients
PLATFORM DECISION Modeled outcome

Choose one approach

Mission complete

Your agent architecture profile

LAUNCH REVIEW
OPERATING PROFILE

Balanced platform

Constraint review

Would these boundaries hold?

Reviewing

Architecture record

Six decisions, one agent platform

Self-guided architecture lab

Stress the boundary. Inspect the consequence.

Five production incidents

Contain model-generated code

Repair the isolation boundary without turning every request into a cold start.

0 / 5 contained
DETERMINISTIC FLOOR no credentials · no neighbors · one allowed path out CLAIM one task VEND warm sandbox RUN side channel DESTROY TTL cleanup
Decision rules from the session

Match the Kubernetes shape to the work

The same agent code can be a Service, Job, or session. Coordination changes independently.

Agent lifecycle
Team topology
Handoff duration
SESSION RULES lifecycle → primitive · topology → coordinator · duration → transport

Team shape does not dictate transport. A2A and MCP solve different directions.

A2A = agent to agent. MCP = agent to tool.

Heterogeneous compute rollout

A Ready node is not a ready model

Watch scheduling, image pull, weight loading, readiness, and agent scaling complete in separate phases.

PODS RUNNING 0/11
all workload classes
NODES READY 0
created by matching NodePools
CURRENT BOTTLENECK request resources → provision node → load model → pass readiness
SCHEDULINGtraffic waits here
Node planeEMPTY
Model planeNOT READY

Pods declare capabilities; Karpenter has not created matching nodes yet.

Architecture consequence simulation

One model route changes. Which agents break?

Compare direct provider clients with one gateway endpoint as budget and availability change.

PRIMARY MODEL Bedrock
managed route
TEAM TOKEN RATE 44k/min
shared budget
GATEWAY POLICY authenticate → budget → route → fallback
PRIMARYone control point
Direct SDKsSERVE
AI gatewaySERVE

The primary route is healthy. Both designs serve traffic.

Self-managed, integrated, or both

Choose where you want control and where you want offload

The options are peers, not maturity levels. Inspect the operating posture of each boundary.

The non-negotiable floor

Probabilistic policy sits above deterministic controls

Identityleast privilege Isolationblast radius Guardrailsprobabilistic

Facilitator setup

Participant link

The QR code adds participant mode to this address.

Evidence and further reading

Sources

Mission scores are deterministic teaching aids. The architecture guidance and tradeoffs are taken from the companion session.