Skip to content

Architecture Decision Guide

Choose an AI agent framework by architecture, not hype

Framework selection should follow the operating model of the agent: how state is persisted, how work is scheduled, how tools are secured, and how failures are recovered.

Answer in brief

Choose the framework that makes state transitions explicit, supports durable execution, exposes complete traces, and lets you replace models and tools without rewriting the workflow. Prototype convenience matters less than operational control.

Decision dimensions

Use these dimensions to make the architecture decision explicit and testable.

State model

Can the framework checkpoint, resume, branch, and replay a workflow?

Control flow

Can you mix deterministic steps with model decisions and human approvals?

Tool contracts

Are parameters typed, validated, permissioned, and observable?

Deployment

Can workers scale independently and survive process restarts?

Portability

How tightly are prompts, state, and tool code coupled to proprietary abstractions?

Single-agent vs multi-agent

Use these dimensions to make the architecture decision explicit and testable.

Single agent

Start here. One orchestrator with well-defined tools is easier to evaluate and secure.

Specialist workers

Add workers when tasks require distinct context, permissions, or evaluation criteria.

Multi-agent debate

Use only when independent perspectives improve measurable outcomes. It otherwise increases coordination cost.

Proof-of-concept scorecard

Use these dimensions to make the architecture decision explicit and testable.

Reliability

Resume after failure and produce the same result when inputs are fixed.

Observability

Trace prompts, model outputs, tool calls, state changes, cost, and approvals.

Security

Enforce least privilege and prevent untrusted content from selecting arbitrary tools.

Maintainability

Version graphs, prompts, schemas, and policies independently.

Production checklist

Use this as a design-review gate before release.

  1. Model the workflow before choosing a framework.
  2. Test restart and replay behavior.
  3. Validate every tool input.
  4. Export traces to your observability stack.
  5. Keep business state outside the conversation.
  6. Run the same evaluation set across finalists.

Continue learning

Place this pattern inside a broader agent architecture and operating model.

AI agent tutorial library

Browse memory, planning, frameworks, reliability, safety, and observability.

Open the tutorial library →

AI agent guide

Start with agent features, design patterns, benefits, challenges, and industry applications.

Open the guide →