Production Reference Architecture

Separate request execution from the control systems that configure, evaluate, and govern it.

A production architecture should make model access, data movement, policy, state, and observability visible. One useful distinction is between the data plane, which executes user requests, and the control plane, which governs how that execution is configured and released.