GlossaryShared across all subject areas

LLM gateway

A service routing all model calls through one controlled point.

Why it matters

Makes residency routing, retention policy, cost attribution and provider substitution configuration changes rather than code changes. Without it, switching provider is a refactor and nobody knows what data left.