Gateway
One API in front of several model providers. Requests are routed by task, fall back to a second provider when the first fails, and repeat questions are answered from cache.
- Routing across Anthropic, OpenAI, and AWS Bedrock
- Automatic failover between providers
- Response and prompt caching
- Regional routing for data residency