Documentation
Strategies
Lower cost, route by benchmark, compare models, and cache repeated work.
In this section
Cost-efficient routing
Use lower-cost Flex capacity when it meets your latency needs.
Benchmark routing
Route through weighted benchmark aliases with automatic fallback.
Shadow models
Stop overpaying for every request. Find the cheapest model that performs on your real production traffic.
Prompt caching
Reuse provider-cached prompt prefixes to reduce latency and cost.