# AI Gateways

> Unified endpoints, routing, and fallback across multiple AI model providers.

Navigation: [Index](../../llms.txt) · [HTML](https://awesomeopensource.dev/topic/ai-gateways)

AI gateways put one API in front of many model providers, handling authentication, quotas, retries, and fallback. They are useful when you want to switch models without rewriting application code.

This topic covers self-hostable gateways and companion authentication plugins that expose multiple commercial and open-weight models through a single endpoint.

## Feature comparison

| Project | Multi-provider routing | Fallback and retries | Rate limits and budgets | OpenAI-compatible endpoint | Logging and observability | Response caching | Guardrails and content filtering |
|---|---|---|---|---|---|---|---|
| [cheaper-inference/OmniRoute](../cheaper-inference-omniroute.md) | Yes | Yes | Yes | Yes | Partial | – | – |
| [diegosouzapw/OmniRoute](../diegosouzapw-omniroute.md) | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| [BerriAI/litellm](../berriai-litellm.md) | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| [Alph4d0g/opencode-omniroute-auth](../alph4d0g-opencode-omniroute-auth.md) | Yes | Yes | Yes | Yes | Yes | No | No |
| [Portkey-AI/gateway](../portkey-ai-gateway.md) | Yes | Yes | – | Yes | Yes | Yes | Yes |

## Features

- **Multi-provider routing**: Routes requests across several model providers.
- **Fallback and retries**: Fails over between providers or retries requests.
- **Rate limits and budgets**: Controls usage with quotas, rate limits or cost budgets.
- **OpenAI-compatible endpoint**: Accepts OpenAI-style requests so existing clients work.
- **Logging and observability**: Records requests, traces or usage metrics.
- **Response caching**: Caches model responses to cut latency and cost.
- **Guardrails and content filtering**: Applies safety checks or content filters to model traffic.

## 5 projects

- [cheaper-inference/OmniRoute](../cheaper-inference-omniroute.md) · Activity score 5.0/5 (Thriving)
- [diegosouzapw/OmniRoute](../diegosouzapw-omniroute.md) · Activity score 5.0/5 (Thriving)
- [BerriAI/litellm](../berriai-litellm.md) · Activity score 5.0/5 (Thriving)
- [Alph4d0g/opencode-omniroute-auth](../alph4d0g-opencode-omniroute-auth.md) · Activity score 3.0/5 (Maintained)
- [Portkey-AI/gateway](../portkey-ai-gateway.md) · Activity score 2.9/5 (Maintained)
