LiteLLM
Manage authentication, load balancing, and cost tracking across 100+ LLMs through a single OpenAI-compatible gateway. Trusted by Netflix and enterprise teams.
45,416
Other
替代： Cloudflare AI Gateway
最佳开源 Cloudflare AI Gateway 替代方案
Route, monitor, and control API requests to multiple AI models through a unified gateway with built-in caching, rate limiting, and detailed analytics for cost optimization.
Cloudflare AI Gateway5 tools
开源工具
显示该主题下 5 个精选项目，共 5 个。
Portkey AI Gateway
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
11,544
MIT
替代： Cloudflare AI Gateway
Bifrost
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
4,910
Apache-2.0
替代： Cloudflare AI Gateway
Envoy AI Gateway
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
1,610
Apache-2.0
替代： Cloudflare AI Gateway
LLM Gateway
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
1,206
MIT
替代： Cloudflare AI Gateway