LiteLLM
Manage authentication, load balancing, and cost tracking across 100+ LLMs through a single OpenAI-compatible gateway. Trusted by Netflix and enterprise teams.
45,416
Other
替代： Kong AI Gateway
最佳开源 Kong AI Gateway 替代方案
Manage and secure AI model APIs with advanced traffic control, authentication, and monitoring capabilities for enterprise AI deployments.
Kong AI Gateway5 tools
开源工具
Portkey AI Gateway
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
11,544
MIT
替代： Kong AI Gateway
Bifrost
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
5,994
Apache-2.0
替代： Kong AI Gateway
Envoy AI Gateway
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
1,778
Apache-2.0
替代： Kong AI Gateway
LLM Gateway
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
1,336
MIT
替代： Kong AI Gateway