https://github.com/maximhq/bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
https://github.com/maximhq/bifrost
ai-gateway gateway gateway-services generative-ai guardrails llm llm-cost llm-gateway llm-observability llmops load-balancing mcp-client mcp-gateway mcp-server model-router token-management
Last synced: 6 days ago
JSON representation
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
- Host: GitHub
- URL: https://github.com/maximhq/bifrost
- Owner: maximhq
- License: apache-2.0
- Created: 2025-03-19T07:21:26.000Z (12 months ago)
- Default Branch: main
- Last Pushed: 2026-02-12T20:51:11.000Z (27 days ago)
- Last Synced: 2026-02-13T03:36:30.389Z (27 days ago)
- Topics: ai-gateway, gateway, gateway-services, generative-ai, guardrails, llm, llm-cost, llm-gateway, llm-observability, llmops, load-balancing, mcp-client, mcp-gateway, mcp-server, model-router, token-management
- Language: Go
- Homepage: https://www.getmaxim.ai/bifrost
- Size: 416 MB
- Stars: 2,296
- Watchers: 10
- Forks: 234
- Open Issues: 124
-
Metadata Files:
- Readme: README.md
- Contributing: docs/contributing/adding-a-configstore.mdx
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Support: docs/supportWidget.js
Awesome Lists containing this project
- awesome-go - maximhq/bifrost
- awesome-langchain - Bifrost
- Awesome-LLMOps - bifrost - commit/maximhq/bifrost?color=green) (Inference / LLM Router)
- awesome-mcp-enterprise - Bifrost - High-performance open-source LLM and MCP gateway with sub-100µs overhead. Unified API for 15+ providers with automatic fallbacks and load balancing. 🆓 (Gateways & Proxies)
- awesome-repositories - maximhq/bifrost - Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS. (Go)