https://github.com/maximhq/bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
https://github.com/maximhq/bifrost

ai-gateway gateway gateway-services generative-ai guardrails llm llm-cost llm-gateway llm-observability llmops load-balancing mcp-client mcp-gateway mcp-server model-router token-management

Last synced: 1 day ago
JSON representation

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

• Host: GitHub
• URL: https://github.com/maximhq/bifrost
• Owner: maximhq
• License: apache-2.0
• Created: 2025-03-19T07:21:26.000Z (about 1 year ago)
• Default Branch: dev
• Last Pushed: 2026-06-07T12:42:05.000Z (7 days ago)
• Last Synced: 2026-06-07T13:22:25.622Z (7 days ago)
• Topics: ai-gateway, gateway, gateway-services, generative-ai, guardrails, llm, llm-cost, llm-gateway, llm-observability, llmops, load-balancing, mcp-client, mcp-gateway, mcp-server, model-router, token-management
• Language: Go
• Homepage: https://www.getmaxim.ai/bifrost
• Size: 685 MB
• Stars: 5,551
• Watchers: 23
• Forks: 707
• Open Issues: 476
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/contributing/adding-a-configstore.mdx
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Codeowners: .github/CODEOWNERS
  • Security: SECURITY.md
  • Support: docs/supportWidget.js
  • Agents: AGENTS.md

Awesome Lists containing this project

• awesome-ai-agents-2026 - Bifrost (Maxim AI) - 🆕 オープンソースのエンタープライズ AI ゲートウェイ（Apache-2.0）—— 1000+ モデル、適応的ロードバランサ、クラスタモード、ガードレール、PKCE 付き OAuth 2.0、ゲートウェイ層でのプロンプトインジェクション防御；5k RPS で <100µs オーバーヘッド。 (🔌 ツールと API 連携 / その他の標準)
• awesome-go - maximhq/bifrost
• awesome-llm-cost - Bifrost - Rust based router with microsecond scale overhead at high RPS, plus built in budget controls and intelligent routing. (Routing and Model Selection / Gateways and proxies)
• Awesome-LLMOps - bifrost - commit/maximhq/bifrost?color=green) (Inference / LLM Router)
• awesome-mcp-security - bifrost - githubcom-maximhq-bifrost) | (カテゴリ / 🔌 <a name="api-development"></a>API開発)
• awesome-mcp-lists - GitHub
• awesome-mcp-enterprise - Bifrost - High-performance open-source LLM and MCP gateway with sub-100µs overhead. Unified API for 15+ providers with automatic fallbacks and load balancing. 🆓 (Gateways & Proxies)
• awesome-llm-services - Bifrost
• awesome-langchain - Bifrost
• awesome-llm-gateways - maximhq/bifrost - 2.0 | Teams optimizing for low-overhead model routing and gateway performance. | Go implementation, model routing, load balancing, guardrails, observability and cost-oriented features. | Younger than established API gateways; benchmark and feature claims should be verified in your workload. | (Quick Comparison)