https://github.com/maximhq/bifrost
Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
https://github.com/maximhq/bifrost
gateway guardrails llm llm-gateway mcp-client mcp-gateway mcp-server
Last synced: 1 day ago
JSON representation
Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
- Host: GitHub
- URL: https://github.com/maximhq/bifrost
- Owner: maximhq
- License: apache-2.0
- Created: 2025-03-19T07:21:26.000Z (10 months ago)
- Default Branch: main
- Last Pushed: 2025-11-20T06:39:46.000Z (about 2 months ago)
- Last Synced: 2025-11-20T08:25:25.706Z (about 2 months ago)
- Topics: gateway, guardrails, llm, llm-gateway, mcp-client, mcp-gateway, mcp-server
- Language: Go
- Homepage: https://www.getmaxim.ai/bifrost
- Size: 293 MB
- Stars: 1,121
- Watchers: 6
- Forks: 115
- Open Issues: 64
-
Metadata Files:
- Readme: README.md
- Contributing: docs/contributing/code-conventions.mdx
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
- awesome-go - maximhq/bifrost
- awesome-langchain - Bifrost
- awesome-mcp - bifrost - ⭐ 1,348 (📚 Projects (1974 total) / MCP Servers)
- Awesome-LLMOps - bifrost - commit/maximhq/bifrost?color=green) (Inference / LLM Router)
- awesome-repositories - maximhq/bifrost - Fastest LLM gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS. (Go)