https://github.com/vllm-project/semantic-router

Intelligent Mixture-of-Models Router for Efficient LLM Inference
https://github.com/vllm-project/semantic-router

ai-gateway bert-classification envoy-ext-proc envoyproxy fine-tuning golang huggingface-candle huggingface-transformers kubernetes llm-tool-call mixture-of-models pii-detection prompt-engineering prompt-guard python rust semantic-router vllm

Last synced: 3 months ago
JSON representation

Intelligent Mixture-of-Models Router for Efficient LLM Inference

• Host: GitHub
• URL: https://github.com/vllm-project/semantic-router
• Owner: vllm-project
• License: apache-2.0
• Created: 2025-08-26T21:49:50.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2025-10-05T14:21:22.000Z (3 months ago)
• Last Synced: 2025-10-05T14:45:45.632Z (3 months ago)
• Topics: ai-gateway, bert-classification, envoy-ext-proc, envoyproxy, fine-tuning, golang, huggingface-candle, huggingface-transformers, kubernetes, llm-tool-call, mixture-of-models, pii-detection, prompt-engineering, prompt-guard, python, rust, semantic-router, vllm
• Language: Go
• Homepage: https://vllm-semantic-router.com
• Size: 6.42 MB
• Stars: 1,605
• Watchers: 24
• Forks: 179
• Open Issues: 94
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Codeowners: CODEOWNERS

Awesome Lists containing this project

• awesome-repositories - vllm-project/semantic-router - System Level Intelligent Router for Mixture-of-Models (Go)
• awesome-mcp - semantic-router - ⭐ 2,399 (📚 Projects (1974 total) / Tools & Libraries)
• Awesome-LLMOps - vLLM Semantic Router - of-Models Router for Efficient LLM Inference    (Inference / LLM Router)