https://github.com/radlab-dev-group/llm-router
LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).
https://github.com/radlab-dev-group/llm-router
automation cloud genai llm llm-balancing llm-gateway llm-gateway-system llm-router llm-router-models llm-router-plugins load-balancing local-llm local-llm-integration model-management on-prem pii prometheus rest-api security
Last synced: about 1 month ago
JSON representation
LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).
- Host: GitHub
- URL: https://github.com/radlab-dev-group/llm-router
- Owner: radlab-dev-group
- License: apache-2.0
- Created: 2025-09-21T19:44:40.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2026-01-14T14:34:51.000Z (3 months ago)
- Last Synced: 2026-01-14T16:44:09.162Z (3 months ago)
- Topics: automation, cloud, genai, llm, llm-balancing, llm-gateway, llm-gateway-system, llm-router, llm-router-models, llm-router-plugins, load-balancing, local-llm, local-llm-integration, model-management, on-prem, pii, prometheus, rest-api, security
- Language: Python
- Homepage: https://llm-router.cloud/
- Size: 1.46 MB
- Stars: 4
- Watchers: 0
- Forks: 1
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE