https://github.com/radlab-dev-group/llm-router-utils
The repository contains a set of tools that use llm-router as the core foundation.
https://github.com/radlab-dev-group/llm-router-utils
llm-gateway llm-router llm-router-utils llm-utils ml-utils
Last synced: 6 months ago
JSON representation
The repository contains a set of tools that use llm-router as the core foundation.
- Host: GitHub
- URL: https://github.com/radlab-dev-group/llm-router-utils
- Owner: radlab-dev-group
- License: apache-2.0
- Created: 2025-12-13T11:12:32.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-12-27T15:15:16.000Z (6 months ago)
- Last Synced: 2025-12-29T11:03:25.126Z (6 months ago)
- Topics: llm-gateway, llm-router, llm-router-utils, llm-utils, ml-utils
- Language: Python
- Size: 35.2 KB
- Stars: 1
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# llm‑router‑utils
## What is it?
`llm-router-utils` is a collection of ready‑made **tools and examples** built on top of **LLM‑Router** – a flexible
language‑model router. The repository contains:
* **Ready‑to‑run examples** – scripts, configurations, and small applications that you can simply clone and execute.
* **Universal tools** – useful in many areas (data analysis, text processing, content protection, etc.).
* **Minimal setup** – everything you need is in the repository; after cloning, just run a few commands.
---
## Why use it?
* **Fast start** – you don’t have to build infrastructure from scratch; all components are already prepared.
* **Modularity** – you can pick only the parts you need and easily combine them.
* **Extensibility** – thanks to LLM‑Router you can plug in any model (local, cloud‑based, custom service) and take
advantage of built‑in load‑balancing strategies.
---
## What’s in the repository?
| Directory / File | Description |
|---------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------|
| [resources/llm-router-speakleash/](resources/llm-router-speakleash) | Example configuration and launch scripts for Speakleash models (e.g., Bielik‑11B‑v2.3‑Instruct and Bielik‑Guard). |
| `run‑*.sh` | Bash start‑up scripts (VLLM, REST‑API, Guardrail). Just make them executable (`chmod +x`) and run them. |
| `llm_router_utils/` | Python package with helper functions (currently empty, ready for extension). |
| `README.md` (this file) | Guide to the repository. |
| `requirements.txt` (optional) | List of dependencies, if you decide to add your own libraries. |
---
## Installation
```bash
# 1️⃣ Clone the repository
git clone https://github.com/radlab-dev-group/llm-router-utils.git
cd llm-router-utils
# 2️⃣ Install the package (editable mode is handy during development)
pip install -e .
# 3️⃣ Install the full set of dependencies (including llm-router and llm-router‑services)
pip install ."[llm-router]"
# Dependencies that will be pulled automatically:
# - llm-router @ git+https://github.com/radlab-dev-group/llm-router
# - llm-router-services @ git+https://github.com/radlab-dev-group/llm-router-services
```
These dependencies are fetched directly from the specified Git repositories during the `pip install .[llm-router]` step.
---
## Summary
`llm-router-utils` is a **compact toolkit** that lets you test and deploy LLM‑Router‑based solutions within minutes.
Just **clone, set permissions, and run** – and you’ll have a working content‑generation and protection pipeline.
Happy coding! 🚀