An open API service indexing awesome lists of open source software.

https://github.com/slb350/octoroute

Smart HTTP router for local LLMs (Ollama, LM Studio, llama.cpp). Rule-based + LLM-powered routing, health checks, load balancing, Prometheus metrics. Rust-native, zero-overhead.
https://github.com/slb350/octoroute

ai artificial-intelligence homelab llama-cpp llm lm-studio local-llm ollama prometheus rust

Last synced: 3 months ago
JSON representation

Smart HTTP router for local LLMs (Ollama, LM Studio, llama.cpp). Rule-based + LLM-powered routing, health checks, load balancing, Prometheus metrics. Rust-native, zero-overhead.

Awesome Lists containing this project