https://github.com/planetf1/oxllm

🦀 Ultra-minimalist, high-resilience LLM routing gateway in Rust. OpenAI-compatible with auto-retry, backoffs, circuit breakers, SIGHUP hot-reloads, and OOM-proof telemetry. Perfect companion for planetf1/otelite.

artificial-intelligence circuit-breaker distributed-tracing edge-computing embedded failover gateway generative-ai high-availability hot-reload lightweight llm openai-compatible opentelemetry openwrt otelite proxy rate-limiting rust zero-disk

Last synced: 26 Jun 2026