https://github.com/defilantech/llmkube

Kubernetes operator for local LLM inference with llama.cpp, vLLM, and TGI - multi-GPU, autoscaling, air-gapped, production-ready

ai ai-infrastructure apple-silicon autoscaling edge-computing gguf gpu homelab inference kubernetes kubernetes-operator llama-cpp llm local-llm metal mlops multi-gpu nvidia self-hosted vllm

Last synced: 13 Jun 2026

https://github.com/defilantech/llmkube-runtimes

LLMKube inference runtime images (AMD/Vulkan first). Build-from-source, hardware-gated CI.

Last synced: 25 Jun 2026

https://github.com/defilantech/issueparser

LLM-powered GitHub issue theme analyzer. Scan repositories for issues and use AI to identify common pain points, recurring themes, and actionable insights.

ai analytics github golang issue-tracking kubernetes llm llmkube

Last synced: 13 Jan 2026

https://github.com/defilantech/llmkube-bootstrap

One-command setup for a fresh Apple Silicon Mac to run local LLM inference on LLMKube.

Last synced: 25 Jun 2026

https://github.com/defilantech/mlx-server

OpenAI-compatible HTTP server for mlx-swift-lm on Apple Silicon. Drop-in replacement for llama-server with state-of-the-art speculative decoding.

Last synced: 25 Jun 2026