Projects in Awesome Lists by InftyAI
A curated list of projects in awesome lists by InftyAI .
https://github.com/inftyai/llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
huggingface inference inference-platform kubernetes llamacpp llm modelscope ollama sglang text-generation-inference vllm
Last synced: 05 Apr 2025
https://github.com/inftyai/manta
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
cache distributed-systems kubernetes llm p2p-network
Last synced: 09 Oct 2025
https://github.com/inftyai/llmlite
🌵 A library helps to communicate with all kinds of LLMs consistently.
Last synced: 12 Apr 2025
https://github.com/inftyai/scheduler-plugins
Scheduler plugins designed for smart scheduling with llmaz.
Last synced: 12 Apr 2025
https://github.com/inftyai/pr-copilot
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑💻🐛
Last synced: 12 Apr 2025
https://github.com/inftyai/omnistore
🎯 An unified python client to communicate with various kinds of object-store providers.
gcs minio object-store oss python s3
Last synced: 12 Apr 2025
https://github.com/inftyai/puma
Aim to be a lightweight, high-performance inference engine for heterogeneous devices. WIP.
Last synced: 09 Mar 2025