Projects in Awesome Lists tagged with litellm
A curated list of projects in awesome lists tagged with litellm .
https://github.com/berriai/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
ai-gateway anthropic azure-openai bedrock gateway langchain litellm llm llm-gateway llmops mcp-gateway openai openai-proxy rust rust-ai vertex-ai
Last synced: 30 Aug 2026
https://github.com/strands-agents/harness-sdk
A model-driven approach to building AI agents in just a few lines of code.
agentic agentic-ai agents ai anthropic autonomous-agents bedrock genai litellm llama llm machine-learning mcp multi-agent-systems ollama openai opentelemetry python strands-agents
Last synced: 10 Jun 2026
https://github.com/strands-agents/sdk-python
A model-driven approach to building AI agents in just a few lines of code.
agentic agentic-ai agents ai anthropic autonomous-agents bedrock genai litellm llama llm machine-learning mcp multi-agent-systems ollama openai opentelemetry python strands-agents
Last synced: 04 Mar 2026
https://github.com/morphik-org/morphik-core
The most accurate document search and store for building AI apps
artificial-intelligence cache-augmented-generation colpali database litellm multimodal rag rules-based-ingestion
Last synced: 06 Mar 2026
https://github.com/prometheus-eval/prometheus-eval
Evaluate your LLM's response with Prometheus and GPT4 π―
evaluation gpt4 litellm llm llm-as-a-judge llm-as-evaluator llmops python vllm
Last synced: 06 Apr 2026
https://github.com/LiteLLM-Labs/litellm-agent-control-plane
1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.
agent-builder agent-builder-tools agent-platform agent-vault ai-gateway claude-code codex codex-cli litellm litellm-ai-gateway sandbox
Last synced: 24 Jun 2026
https://github.com/k-dense-ai/k-dense-byok
An AI co-scientist powered by Scientific Agent Skills running on your desktop.
agentic-ai ai-agent ai-assistant bioinformatics byok drug-discovery google-adk litellm local-first mcp ollama openrouter research-assistant scientific-computing
Last synced: 30 Jul 2026
https://github.com/Anil-matcha/open-claude-tag
Self-hostable channel-native AI teammate for Slack. Open source alternative to Claude Tag. LLM-agnostic.
ai-agent ai-memory ai-teammate ambient-agent anthropic autonomous-agent claude claude-sonnet claude-tag litellm llm mcp open-source openai persistent-memory python self-hosted slack slack-ai slack-bot
Last synced: 14 Jul 2026
https://github.com/anil-matcha/open-claude-tag
Self-hostable channel-native AI teammate for Slack. Open source alternative to Claude Tag. LLM-agnostic.
ai-agent ai-teammate ambient-agent anthropic autonomous-agent channel-ai claude-tag gemini litellm llm mcp multi-model open-source openai persistent-memory python self-hosted slack slack-bot sqlite
Last synced: 28 Jun 2026
https://github.com/K-Dense-AI/k-dense-byok
An AI co-scientist powered by Scientific Agent Skills running on your desktop.
agentic-ai ai-agent ai-assistant bioinformatics byok drug-discovery google-adk litellm local-first mcp ollama openrouter research-assistant scientific-computing
Last synced: 07 Jun 2026
https://github.com/gobii-ai/gobii-platform
Your easy to use, always-on AI workforce πΎ
agentic-ai ai anthropic automation deepseek docker easy gemini gemma gpt litellm llm manus-ai manus-alternative openclaw-alternative openclaw-alternative-with-full-settings-ui openrouter oss python
Last synced: 08 May 2026
https://github.com/starbaser/ccproxy
Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours
ai ai-gateway ai-proxy ai-tools anthropic claude claude-ai claude-api claude-code claude-max claudecode gemini gemini-cli litellm llm llm-gateway llm-proxy llmops openai openrouter
Last synced: 09 Jun 2026
https://github.com/barun-saha/slide-deck-ai
Co-create PowerPoint slide decks with AI
anthropic azure-openai bert cli gemini-ai gemini-api gemini-flash generative-ai hackathon large-language-models litellm llama ollama openrouterai pdf powerpoint-presentations pypi sambanova streamlit togetherai
Last synced: 18 Apr 2026
https://github.com/strands-agents/mcp-server
This MCP server provides documentation about Strands Agents to your GenAI tools, so you can use your favorite AI coding assistant to vibe-code Strands Agents.
agentic agentic-ai agents ai anthropic autonomous-agents bedrock genai litellm llama llm machine-learning mcp multi-agent-systems ollama openai opentelemetry python strands-agents
Last synced: 28 Aug 2026
https://github.com/askalf/dario
Your Claude Pro/Max subscription in any tool β Cursor, Cline, Aider, Agent SDK β at subscription pricing, not per-token bills. One local endpoint that replays Claude Code's wire shape so your traffic stays in the subscription pool.
ai anthropic api claude claude-max claude-pro cli developer-tools groq litellm llm llm-router multi-provider oauth ollama openai openai-compat openrouter proxy
Last synced: 16 Jun 2026
https://github.com/strands-agents/docs
Documentation for the Strands Agents SDK. A model-driven approach to building AI agents in just a few lines of code.
agentic agentic-ai agents ai anthropic autonomous-agents bedrock genai litellm llama llm machine-learning mcp multi-agent-systems ollama openai opentelemetry python strands-agents
Last synced: 27 Feb 2026
https://github.com/phil65/agentpool
A unified agent orchestration hub that lets you configure and manage multiple AI agents (native, ACP, AGUI, Claude Code) via YAML, and exposes them through standardized protocols (ACP/OpenCode Server).
acp agent ai litellm llm llm-agent mcp pydantic pydantic-ai yaml
Last synced: 28 Aug 2026
https://github.com/strands-agents/tools
A set of tools that gives agents powerful capabilities.
agentic agentic-ai agents ai anthropic autonomous-agents bedrock genai litellm llama llm machine-learning mcp multi-agent-systems ollama openai opentelemetry python
Last synced: 02 Jan 2026
https://github.com/strands-agents/samples
Agent samples built using the Strands Agents SDK.
agentic agentic-ai agents ai anthropic autonomous-agents bedrock genai litellm llama llm machine-learning mcp multi-agent-systems ollama openai opentelemetry python
Last synced: 18 Jun 2025
https://github.com/wangyuxinwhy/generate
A Python Package to Access World-Class Generative Models
Last synced: 23 Oct 2025
https://github.com/kanchengw/cnllm
δΈζ倧樑ειη¨SDKοΌη³»η»ζ§δΌεζ₯ε£ιι γε’εΌΊεεΊθ§£ζεζΉιε€ηηθ½εοΌζ·±εΊ¦ιι OpenAI ηζε LangChainγLlamaIndexγAutoGen η倧樑εεΊη¨ζ‘ζΆγζ―ζδ½δΈΊAgent Skillι¨η½²ε°εη§AIηΌη¨ε·₯ε ·γ
adapter ai api api-wrapper autogen chinese-llm chinese-llms deepeval doubao glm haystack langchain litellm llamaindex machine-learning mimo-v2 minimax openai package python
Last synced: 12 Jun 2026
https://github.com/fdueblab/micro-agent
A lightweight AI agent framework for vertical domain applications | ι’εεεεΊη¨ηθ½»ιηΊ§ AI Agent ζ‘ζΆ
ai-agent fastapi litellm llm mcp rag react-agent vertical-domain
Last synced: 22 Jul 2026
https://github.com/azrtydxb/Fastllm-proxy
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang β 0.76 Β΅s per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
ai-gateway inference litellm llm llm-gateway load-balancing observability openai-api rbac reverse-proxy rust vllm
Last synced: 14 Sep 2026
https://github.com/fus3n/gem-assist
Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools
ai-personal-assistants gemini-2-0-flash gemini-api litellm ollama
Last synced: 07 Apr 2025
https://github.com/Fus3n/gem-assist
Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools
ai-personal-assistants gemini-2-0-flash gemini-api litellm ollama
Last synced: 01 Apr 2025
https://github.com/ferro-labs/ai-gateway
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
ai-gateway ai-infrastructure gateway guardrails kong litellm llm llm-cost llm-proxy llm-strategy llmops mcp pii-detection prompt-management semantic-cache
Last synced: 24 May 2026
https://github.com/mr-karan/hodor
Agentic code reviewer for GitHub PRs and GitLab MRs. Multi-step reasoning with autonomous tool orchestration β catches bugs requiring analysis across files.
agent ai ci-cd code-quality code-review developer-tools litellm openhands
Last synced: 25 Apr 2026
https://github.com/jake83741/vnc-lm
A Discord bot for large language models. Add Llama-4, Sonnet-3.7 DeepSeek R-1, and other models. Easily change models, edit prompts, and enable web search.
deepseek discord discord-bot gemini language-model litellm llama llm ollama
Last synced: 09 Apr 2025
https://github.com/rvanasa/pandas-gpt
Power up your data science workflow with ChatGPT.
chatgpt claude-ai data-cleaning data-engineering data-science data-visualization gemini generative-ai gpt4 jupyter-notebook litellm low-code matplotlib numpy o1 openai pandas productivity scipy seaborn
Last synced: 09 May 2025
https://github.com/cyclenerd/google-cloud-litellm-proxy
π LiteLLM Proxy for Google Cloud Generative AI
docker gemini gemini-api gemini-pro genai genai-chatbot google-cloud google-cloud-platform litellm llama3 llm lobe-chat meta openai openai-api
Last synced: 17 Nov 2025
https://github.com/alduncanson/handler
A2A protocol client for your terminal
a2a a2a-cli a2a-client a2a-protocol a2a-server adk agent ai ai-agents cli litellm mcp mcp-server ollama pypi python tui uv
Last synced: 27 Aug 2026
https://github.com/barun-saha/kodeagent
The minimal AI agent engine
agent agentic-ai agentic-framework ai ai-agents azure-openai codeagent e2b gemini-api lightweight litellm llm ollama planning python react-agent
Last synced: 26 Apr 2026
https://github.com/alDuncanson/Handler
A2A Protocol client and developer toolkit.
a2a a2a-cli a2a-client a2a-protocol a2a-server adk agent ai ai-agents cli litellm mcp mcp-server ollama pypi python tui uv
Last synced: 31 Mar 2026
https://github.com/ahmet-dedeler/ai-llm-comparison
A website where you can compare every AI Model β¨
ai chatgpt collaborate cursor github learn litellm llm nextjs14 shadcn-ui supabase supabase-functions typescript v0
Last synced: 21 Aug 2025
https://github.com/aws-samples/sample-getting-started-with-strands-agents-course
Learn to build AI agents with Strands framework. Covers LLM integration via Amazon Bedrock/Anthropic, AWS service connections, tool implementation with MCP/A2A protocols, and agent evaluation using LangFuse/RAGAS.
a2a anthropic aws bedrock litellm mcp python strands-agents
Last synced: 18 Jan 2026
https://github.com/vincentkoc/tiny_qa_benchmark_pp
Tiny QA Benchmark++ a micro-benchmark suite (52-item gold + on-demand multilingual synthetic packs), generator CLI, and CI-ready eval harness for ultra-fast LLM smoke-testing & regression-catching.
benchmark dataset evaluation huggingface-datasets litellm llm llm-testing llmops qa-dataset smoke-test synthetic-data tinybenchmarks
Last synced: 12 Jun 2025
https://github.com/aurorallm/aurora
The Fastest enterprise AI gateway β route LLM traffic across OpenAI, Anthropic, Gemini, Groq & 30+ providers via a single API. Self-hosted, no vendor lock-in. ( 55x faster than litellm )
ai ai-agents ai-gateway ai-proxy anthropic api-gateway claude-code gateway litellm litellm-alternative llm llm-gateway model-router open-source openai openai-proxy self-hosted
Last synced: 01 Sep 2026
https://github.com/shekswess/synthgenai
SynthGenAI - Package for Generating Synthetic Datasets using LLMs.
ai bedrock gemini generative-ai huggingface langfuse litellm llm llms machine-learning nlp ollama openai python synthetic-data synthetic-dataset-generation
Last synced: 14 Apr 2025
https://github.com/Netis/heron
Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude, Codex, DeepAgents and more β deployed on the provider side, no SDK changes required.
agentic-ai ai-agent-development ai-observability libpcap litellm llm-monitoring llm-observability llmops observability ollama packet-capture rust sglang vllm
Last synced: 11 Jul 2026
https://github.com/ypollak2/llm-router
Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain keeps costs 70β85% lower.
ai-routing anthropic claude claude-code cost-optimization gemini litellm llm llm-router mcp-server model-router ollama openai
Last synced: 27 May 2026
https://github.com/langchain-ai/langchain-litellm
π¦π LangChain interface to LiteLLM
Last synced: 01 Mar 2026
https://github.com/phil65/llmling-agent
Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Human-in-the-loop integration.
agent ai litellm llm llm-agent pydantic pydantic-ai yaml
Last synced: 16 Dec 2025
https://github.com/andreimerfu/pllm
High-performance LLM Gateway built in Go - OpenAI compatible proxy with multi-provider support, adaptive routing, and enterprise features
ai anthropic api-gateway azure bedrock cloud-native enterprise gateway golang kubernetes litellm litellm-ai-gateway llm load-balancer microservices openai openrouter openrouter-api openrouter-go proxy
Last synced: 22 Jun 2026
https://github.com/mj23978/openserver
Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.
autogen g4f image-generation langchain litellm llamacpp llm llmops openai stable vector-database whisper
Last synced: 13 Oct 2025
https://github.com/g1ibby/llm-deploy
Tool to manage ollama model on vast.ai
litellm llm ollama openai-api vastai
Last synced: 29 Jul 2025
https://github.com/wa91h/local-ai-toolkit
A self-hosted AI toolkit running locally via Docker Compose, bundling an LLM gateway, workflow automation, and a chat UI β all backed by a shared PostgreSQL database.
ai ai-agent docker docker-compose litellm llm llm-gateway llm-proxy local-llm n8n ollama openwebui self-hosted workflow
Last synced: 18 May 2026
https://github.com/versionhq/multi-agent-system
Autonomous agent networks for task automation that requires multi-step reasoning
agentic-ai autonomous-agents composiotool docling graph-theory langchain litellm matplotlib mem0ai multi-agent-systems multi-step-reasoning networkx orchestration-framework pydantic pygraphviz python3 rag self-directed-learning
Last synced: 08 Oct 2025
https://github.com/kaymen99/ai-voice-assistant
AI Voice Assistant: talk to an AI agent that handles event scheduling, managing contacts, accessing your knowledge base and web searching through simple voice commands.
ai-agent ai-speech ai-voice-assistant deepgram gemini-pro-vision gmail google-calendar google-contacts groq litellm llama3 voice-assistant
Last synced: 13 Jul 2025
https://github.com/catuscio/wiki-as-readme
Turn your codebase into a comprehensive Wiki in minutes, delivered in a single Readme. Works with Any Model. Any Repo. Any Environment.
ai-tools documentation documentation-generator documentation-tool fastapi github-actions knowledge-base litellm mermaid readme streamlit wiki
Last synced: 25 Feb 2026
https://github.com/hummat/paperpipe
Extract equations and context from research papers for LLM coding assistants (arXiv, LaTeX, RAG)
ai-coding-assistant arxiv cli developer-tools equation-extraction latex litellm llm paper-management paperqa python rag research-papers scientific-research
Last synced: 21 May 2026
https://github.com/CXwudi/litellm-config-generator
Fill up the `model_list` field in your LiteLLM proxy configuration file
anthropic gemini groq litellm mistral openai openrouter togetherai
Last synced: 06 Mar 2025
https://github.com/aureliolo/synthorg
SynthOrg - Framework for building synthetic organizations with autonomous AI agents
agent-framework ai-agents ai-orchestration autonomous-agents litellm litestar llm mcp multi-agent pydantic python react-dashboard synthetic-organization
Last synced: 10 Aug 2026
https://github.com/aureliusivan/remembear
An app for people with short-term-memory π§
ai alzheimers-disease capacitorjs demensia embeddings fastapi gemini gemini-api litellm mem0ai nextjs python qdrant rag shadcn-ui
Last synced: 16 Mar 2025
https://github.com/mushinbush/discord-bot-hakkallm
Discord chat bot with LLMs API
cohere discord-bot gemini-api litellm
Last synced: 07 May 2025
https://github.com/matthewspangler/agentflipper
An AI agent that controls your Flipper Zero that uses PyFlipper, LightLLM, RAG, and can connect to your local Ollama instance!
agentic-ai ai ai-agents badusb flipper-zero flipperzero gpt hacking litellm ollama pentesting rag retrieval-augmented-generation
Last synced: 18 Jun 2025
https://github.com/cxwudi/litellm-config-generator
Fill up the `model_list` field in your LiteLLM proxy configuration file
anthropic gemini groq litellm mistral openai openrouter togetherai
Last synced: 13 Aug 2025
https://github.com/kaymen99/agentic-ai-projects
Collection of generative AI projects & applications including: multiple LLMs, AI agents, RAG
ai-agent chatbot crewai gemini-pro generative-ai langchain langgraph litellm llama3 ollama openai python rag retrieval-augmented-generation
Last synced: 10 Oct 2025
https://github.com/palenaai/litellm-operator
Kubernetes operator for deploying and managing LiteLLM AI Gateway. Declarative CRDs for models, teams, users, and virtual keys with bidirectional config sync, SSO/SCIM user provisioning, and OLM support. Built with Operator SDK.
ai-gateway cloud-native gitops kubernetes kubernetes-operator litellm llm openai openshift operator
Last synced: 10 Jul 2026
https://github.com/teremterem/litellm-server-boilerplate
A lightweight LiteLLM server boilerplate pre-configured with uv and Docker for hosting your own OpenAI- and Anthropic-compatible endpoints. Includes LibreChat as an optional web UI.
agentic-ai ai ai-assistant ai-chatbot anthropic boilerplate chatgpt gemini genai generative-ai librechat litellm litellm-proxy llm llm-server llm-serving openai python setup webchat
Last synced: 16 Feb 2026
https://github.com/sunwood-ai-labs/cloudflare-os-home
Unofficial self-hosted Cloudflare OS Home with a project-local LiteLLM gateway, Docker Compose, Tailscale, and agent-first QA.
ai-agents cloudflare-os docker-compose litellm openai-compatible self-hosted tailscale
Last synced: 15 Aug 2026
https://github.com/frangelbarrera/agentic-harness
Production-grade Agentic Harness for autonomous AI agents. Features MCP server integration, cost-controlled DAG workflows, and actor-critic loops. Optimized for Claude Code, GPT-4o, and local LLMs. The infrastructure for reliable Agentic AI.
actor-critic agent-harness ai-agents anti-hallucination claude-desktop litellm llm mcp multi-agent ollama vendor-neutral
Last synced: 16 Aug 2026
https://github.com/cheesejaguar/sopher.ai
π AI book-writing platform that transforms author briefs into complete manuscripts using multi-agent CrewAI system. Built with FastAPI backend, Next.js frontend, real-time SSE streaming, PostgreSQL/Redis storage, and comprehensive cost tracking. Production-ready with Kubernetes deployment. β¨π€
agentic-ai crewai docker fastapi generative-ai langchain litellm llm nextjs14 tailwindcss
Last synced: 04 Apr 2026
https://github.com/kaymen99/ai-sales-agent
Automate customer engagement and sales processes with an AI sales agent that can recommend products, book consultation and process stripe payment.
ai-agents calendly groq instructor langfuse litellm llama3 rag sales-agent sales-automation stripe website-chatbot
Last synced: 25 Oct 2025
https://github.com/crp4222/privaite
Privacy-first LLM proxy : automatically anonymizes PII before sending to any LLM provider, then de-anonymizes responses. Drop-in OpenAI-compatible API. Works with OpenWebUI, Ollama, OpenAI, Anthropic.
anonymization gdpr litellm llm openai pii privacy proxy
Last synced: 22 Jul 2026
https://github.com/the-swarm-corporation/swarms-api
An all-encompassing API for all swarm architectures
agents langchain litellm multi-agents swarms transformers
Last synced: 27 Jul 2025
https://github.com/blacksuan19/structx
Type-safe structured data extraction from text using LLMs.
Last synced: 10 Aug 2025
https://github.com/ladbaby/tresor
β‘Switch LLM Providers for Any Apps with One Click: A Single-Binary LLM Gateway with Auto API Translations.
agent ai-gateway anthropic cc-switch claude-code codex deepseek gateway gemini-cli litellm llm llm-gateway openai opencode
Last synced: 28 Jun 2026
https://github.com/gethnet/litellm-connector-copilot
Adds LiteLLM as a provider within Copilot in VSCode, expanding the models you can access significantly. Available on Visual Studio Code Marketplace: https://marketplace.visualstudio.com/items?itemName=Gethnet.litellm-connector-copilot
ai copilot integration language-provider litellm litellm-proxy vscode-extension
Last synced: 24 Apr 2026
https://github.com/piotrmaciejbednarski/structllm
Universal Python library for Structured Outputs with any LLM provider
ai anthropic json-schema litellm llm openai pydantic structured-output structured-outputs
Last synced: 31 Jul 2025
https://github.com/rishi-raj-jain/remix-wysiwyg-litellm-xata-vercel
A demo of your own Content CMS with Xata, Remix, WYSIWYG Editor, LiteLLM, OpenAI and Vercel.
litellm notion novel openai remix tailwindcss vercel xata
Last synced: 08 May 2025
https://github.com/zayedrais/ai_agent_with_mcp
MCP server built with Googleβs Agent Development(ADK) Kit featuring multiple specialised agents that collaborate through intelligent routing. The system provides RESTful API endpoints for various capabilities including web searches, data analysis, and code generation while maintaining extensibility through a modular architecture
agent agentic-ai agents ai ai-agents ai-tools airtificialintelligence fastmcp google-adk groq-api litellm llm llmagents mcp mcp-client mcp-server model-context-protocol openrouter-api python tools
Last synced: 29 Aug 2025
https://github.com/markolofsen/litellm2
A powerful AI framework with structured Pydantic responses, flexible LLM integration, and advanced agent capabilities
Last synced: 04 Oct 2025
https://github.com/rishi-raj-jain/xata-rag-chatbot
A demo of your own RAG Chatbot with Xata, SvelteKit, LiteLLM, OpenAI and Vercel.
ai embeddings litellm openai sveltekit tailwindcss vector vercel xata
Last synced: 29 Aug 2025
https://github.com/digihunch/chat-service
Sample LLM-based chatbot service with local and remote models
chatbot chatgpt chatgpt-api docker docker-compose gpt-35-turbo litellm llama3 llama31 llm nginx ollama openai openai-api openwebui postgresql
Last synced: 18 Jan 2026
https://github.com/sushant1827/google_adk
This repository contains examples for learning Google's Agent Development Kit (ADK), a powerful framework for building LLM-powered agents.
agentic-workflow google-adk litellm multi-agent-system persistent-storage pydantic session-storage structured-output
Last synced: 06 Mar 2026
https://github.com/therealfredp3d/ctf-tui
The CTF Toolkit provides an integrated environment combining terminal operations, note-taking, AI assistance, and tool management in a single, efficient interface. Built with Python's Textual framework, it aims to enhance CTF player productivity. Working Prototype!
ctf litellm llm markdown ollama personal-project python terminal
Last synced: 18 Feb 2026
https://github.com/ai-2070/l0-python
L0: The Missing Reliability Substrate for AI. Streaming-first. Reliable. Replayable. Deterministic. Multimodal. Retries. Continuation. Fallbacks (provider & model). Consensus. Parallelization. Guardrails. Atomic event logs. Byte-for-byte replays.
ai ai-agents ai-guardrails ai-infrastructure ai-runtime ai-streaming fallback fallbacks fault-tolerance litellm llm llm-runtime multimodal openai-api python replays retry-logic sentry streaming
Last synced: 13 Jan 2026
https://github.com/tsmdt/dygest
Generate content insights for your documents with LLMs and NER
groq litellm llms ner ollama openai text-analysis text-processing text-summarizer
Last synced: 23 Sep 2025
https://github.com/jaju/voissistant
Voiss Aceistant - Apple only, with mlx.
apple asr litellm mlx ollama qwen transcription
Last synced: 10 Feb 2026
https://github.com/anthonyfoust/ai-stack-homelab
Complete AI automation stack optimized for Mac Mini M4, but can work in multiple machine configurations. Features n8n workflows, Ollama with Llama 3.2, Open WebUI, LiteLLM proxy, and MCP integration. Production-ready with automated backups, security, and family-safe configuration for you to learn more about AI at home.
ai automation docker docker-compose family-safe litellm llama local-ai m4 mac-mini mcp n8n ollama personal-ai webui
Last synced: 09 Apr 2026
https://github.com/electrocucaracha/yt-summarizer
Application that generates intelligent YouTube video summaries
litellm notion-api youtube-api
Last synced: 10 Mar 2026
https://github.com/likhithsai2580/agent_unknown
Automating Everything
ai automation docker litellm open-interpreter os python
Last synced: 03 Feb 2026
https://github.com/wronai/code2logic
Code2Logic analyzes codebases and generates compact, LLM-friendly representations with semantic understanding. Perfect for feeding project context to AI assistants, building code documentation, or analyzing code structure.
code2logic compactness framework library litellm llm ollama python refactoring
Last synced: 14 Jan 2026
https://github.com/sap-contributions/litellm-agentic-examples
Agentic Framework examples for SAP Gen AI Hub via LiteLLM
agentic-ai litellm sap-generative-ai-hub
Last synced: 16 Jan 2026
https://github.com/quantumpipes/capsule-litellm
Capsule Protocol integration for LiteLLM. Automatic cryptographic audit trail for every LLM call.
ai ai-safety anthropic audit-trail capsule cryptography hash-chain litellm llm middleware openai python tamper-evident
Last synced: 05 Aug 2026
https://github.com/dinhanhx/litellm-infinity-vllm-serving-local-models
docker compose to serve some local language models
cohere docker docker-compose infinity jinaai litellm openai vllm
Last synced: 11 Apr 2026
https://github.com/shantanu-deshmukh/chunktuner
Benchmark chunking strategies for your RAG corpus. Get a recommended config. CLI, Python library, and MCP server.
chunking embedding evaluation langchain litellm llamaindex llm mcp optimization rag ragas retrieval text-splitting vector-database
Last synced: 03 Jul 2026
https://github.com/nbsp1221/ai-agents
π€ A comprehensive framework for building and deploying AI agents
ai-agents litellm n8n ollama open-webui
Last synced: 10 Jul 2025
https://github.com/rishang/deep-research
Python SDK for Deep-Research
ai deep-research deepresearch docling litellm
Last synced: 12 Jun 2025
https://github.com/nbsp1221/agentforge
π€ A comprehensive framework for building and deploying AI agents
ai-agents litellm n8n ollama open-webui
Last synced: 16 May 2026
https://github.com/bluet/arguslm
The hundred-eyed watcher for your LLM providers. Monitor uptime, TTFT, TPS, and latency across OpenAI, Anthropic, Azure, Bedrock, Ollama, LM Studio, and 100+ providers through a single dashboard. Benchmark, compare, and get alerts β all self-hosted.
ai-ops anthropic dashboard fastapi litellm llm llm-benchmark llm-monitoring llm-ops lm-studio mlops monitoring observability ollama openai performance-monitoring python react self-hosted typescript
Last synced: 11 Mar 2026
https://github.com/patchedreality/ai-cli-switchboard
A simple framework for using Claude Code or Codex CLI as the frontend to any cloud or local LLM on Apple Silicon. Connect locally via LiteLLM + MLX or LM Studio, or remotely via Z.AI, Gemini/Google AI Studio, DeepSeek, or OpenRouter.
anthropic applesilicon claude-code deepseek deepseek-r1 gemini googleaistudio litellm llm llm-tools lmstudio local-models mlx
Last synced: 18 May 2026