Open-Source Local LLM Projects

• chatbot-ui
• open-webui - friendly AI Interface (Supports Ollama, OpenAI API, ...) | 60,041 | 7,315 | 170 | 311 | 83 | BSD 3-Clause "New" or "Revised" License | 2 days, 15 hrs, 49 mins |
• transformers - of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. | 138,058 | 27,674 | 1,538 | 436 | 175 | Apache License 2.0 | 0 days, 9 hrs, 5 mins |
• ollama
• gpt4all - source and available for commercial use. | 71,930 | 7,813 | 704 | 114 | 35 | MIT License | 2 days, 13 hrs, 15 mins |
• gpt_academic
• llama.cpp
• gpt4free
• text-generation-webui
• localGPT
• mlc-llm
• llamafile
• chathub - in-one chatbot client | 10,016 | 1,022 | 281 | 12 | 0 | GNU General Public License v3.0 | 14 days, 8 hrs, 53 mins |
• text-generation-inference
• server - Clause "New" or "Revised" License | 0 days, 8 hrs, 13 mins |
• llama-cpp-python
• chat-ui
• SillyTavern
• openplayground
• koboldcpp
• lollms-webui
• inference - source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop. | 6,054 | 498 | 185 | 89 | 95 | Apache License 2.0 | 1 days, 3 hrs, 13 mins |
• lmdeploy
• LLamaSharp
• chatbot-ollama
• LLMFarm
• maid - platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely. | 1,434 | 159 | 17 | 21 | 31 | MIT License | 3 days, 7 hrs, 29 mins |
• page-assist
• amica
• catai
• FreeChat
• exui
• LocalAIVoiceChat
• tenere
• mikupad
• emeltal - end models. | 156 | 11 | 1 | 1 | 0 | MIT License | 19 days, 10 hrs, 16 mins |
• lobe-chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Qwen / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS/Plugins/Artifacts). One-click FREE deployment of your private ChatGPT/ Claude application. | 52,225 | 11,307 | 549 | 181 | 1,227 | Other | 0 days, 8 hrs, 3 mins |
• h2ogpt - docs.h2o.ai/ | 11,606 | 1,273 | 304 | 69 | 2 | Apache License 2.0 | 10 days, 23 hrs, 53 mins |
• OpenLLM - source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud. | 10,436 | 661 | 17 | 31 | 134 | Apache License 2.0 | 6 days, 9 hrs, 56 mins |
• TensorRT-LLM - LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines. | 9,230 | 1,081 | 441 | 20 | 12 | Apache License 2.0 | 2 days, 12 hrs, 16 mins |
• ava - in-one desktop app for running LLMs locally. | 417 | 15 | 3 | 3 | 0 | Other | 6 days, 23 hrs, 57 mins |
• ChatterUI - native. | 813 | 47 | 17 | 4 | 54 | GNU Affero General Public License v3.0 | 3 days, 18 hrs, 25 mins |
• FlexGen - oriented scenarios. | 9,180 | 548 | 57 | 19 | 0 | Apache License 2.0 | 4 days, 11 hrs, 51 mins |
• ChatGPT-Next-Web
• privateGPT
• cortex.cpp
• web-llm-chat - free, seamless AI conversations. | 582 | 81 | 13 | 181 | 0 | Apache License 2.0 | 5 days, 13 hrs, 22 mins |
• vllm - throughput and memory-efficient inference and serving engine for LLMs | 34,871 | 5,322 | 1,642 | 458 | 46 | Apache License 2.0 | 0 days, 8 hrs, 28 mins |
• anything-llm - in-one Desktop & Docker AI application with built-in RAG, AI agents, and more. | 30,978 | 3,109 | 217 | 91 | 9 | MIT License | 2 days, 7 hrs, 38 mins |
• LocalAI - hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference | 29,764 | 2,240 | 410 | 120 | 68 | MIT License | 0 days, 10 hrs, 46 mins |
• jan
• chatbox - friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...) | 25,590 | 2,518 | 398 | 34 | 47 | GNU General Public License v3.0 | 3 days, 6 hrs, 25 mins |
• LibreChat - 4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active project. | 20,876 | 3,523 | 219 | 176 | 49 | MIT License | 0 days, 8 hrs, 30 mins |
• exo
• ChuanhuChatGPT - based QA, GPT finetuning and query with web search. All with a neat UI. | 15,351 | 2,292 | 126 | 51 | 26 | GNU General Public License v3.0 | 45 days, 17 hrs, 32 mins |
• web-llm - performance In-browser LLM Inference Engine | 14,397 | 930 | 84 | 45 | 1 | Apache License 2.0 | 6 days, 0 hrs, 15 mins |
• big-agi - of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud. | 5,891 | 1,362 | 218 | 46 | 16 | MIT License | 1 days, 14 hrs, 18 mins |
• llm - line | 5,710 | 324 | 280 | 34 | 39 | Apache License 2.0 | 2 days, 13 hrs, 38 mins |
• exllamav2 - class GPUs | 3,877 | 293 | 108 | 51 | 38 | MIT License | 17 days, 21 hrs, 55 mins |
• pocketpal-ai
• oterm - based terminal client for Ollama | 1,220 | 74 | 7 | 15 | 44 | MIT License | 5 days, 14 hrs, 6 mins |
• chat-ui