Open-Source Local LLM Projects

• chatbot-ui
• open-webui - friendly AI Interface (Supports Ollama, OpenAI API, ...) | 44,894 | 5,466 | 139 | 238 | 66 | MIT License | 0 days, 11 hrs, 37 mins |
• LocalAI - hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference | 24,305 | 1,863 | 385 | 109 | 63 | MIT License | 0 days, 17 hrs, 14 mins |
• transformers - of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. | 134,277 | 26,847 | 1,426 | 431 | 169 | Apache License 2.0 | 0 days, 15 hrs, 45 mins |
• ollama
• gpt4all - source and available for commercial use. | 70,365 | 7,683 | 615 | 114 | 28 | MIT License | 0 days, 15 hrs, 20 mins |
• gpt_academic
• llama.cpp
• gpt4free
• text-generation-webui
• vllm - throughput and memory-efficient inference and serving engine for LLMs | 29,451 | 4,415 | 2,218 | 454 | 41 | Apache License 2.0 | 0 days, 8 hrs, 58 mins |
• jan - LLM) | 23,063 | 1,336 | 174 | 55 | 33 | GNU Affero General Public License v3.0 | 0 days, 9 hrs, 14 mins |
• localGPT
• chatbox - friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...) | 21,472 | 2,169 | 375 | 29 | 44 | GNU General Public License v3.0 | 9 days, 2 hrs, 7 mins |
• mlc-llm
• llamafile
• anything-llm - in-one Desktop & Docker AI application with built-in RAG, AI agents, and more. | 25,386 | 2,566 | 185 | 78 | 8 | MIT License | 0 days, 21 hrs, 57 mins |
• ChuanhuChatGPT - based QA, GPT finetuning and query with web search. All with a neat UI. | 15,233 | 2,294 | 122 | 51 | 25 | GNU General Public License v3.0 | 10 days, 7 hrs, 54 mins |
• LibreChat - 4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development. | 18,507 | 3,112 | 176 | 163 | 47 | MIT License | 1 days, 0 hrs, 59 mins |
• web-llm - performance In-browser LLM Inference Engine | 13,504 | 870 | 71 | 42 | 1 | Apache License 2.0 | 10 days, 20 hrs, 22 mins |
• chathub - in-one chatbot client | 10,016 | 1,022 | 281 | 12 | 0 | GNU General Public License v3.0 | 14 days, 8 hrs, 53 mins |
• text-generation-inference
• server - Clause "New" or "Revised" License | 0 days, 14 hrs, 46 mins |
• llama-cpp-python
• chat-ui
• SillyTavern
• openplayground
• big-agi - of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud. | 5,448 | 1,247 | 209 | 43 | 16 | MIT License | 3 days, 11 hrs, 40 mins |
• koboldcpp
• lollms-webui
• llm - line | 4,580 | 253 | 242 | 22 | 29 | Apache License 2.0 | 2 days, 20 hrs, 36 mins |
• exllamav2 - class GPUs | 3,619 | 279 | 90 | 46 | 34 | MIT License | 11 days, 19 hrs, 30 mins |
• inference - source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop. | 5,261 | 424 | 206 | 77 | 87 | Apache License 2.0 | 0 days, 8 hrs, 28 mins |
• lmdeploy
• LLamaSharp
• chatbot-ollama
• LLMFarm
• maid - platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely. | 1,434 | 159 | 17 | 21 | 31 | MIT License | 3 days, 7 hrs, 29 mins |
• oterm - based terminal client for Ollama | 1,037 | 61 | 8 | 12 | 35 | MIT License | 0 days, 17 hrs, 26 mins |
• page-assist
• amica
• catai
• FreeChat
• exui
• LocalAIVoiceChat
• tenere
• mikupad
• emeltal - end models. | 142 | 8 | 1 | 1 | 0 | MIT License | 5 days, 5 hrs, 5 mins |
• lobe-chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application. | 44,029 | 9,845 | 396 | 159 | 1,020 | Other | 0 days, 14 hrs, 22 mins |
• h2ogpt - docs.h2o.ai/ | 11,388 | 1,248 | 281 | 69 | 2 | Apache License 2.0 | 0 days, 10 hrs, 36 mins |
• OpenLLM - source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud. | 9,961 | 635 | 21 | 31 | 131 | Apache License 2.0 | 3 days, 8 hrs, 51 mins |
• TensorRT-LLM - LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines. | 8,543 | 969 | 790 | 16 | 9 | Apache License 2.0 | 2 days, 23 hrs, 33 mins |
• ava - in-one desktop app for running LLMs locally. | 417 | 15 | 3 | 3 | 0 | Other | 6 days, 23 hrs, 57 mins |
• ChatterUI - native. | 500 | 27 | 12 | 1 | 45 | GNU Affero General Public License v3.0 | 1 days, 1 hrs, 47 mins |
• ChatGPT-Next-Web - platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。 | 76,177 | 59,025 | 455 | 228 | 73 | MIT License | 0 days, 8 hrs, 40 mins |
• privateGPT
• cortex.cpp
• web-llm-chat - free, seamless AI conversations. | 305 | 50 | 10 | 181 | 0 | Apache License 2.0 | 27 days, 18 hrs, 53 mins |