Open-Source Local LLM Projects

• chatbot-ui
• open-webui - friendly AI Interface (Supports Ollama, OpenAI API, ...) | 42,874 | 5,161 | 136 | 221 | 63 | MIT License | 0 days, 2 hrs, 33 mins |
• LocalAI - hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference | 23,933 | 1,837 | 370 | 109 | 62 | MIT License | 0 days, 7 hrs, 5 mins |
• transformers - of-the-art Machine Learning for Pytorch, TensorFlow, and JAX. | 133,422 | 26,644 | 1,419 | 432 | 167 | Apache License 2.0 | 0 days, 1 hrs, 5 mins |
• ollama
• gpt4all - source and available for commercial use. | 70,014 | 7,654 | 603 | 113 | 27 | MIT License | 1 days, 1 hrs, 25 mins |
• gpt_academic
• llama.cpp
• gpt4free
• text-generation-webui
• vllm - throughput and memory-efficient inference and serving engine for LLMs | 28,414 | 4,214 | 2,165 | 453 | 40 | Apache License 2.0 | 0 days, 8 hrs, 27 mins |
• jan - LLM) | 22,687 | 1,309 | 154 | 54 | 30 | GNU Affero General Public License v3.0 | 0 days, 3 hrs, 2 mins |
• localGPT
• chatbox - friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...) | 21,235 | 2,143 | 394 | 29 | 43 | GNU General Public License v3.0 | 8 days, 1 hrs, 11 mins |
• mlc-llm
• llamafile
• anything-llm - in-one Desktop & Docker AI application with built-in RAG, AI agents, and more. | 24,558 | 2,468 | 194 | 77 | 7 | MIT License | 0 days, 13 hrs, 34 mins |
• ChuanhuChatGPT - based QA, GPT finetuning and query with web search. All with a neat UI. | 15,191 | 2,293 | 121 | 51 | 25 | GNU General Public License v3.0 | 20 days, 0 hrs, 38 mins |
• LibreChat - 4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development. | 18,165 | 3,035 | 189 | 158 | 46 | MIT License | 0 days, 17 hrs, 26 mins |
• web-llm - performance In-browser LLM Inference Engine | 13,294 | 850 | 71 | 40 | 1 | Apache License 2.0 | 8 days, 1 hrs, 48 mins |
• chathub - in-one chatbot client | 9,708 | 968 | 311 | 12 | 0 | GNU General Public License v3.0 | 11 days, 2 hrs, 14 mins |
• text-generation-inference
• server - Clause "New" or "Revised" License | 0 days, 8 hrs, 46 mins |
• llama-cpp-python
• chat-ui
• SillyTavern
• openplayground
• big-agi - of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud. | 5,373 | 1,222 | 203 | 43 | 16 | MIT License | 0 days, 4 hrs, 23 mins |
• koboldcpp
• lollms-webui
• llm - line | 4,416 | 241 | 231 | 21 | 27 | Apache License 2.0 | 32 days, 15 hrs, 25 mins |
• exllamav2 - class GPUs | 3,570 | 277 | 87 | 46 | 34 | MIT License | 13 days, 16 hrs, 45 mins |
• inference - source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop. | 5,071 | 407 | 205 | 75 | 85 | Apache License 2.0 | 3 days, 4 hrs, 10 mins |
• lmdeploy
• LLamaSharp
• chatbot-ollama
• LLMFarm
• maid - platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely. | 1,380 | 146 | 15 | 20 | 31 | MIT License | 3 days, 9 hrs, 5 mins |
• oterm - based terminal client for Ollama | 1,023 | 60 | 7 | 12 | 35 | MIT License | 3 days, 5 hrs, 23 mins |
• page-assist
• amica
• catai
• FreeChat
• exui
• LocalAIVoiceChat
• tenere
• mikupad
• emeltal - end models. | 142 | 8 | 1 | 1 | 0 | MIT License | 2 days, 2 hrs, 44 mins |
• lobe-chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application. | 42,683 | 9,631 | 398 | 153 | 972 | Other | 0 days, 10 hrs, 38 mins |
• h2ogpt - docs.h2o.ai/ | 11,321 | 1,240 | 283 | 68 | 2 | Apache License 2.0 | 0 days, 5 hrs, 3 mins |
• OpenLLM - source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud. | 9,879 | 628 | 22 | 31 | 128 | Apache License 2.0 | 0 days, 22 hrs, 19 mins |
• TensorRT-LLM - LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines. | 8,415 | 949 | 769 | 15 | 9 | Apache License 2.0 | 0 days, 7 hrs, 19 mins |
• ava - in-one desktop app for running LLMs locally. | 410 | 15 | 3 | 3 | 0 | Other | 2 days, 16 hrs, 32 mins |
• web-llm-chat - free, seamless AI conversations. | 286 | 47 | 10 | 181 | 0 | Apache License 2.0 | 10 days, 18 hrs, 44 mins |
• ChatterUI - native. | 422 | 25 | 10 | 1 | 44 | GNU Affero General Public License v3.0 | 0 days, 3 hrs, 13 mins |
• ChatGPT-Next-Web - platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。 | 75,708 | 58,871 | 441 | 225 | 72 | MIT License | 0 days, 5 hrs, 18 mins |