Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/nomic-ai/gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://github.com/nomic-ai/gpt4all
ai-chat llm-inference
Last synced: 4 days ago
JSON representation
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- Host: GitHub
- URL: https://github.com/nomic-ai/gpt4all
- Owner: nomic-ai
- License: mit
- Created: 2023-03-27T18:49:32.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-11-27T15:44:25.000Z (16 days ago)
- Last Synced: 2024-11-30T00:33:40.998Z (13 days ago)
- Topics: ai-chat, llm-inference
- Language: C++
- Homepage: https://nomic.ai/gpt4all
- Size: 44.4 MB
- Stars: 70,917
- Watchers: 647
- Forks: 7,716
- Open Issues: 645
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.txt
- Roadmap: roadmap.md
Awesome Lists containing this project
- awesome_open_llms - gpt4all
- awesome-local-llms - gpt4all - source and available for commercial use. | 70,365 | 7,683 | 615 | 114 | 28 | MIT License | 0 days, 15 hrs, 20 mins | (Open-Source Local LLM Projects)
- awesome-instruction-dataset - (nomic-ai/gpt4all)|437k|EN|MT|COL
- my-awesome - nomic-ai/gpt4all - chat,llm-inference pushed_at:2024-12 star:71.1k fork:7.7k GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-generative-ai - gpt4all - A chatbot trained on a massive collection of clean assistant data including code, stories and dialogue. (Coding / Developer tools)
- Awesome-Reasoning-Foundation-Models - [Code
- awesome - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-instruction-datasets - GPT4all - ai/gpt4all-j-prompt-generations](https://huggingface.co/datasets/nomic-ai/gpt4all-j-prompt-generations) | nomic-ai | 806199 | EN | MT | COL | code, storys and dialogs | distillation from GPT-3.5-turbo | [download](https://huggingface.co/datasets/QingyiSi/Alpaca-CoT/tree/main/GPT4all) | (Statistics)
- awesome-chatgpt-summary - gpt4all
- awesome - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-local-ai - gpt4all - A chatbot trained on a massive collection of clean assistant data including code, stories and dialogue. (Developer tools)
- awesome-foundation-models - [code
- awesome-projects - gpt4all - to-use LLM chatbots for everyone (search engine)
- awesome-colab-project - GPT4All
- Awesome-LLM - https://github.com/nomic-ai/gpt4all
- awesome-totally-open-chatgpt - nomic-ai/gpt4all - style large language model with ~800k GPT-3.5-Turbo Generations based on LLaMA. ([tatsu-lab/stanford_alpaca](https://github.com/tatsu-lab/stanford_alpaca) / Other LLaMA-derived projects:)
- awesome-genai - GPT4ALL
- awesome-open-gpt - gpt4all
- project-awesome - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- fucking-Awesome-Linux-Software - ![Open-Source Software - gpt4all: an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue (Applications / Utilities)
- Awesome_Multimodel_LLM - GPT4All - Demo, data, and code to train open-source assistant-style large language model based on GPT-J and LLaMa. (Open Source LLM)
- my-awesome-starred - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-rainmana - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-ChatGPT-repositories - gpt4all - gpt4all: a chatbot trained on a massive collection of clean assistant data including code, stories and dialogue (Chatbots)
- awesome-repositories - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-chatgpt-dataset - GPT4All Dataset - lingual | Subset of LAION OIG, StackOverflow Question, BigSciense/p3 dataset. Answered by OpenAI API. | - | (Dataset Detail)
- awesome-llm-eval - GPT4All - Demo, data, and code to train open-source assistant-style large language model based on GPT-J and LLaMa. (LLM-List / Open-LLM)
- stars - nomic-ai/gpt4all - gpt4all: run open-source LLMs anywhere (C++)
- awesome-ai-tools - gpt4all - A chatbot trained on a massive collection of clean assistant data including code, stories, and dialogue. (Text / Developer tools)
- ai-game-devtools - GPT4All
- Awesome-Linux-Software - ![Open-Source Software - gpt4all: an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue (Applications / Utilities)
- StarryDivineSky - nomic-ai/gpt4all
- awesome-generative-ai - gpt4all - A chatbot trained on a massive collection of clean assistant data including code, stories and dialogue. (Coding / Developer tools)
- awesome-ai - gpt4all - A chatbot trained on a massive collection of clean assistant data including code, stories and dialogue. (Coding / Developer tools)
- awesome-hacking-lists - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-gpt - gpt4all
- Awesome-ChatGPT - gpt4all
- awesome-starz - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-llm-and-aigc - GPT4All - ai/gpt4all?style=social"/> : GPT4All: An ecosystem of open-source on-edge large language models. GTP4All is an ecosystem to train and deploy powerful and customized large language models that run locally on consumer grade CPUs. (Summary)
- awesome-llm-and-aigc - GPT4All - ai/gpt4all?style=social"/> : GPT4All: An ecosystem of open-source on-edge large language models. GTP4All is an ecosystem to train and deploy powerful and customized large language models that run locally on consumer grade CPUs. (Summary)
- AiTreasureBox - nomic-ai/gpt4all - 12-07_71032_4](https://img.shields.io/github/stars/nomic-ai/gpt4all.svg) |gpt4all: an ecosystem of open-source chatbots trained on a massive collection of clean assistant data including code, stories and dialogue| (Repos)
- awesome-open-chatgpt - nomic-ai/gpt4all - style large language model with ~800k GPT-3.5-Turbo Generations based on LLaMA. ([TavernAI/TavernAI](https://github.com/TavernAI/TavernAI) / 数据)
- awesome-llm-zh - gpt4all
- Self-Hosting-Guide - GPT4All - source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue based on [LLaMa](https://github.com/facebookresearch/llama). (Tools for Self-Hosting / Running Locally on Windows, MacOS, and Linux:)
- jimsghstars - nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. (C++)
- awesome-ai-tool - gpt4all - 一个训练了代码、故事和对话数据的大型聊天机器人。 (🌟 编辑推荐 / 开发者工具)
- awesome-ai-tool - gpt4all - 一个训练了代码、故事和对话数据的大型聊天机器人。 (🌟 编辑推荐 / 开发者工具)
README
GPT4All
Website • Documentation • Discord • YouTube Tutorial
GPT4All runs large language models (LLMs) privately on everyday desktops & laptops.
No API calls or GPUs required - you can just download the application and get started.
Read about what's new in our blog.
https://github.com/nomic-ai/gpt4all/assets/70534565/513a0f15-4964-4109-89e4-4f9a9011f311
GPT4All is made possible by our compute partner Paperspace.
## Download Links
—
macOS Installer
—
—
Ubuntu Installer
—
Windows and Linux require Intel Core i3 2nd Gen / AMD Bulldozer, or better. x86-64 only, no ARM.
macOS requires Monterey 12.6 or newer. Best results with Apple Silicon M-series processors.See the full [System Requirements](gpt4all-chat/system_requirements.md) for more details.
Flathub (community maintained)
## Install GPT4All Python
`gpt4all` gives you access to LLMs with our Python client around [`llama.cpp`](https://github.com/ggerganov/llama.cpp) implementations.
Nomic contributes to open source software like [`llama.cpp`](https://github.com/ggerganov/llama.cpp) to make LLMs accessible and efficient **for all**.
```bash
pip install gpt4all
``````python
from gpt4all import GPT4All
model = GPT4All("Meta-Llama-3-8B-Instruct.Q4_0.gguf") # downloads / loads a 4.66GB LLM
with model.chat_session():
print(model.generate("How can I run LLMs efficiently on my laptop?", max_tokens=1024))
```## Integrations
:parrot::link: [Langchain](https://python.langchain.com/v0.2/docs/integrations/providers/gpt4all/)
:card_file_box: [Weaviate Vector Database](https://github.com/weaviate/weaviate) - [module docs](https://weaviate.io/developers/weaviate/modules/retriever-vectorizer-modules/text2vec-gpt4all)
:telescope: [OpenLIT (OTel-native Monitoring)](https://github.com/openlit/openlit) - [Docs](https://docs.openlit.io/latest/integrations/gpt4all)## Release History
- **July 2nd, 2024**: V3.0.0 Release
- Fresh redesign of the chat application UI
- Improved user workflow for LocalDocs
- Expanded access to more model architectures
- **October 19th, 2023**: GGUF Support Launches with Support for:
- Mistral 7b base model, an updated model gallery on our website, several new local code models including Rift Coder v1.5
- [Nomic Vulkan](https://blog.nomic.ai/posts/gpt4all-gpu-inference-with-vulkan) support for Q4\_0 and Q4\_1 quantizations in GGUF.
- Offline build support for running old versions of the GPT4All Local LLM Chat Client.
- **September 18th, 2023**: [Nomic Vulkan](https://blog.nomic.ai/posts/gpt4all-gpu-inference-with-vulkan) launches supporting local LLM inference on NVIDIA and AMD GPUs.
- **July 2023**: Stable support for LocalDocs, a feature that allows you to privately and locally chat with your data.
- **June 28th, 2023**: [Docker-based API server] launches allowing inference of local LLMs from an OpenAI-compatible HTTP endpoint.[Docker-based API server]: https://github.com/nomic-ai/gpt4all/tree/cef74c2be20f5b697055d5b8b506861c7b997fab/gpt4all-api
## Contributing
GPT4All welcomes contributions, involvement, and discussion from the open source community!
Please see CONTRIBUTING.md and follow the issues, bug reports, and PR markdown templates.Check project discord, with project owners, or through existing issues/PRs to avoid duplicate work.
Please make sure to tag all of the above with relevant project identifiers or your contribution could potentially get lost.
Example tags: `backend`, `bindings`, `python-bindings`, `documentation`, etc.## Citation
If you utilize this repository, models or data in a downstream project, please consider citing it with:
```
@misc{gpt4all,
author = {Yuvanesh Anand and Zach Nussbaum and Brandon Duderstadt and Benjamin Schmidt and Andriy Mulyar},
title = {GPT4All: Training an Assistant-style Chatbot with Large Scale Data Distillation from GPT-3.5-Turbo},
year = {2023},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/nomic-ai/gpt4all}},
}
```