Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.
Awesome Lists | Featured Topics | Projects
https://github.com/WaterPistolAI/Awesome-Local-LLM

A curated list of resources, libraries, tools, and communities for working with Local Large Language Models (LLMs).
https://github.com/WaterPistolAI/Awesome-Local-LLM
List: Awesome-Local-LLM
ai coding llm llms local
Last synced: 3 days ago
JSON representation
A curated list of resources, libraries, tools, and communities for working with Local Large Language Models (LLMs).
Host: GitHub
URL: https://github.com/WaterPistolAI/Awesome-Local-LLM
Owner: WaterPistolAI
Created: 2024-12-20T13:04:46.000Z (19 days ago)
Default Branch: master
Last Pushed: 2024-12-20T13:04:48.000Z (19 days ago)
Last Synced: 2024-12-21T06:50:24.238Z (18 days ago)
Topics: ai, coding, llm, llms, local
Homepage: https://discord.waterpistol.co
Size: 2.93 KB
Stars: 2
Watchers: 2
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
Awesome Lists containing this project

awesome_ai_agents - Awesome-Local-Llm - A curated list of resources, libraries, tools, and communities for working with Local Large Language Models (LLMs). (Building / Tools)
awesome_ai_agents - Awesome-Local-Llm - A curated list of resources, libraries, tools, and communities for working with Local Large Language Models (LLMs). (Building / Tools)
README

        # Awesome List for Local LLMs

A curated list of resources, libraries, tools, and communities for working with Local Large Language Models (LLMs).  

Join us on [Discord](https://discord.waterpistol.co)!

## Model Libraries

- **Hugging Face** [_Website_](https://huggingface.co/) | [_Discord_](https://discord.com/invite/JfAtkvEtRb) | [_Docs_](https://huggingface.co/docs)

- **ModelScope** [_Website_](https://modelscope.cn/models) | [_Discord_](https://discord.com/invite/JfAtkvEtRb) | [_Docs_](https://modelscope.cn/docs)

- **Ollama** [_Website_](https://ollama.com/) | [_Git_](https://github.com/ollama/ollama) | [_Discord_](https://discord.gg/ollama) | [_Docs_](https://github.com/ollama/ollama/tree/main/docs)

- **Github Models** [_Website_](https://github.com/marketplace/models) | [_Docs_](https://docs.github.com/en/github-models/prototyping-with-ai-models)

## UI

- **Open WebUI** [_Website_](https://openwebui.com/) | [_Git_](https://github.com/open-webui/open-webui) | [_Discord_](https://discord.gg/d6JADCCtYU) | [_Docs_](https://docs.openwebui.com/)

- **Anything LLM** [_Website_](https://anythingllm.com/) | [_Git_](https://github.com/Mintplex-Labs/anything-llm) | [_Discord_](https://discord.gg/MuqQrEBfwF) | [_Docs_](https://docs.anythingllm.com/)

- **ComfyUI** [_Website_](https://www.comfy.org/) | [_Git_](https://github.com/comfyanonymous/ComfyUI) | [_Matrix_](https://app.element.io/#/room/%23comfyui_space%3Amatrix.org) | [_Docs_](https://comfyui-wiki.com/)

- **oterm** [_Git_](https://github.com/ggozad/oterm)

## Local Inference

- **Llama.cpp** [_Git_](https://github.com/ggerganov/llama.cpp) | [_Docs_](https://github.com/ggerganov/llama.cpp/wiki)

- **Ollama** [_Website_](https://ollama.com/) | [_Git_](https://github.com/ollama/ollama) | [_Discord_](https://discord.gg/ollama) | [_Docs_](https://github.com/ollama/ollama/tree/main/docs)

- **Distributed Llama** [_Git_](https://github.com/b4rtaz/distributed-llama) | [_Discord_](https://discord.gg/gFmg9eC384) | [_Docs_](https://github.com/b4rtaz/distributed-llama/tree/main/docs)

- **vLLM** [_Git_](https://github.com/vllm-project/vllm) | [_Discord_](https://discord.gg/FUcUS3b757) | [_Docs_](https://docs.vllm.ai/en/latest/)

- **LM Studio** [_Website_](https://lmstudio.ai/) | [_Discord_](https://discord.gg/8Zg47r4nr4) | [_Docs_](https://lmstudio.ai/docs/welcome)

## Coding

- **Twinny** [_Website_](https://twinny.dev/) | [_Git_](https://github.com/twinnydotdev/twinny) | [_Docs_](https://twinnydotdev.github.io/twinny-docs/)

- **Continue** [_Website_](https://continue.dev) | [_Git_](https://github.com/continuedev/continue) | [_Docs_](https://docs.continue.dev/)

- **Open Hands** [_Git_](https://github.com/All-Hands-AI/OpenHands) | [_Discord_](https://discord.gg/dWZk2U7y2P) | [_Docs_](https://docs.all-hands.dev/)

- **SWE-Agent** [_Website_](https://princeton-nlp.github.io/SWE-agent/) | [_Git_](https://github.com/princeton-nlp/SWE-agent) | [_Discord_](https://discord.gg/hqDCGedKAW) | [_Docs_](https://princeton-nlp.github.io/SWE-agent/)

- **Aider** [Git](https://github.com/paul-gauthier/aider)

## Terminal

- **Self-Operating Computer** [_Website_](https://www.hyperwriteai.com/self-operating-computer) | [_Git_](https://github.com/OthersideAI/self-operating-computer) | [_Discord_](https://discord.gg/YqaKtyBEzM) | [_X_](https://x.com/HyperWriteAI)

- **Neo-AI** [_Git_](https://github.com/Vasco0x4/Neo-AI) [_Docs_](https://github.com/Vasco0x4/Neo-AI/blob/master/docs/HOW_IT_WORKS.md)

- **Warp** [_Website_](https://www.warp.dev/) | [_Git_](https://github.com/warpdotdev/Warp) | [_Discord_](https://discord.com/invite/warpdotdev) | [_Docs_](https://docs.warp.dev/)

## Agents

- **AG2** [_Website_](https://ag2.ai/) [_Git_](https://github.com/ag2ai/ag2) | [_Discord_](https://discord.com/invite/Av89b25VgR) | [_Docs_](https://ag2ai.mintlify.app/docs/Home)

- **Autogen** [_Website_](https://github.com/microsoft/autogen) | [_Discord_](https://aka.ms/autogen-discord) | [_Docs_](https://microsoft.github.io/autogen/docs/Getting-Started)

- **Crew AI** [_Website_](https://www.crewai.com/open-source) | [_Git_](https://github.com/crewAIInc/crewAI) | [_Docs_](https://docs.crewai.com/)

- **Ollama Agents** [_Git_](https://github.com/MikeyBeez/Ollama_Agents)

- **Agent Chef** [_Discord_](https://discord.gg/CAXMDpu9vY) | [_Git_](https://github.com/Leoleojames1/Agent_Chef) | [_Docs_](https://github.com/Leoleojames1/Agent_Chef/tree/main/docs)

- **Rollcage** [_Discord_](https://discord.gg/CAXMDpu9vY) | [_Git_](https://github.com/Leoleojames1/ollama_agent_roll_cage) | [_Docs_](https://github.com/Leoleojames1/ollama_agent_roll_cage/tree/master/docs)

- **Agentless** [Git](https://github.com/OpenAutoCoder/Agentless)

## Diffusion

- **PyTorch** [_Website_](https://pytorch.org/) | [_Git_](https://github.com/pytorch/pytorch) | [_Discord_](https://discord.gg/WUg7syZcpb) | [_Docs_](https://pytorch.org/docs/stable/index.html)

- **Stable Diffusion** [_Website_](https://stability.ai/) | [_Git_](https://huggingface.co/stabilityai) | [_Discord_](https://discord.gg/stablediffusion)

- **CivitAI** [_Website_](https://civitai.com/) | [_Discord_](https://discord.gg/civitai) | [_Docs_](https://developer.civitai.com/docs/intro)

## Search and Scrape

- **SearXNG** [_Website_](https://docs.searxng.org/) | [_Git_](https://github.com/searxng/searxng) | [_Matrix_](https://matrix.to/#/#searxng:matrix.org)

- **Apache Tika** [_Website_](https://tika.apache.org/) | [_Git_](https://github.com/apache/tika)

- **Meilisearch** [_Website_](https://www.meilisearch.com/) | [_Git_](https://github.com/meilisearch) | [_Discord_](https://discord.meilisearch.com/) | [_Docs_](https://www.meilisearch.com/docs)

- **FireCrawl** [_Website_](https://www.firecrawl.dev/) | [_Git_](https://github.com/mendableai/firecrawl) | [_Docs_](https://docs.firecrawl.dev/)

- **RagArena** [_Website_](https://www.firecrawl.dev/) | [_Git_](https://github.com/mendableai/rag-arena) | [_Docs_](https://ragarena.com/)

- **RSSHub** [_Website_](https://rsshub.app/) | [_Git_](https://github.com/DIYgod/RSSHub) | [_Docs_](https://docs.rsshub.app/)

- **Raycast** [_Website_](https://raycast.com/) | [_Git_](https://github.com/raycast) | [_Docs_](https://developers.raycast.com/)

- **Fresh RSS** [_Website_](https://freshrss.org/) | [_Git_](https://github.com/FreshRSS/FreshRSS) | [_Docs_](https://freshrss.github.io/FreshRSS/)

- **Browserless** [_Website_](https://www.browserless.io/) | [_Git_](https://github.com/browserless/browserless) | [_Docs_](https://docs.browserless.io/)

- **Scrapy** [_Website_](https://scrapy.org/) | [_Git_](https://github.com/scrapy/scrapy) | [_Docs_](https://docs.scrapy.org/en/latest/)

## TTS

- **Whisper** [_Git_](https://github.com/openai/whisper)

- **Whisper.cpp** [_Git_](https://github.com/ggerganov/whisper.cpp)

- **Faster Whisper** [_Git_](https://github.com/openai/whisper)

- **Faster Whisper Server** https://github.com/fedirz/faster-whisper-server

## STT

- **OpenedAI Speech** [_Git_](https://github.com/matatonic/openedai-speech) | [_Docs_](https://docs.openwebui.com/tutorial/openedai-speech-integration#step-6-configuring-open-webui-to-use-openedai-speech-for-tts)

- **Coqui** [_Website_](https://coqui.ai/) | [_Git_](https://github.com/coqui-ai/TTS)

- **LLaMa Omni** [Git](https://github.com/ictnlp/LLaMA-Omni)

## Datasets

- **Datasets** [_Git_](https://github.com/huggingface/datasets) | [_Docs_](https://huggingface.co/docs/datasets/index)

- **Dataset Viewer** [_Git_](https://github.com/huggingface/dataset-viewer) | [_Docs_](https://huggingface.co/docs/dataset-viewer/index)

- **Papers with Code** [Datasets](https://paperswithcode.com/datasets)

- **Ollama Grid Search** [Git](https://github.com/dezoito/ollama-grid-search)

## Training

- **Autotrain-Advanced** [_Website_](https://huggingface.co/autotrain) | [_Git_](https://github.com/FailSpy/abliterator) | [_Docs_](https://huggingface.co/docs/autotrain/main/en/index)

- **LLaMA Factory** [_Website_](https://arxiv.org/abs/2403.13372) | [_Git_](https://github.com/hiyouga/LLaMA-Factory) | [_Docs_](https://llamafactory.readthedocs.io/zh-cn/latest/)

- **Unsloth** [_Website_](https://unsloth.ai/) | [_Git_](https://github.com/unslothai/unsloth) | [_HF_](https://huggingface.co/unsloth) | [_Discord_](https://discord.gg/unsloth) | [_Docs_](https://docs.unsloth.ai/)

- **Liger Kernel** [_Git_](https://github.com/linkedin/Liger-Kernel) | [_Discord_](https://discord.gg/vNBDpjhb)

- **MergeKit** [_Website_](https://app.arcee.ai/account/login) | [_Git_](https://github.com/arcee-ai/mergekit) | [_Docs_](https://github.com/arcee-ai/mergekit/tree/main/docs)

- **Axolotl** [_Website_](https://axolotl.ai/) | [_Git_](https://github.com/axolotl-ai-cloud/axolotl) | [_Discord_](https://discord.gg/KNyFdkJp9d) | [_Docs_](https://axolotl-ai-cloud.github.io/axolotl/)

- **Abliterator** [_Git_](https://github.com/FailSpy/abliterator)

## Chat and API

- **ChatGPT** [_Website_](https://chatgpt.com/) | [_Docs_](https://platform.openai.com/docs/concepts)

- **Cursor** [_Website_](https://www.cursor.com/) | [_Git_](https://github.com/getcursor) | [_X_](https://twitter.com/cursor_ai)

- **Claude** [_Website_](https://claude.ai/) | [_Docs_](https://docs.anthropic.com/en/docs/welcome)

- **Mistral AI** [_Website_](https://mistral.ai/) | [_Discord_](https://discord.gg/mistralai) | [_Docs_](https://docs.mistral.ai/)

- **Mirage** [_Website_](https://mirage-ai.com/) | [_Git_](https://github.com/mirage-ai-com) | [_Discord_](https://discord.gg/VMgkuAqVmw) | [_Docs_](https://docs.mirage-ai.com/)

- **Midjourney** [_Website_](https://www.midjourney.com/home)

- **HyperWrite** [_Website_](https://app.hyperwriteai.com/personalassistant)

## VPS and Instance

- **Hugging Face Spaces** [_Website_](https://huggingface.co/spaces) | Git | [_Discord_](https://discord.com/invite/JfAtkvEtRb) | [_Docs_](https://huggingface.co/docs/hub/en/index#spaces)

- **LightningAI** [_Website_](https://lightning.ai/) | [_Discord_](https://discord.gg/BvB3xAwU) | [_Docs_](https://lightning.ai/docs/overview/getting-started)

- **Intel DevCloud** [_Website_](https://devcloud.intel.com/oneapi/) | [_Docs_](https://devcloud.intel.com/oneapi/documentation/shell-commands/)

- **NVIDIA NIM** [_Website_](https://build.nvidia.com/explore/discover) | [_Docs_](https://docs.nvidia.com/nim/large-language-models/latest/getting-started.html)

- **Amazon SageMaker** [_Website_](https://aws.amazon.com/sagemaker/) | [_Docs_](https://docs.aws.amazon.com/sagemaker/)

- **Google Colab** [_Website_](https://colab.research.google.com/)

- **Groq** [_Website_](https://groq.com/)

## General

- **Llama.cpp** [Git](https://github.com/ggerganov/llama.cpp) | [Docs](https://github.com/ggerganov/llama.cpp/tree/master/docs)

- **CUDA Toolkit** [_Website_](https://developer.nvidia.com/cuda-toolkit) | [_Docs_](https://docs.nvidia.com/cuda/)

- **ROCm** [_Git_](https://github.com/ROCm) | [_Docs_](https://rocm.docs.amd.com/en/latest/)

- **AMD SHARK** [_Discord_](https://discord.gg/K6xUQ7QfqQ)

- **Python** [_Discord_](https://discord.gg/python)

- **Liquid Neural Network** [Git](https://github.com/starsnatched/liquid-neural-network)

- **Genesis Embodied AI** [Git](https://github.com/Genesis-Embodied-AI/Genesis)

## Community

- **BORCH's UToE** [_Git_](https://github.com/Leoleojames1/) | [_Discord_](https://discord.gg/CAXMDpu9vY)

- **The Drummer/BeaverAI** [_HF_](https://huggingface.co/TheDrummer) | [_Discord_](https://discord.gg/K9Mq4sApSS)

## Reference

- [_Ollama and Agents_](https://github.com/premthomas/Ollama-and-Agents)

- [_GraphRAG + AutoGen + Ollama + Chainlit UI_](https://github.com/karthik-codex/Autogen_GraphRAG_Ollama)

- [_Awesome Public Datasets_](https://github.com/awesomedata/awesome-public-datasets)

- [_Awesome Alternative Frontends_](https://github.com/Myzel394/awesome-alternative-frontends?tab=readme-ov-file)

- [_Awesome Torch_](https://github.com/carpedm20/awesome-torch)

- [_Train a Llama Model from Scratch_](https://huggingface.co/blog/nroggendorff/train-with-llama-architecture)

- **SAELens Example Dashboard** [Link](https://jbloomaus.github.io/SAELens/#example-wandb-dashboard)

## Resources

- **DataCamp**

  https://www.datacamp.com

  - [Speculative Decoding Tutorial](https://www.datacamp.com/tutorial/speculative-decoding)

- **ComfyUI**

  - 

  - 

- **FLUX**

  - 

  - 

  - 

  - 

  - 

## Contribution

Contributions are welcome! If you have a resource that would fit into this list, please submit a pull request or open an issue describing the resource and why it should be included.

## License

This list is provided under the [CC0 1.0 Universal (CC0 1.0) Public Domain Dedication](https://creativecommons.org/publicdomain/zero/1.0/). Feel free to use, share, modify, and distribute this list as you see fit.