https://github.com/mudler/LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference
https://github.com/mudler/LocalAI

ai api audio-generation distributed gemma gpt4all image-generation kubernetes llama llama3 llm mamba mistral musicgen p2p rerank rwkv stable-diffusion text-generation tts

Last synced: about 2 months ago
JSON representation

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

• Host: GitHub
• URL: https://github.com/mudler/LocalAI
• Owner: mudler
• License: mit
• Created: 2023-03-18T22:58:02.000Z (about 2 years ago)
• Default Branch: master
• Last Pushed: 2024-10-29T09:30:04.000Z (6 months ago)
• Last Synced: 2024-10-29T09:47:04.590Z (6 months ago)
• Topics: ai, api, audio-generation, distributed, gemma, gpt4all, image-generation, kubernetes, llama, llama3, llm, mamba, mistral, musicgen, p2p, rerank, rwkv, stable-diffusion, text-generation, tts
• Language: C++
• Homepage: https://localai.io
• Size: 8.68 MB
• Stars: 24,251
• Watchers: 177
• Forks: 1,862
• Open Issues: 384
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Security: SECURITY.md

Awesome Lists containing this project

• awesome-go - LocalAI - Open Source OpenAI alternative, self-host AI models. (Artificial Intelligence)
• awesome-go - LocalAI - Open Source OpenAI alternative, self-host AI models. (Artificial Intelligence)
• awesome-go-with-stars - LocalAI - Open Source OpenAI alternative, self-host AI models. (Artificial Intelligence)
• awesome - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference (Go)
• awesome-go - LocalAI - Open Source OpenAI alternative, self-host AI models. Stars:`31.5K`. (Artificial Intelligence)
• awesome-go-cn - LocalAI - host AI models. [![近一周有更新][G]](https://github.com/mudler/LocalAI) [![godoc][D]](https://godoc.org/github.com/mudler/LocalAI) (Artificial Intelligence)
• awesome-go - LocalAI - Open Source OpenAI alternative, self-host AI models. (Artificial Intelligence)
• awesome-mlops - LocalAI - Drop-in replacement REST API that’s compatible with OpenAI API specifications for inferencing. (Model Serving)
• awesome-go - LocalAI - Open Source OpenAI alternative, self-host AI models. (Artificial Intelligence)
• awesome-go-cn - LocalAI - host AI models. [![近一周有更新][G]](https://github.com/mudler/LocalAI) (Artificial Intelligence)
• awesome-homelab - LocalAI - hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference | (Apps / AI)
• awesome-production-machine-learning - LocalAI - LocalAI is a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. (Deployment and Serving)
• awesome-starred - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr (Go)
• awesome-starred - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr (Go)
• awesome-repositories - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr (Go)
• my-awesome-github-stars - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr (Go)
• fucking-awesome-go - LocalAI - Open Source OpenAI alternative, self-host AI models. (Artificial Intelligence)
• awesome-LLM-resourses - LocalAI - hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. (推理 Inference)
• awesome-go-plus - LocalAI - Open Source OpenAI alternative, self-host AI models.  (Artificial Intelligence)
• awesome-go-plus - LocalAI - Open Source OpenAI alternative, self-host AI models. (Artificial Intelligence)
• my-awesome - mudler/LocalAI - generation,distributed,gemma,gpt4all,image-generation,kubernetes,libp2p,llama,llama3,llm,mamba,mistral,musicgen,rerank,rwkv,stable-diffusion,text-generation,tts pushed_at:2025-04 star:31.7k fork:2.4k :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference (Go)
• awesome-openvino - LocalAI - LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI (Elevenlabs, Anthropic... ) API specifications for local AI inferencing. (Table of content / Generative AI)
• awesome-local-llms - LocalAI - hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference | 29,764 | 2,240 | 410 | 120 | 68 | MIT License | 0 days, 10 hrs, 46 mins | (Open-Source Local LLM Projects)
• awesome - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference (Go)
• awesome - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference (Go)
• awesome-ai - LocalAI - LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families and architectures. (Self Hosted)
• AiTreasureBox - mudler/LocalAI - 04-30_32250_19](https://img.shields.io/github/stars/mudler/LocalAI.svg)|🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.| (Repos)
• awesome-hacking-lists - mudler/LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr (Go)
• awesome-go - LocalAI - 开源的 OpenAI 替代方案，可以自托管 AI 模型。 (人工智能 (AI))
• awesomeLibrary - LocalAI - :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference (语言资源库 / c++)