https://github.com/altengineer/awesome-ai-repositories
A curated list of open source repositories for AI Engineers
https://github.com/altengineer/awesome-ai-repositories
List: awesome-ai-repositories
agent agents ai awesome awesome-list fine-tune finetuning llama llm llmops mcp rag vector-database vector-search
Last synced: about 2 months ago
JSON representation
A curated list of open source repositories for AI Engineers
- Host: GitHub
- URL: https://github.com/altengineer/awesome-ai-repositories
- Owner: altengineer
- Created: 2024-06-24T09:21:44.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-20T05:02:48.000Z (8 months ago)
- Last Synced: 2025-09-27T05:25:18.449Z (about 2 months ago)
- Topics: agent, agents, ai, awesome, awesome-list, fine-tune, finetuning, llama, llm, llmops, mcp, rag, vector-database, vector-search
- Homepage:
- Size: 178 KB
- Stars: 119
- Watchers: 2
- Forks: 21
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- ultimate-awesome - awesome-ai-repositories - A curated list of open source repositories for AI Engineers. (Other Lists / TeX Lists)
README
## AI Infra Repositories
A curated list of open source repositories for AI Engineers
If you want to contribute to this list, please make a PR
## Contents
- [AI Gateway](#ai-gateway)
- [AI Workload Manager](#ai-workload-manager)
- [Copilot Development](#copilot-development)
- [Dataset Engineering](#dataset-engineering)
- [Evaluation](#evaluation)
- [Fine Tuning](#fine-tuning)
- [Function Calling](#function-calling)
- [Graph RAG](#graph-rag)
- [Guardrails](#guardrails)
- [Local Model Inference](#local-model-inference)
- [LLM Agent Framework](#llm-agent-framework)
- [Model Serving](#model-serving)
- [Observability](#observability)
- [Pre Training](#pre-training)
- [Prompt Engineering](#prompt-engineering)
- [RAG Framework](#rag-framework)
- [Structured Extraction](#structured-extraction)
- [Structured Generation](#structured-generation)
- [Vector DB](#vector-db)
## AI Gateway
| Name (site) | Github |
|------------|------------|
| [Kong](https://konghq.com/products/kong-ai-gateway) | 
|
| [Litellm](https://docs.litellm.ai/docs/) | 
|
| [Portkey](https://portkey.ai/) | 
|
| [RouteLLM](https://lmsys.org/projects/) | 
|
| [GPTRouter](https://gpt-router.writesonic.com/) | 
|
| [tensorzero](https://www.tensorzero.com/) | 
|
| [missing studio](https://www.missing.studio/) | 
|
## AI Workload Manager
| Name (site) | Github |
|------------|------------|
| [Ray](https://www.ray.io/) | 
|
| [higgsfield](https://higgsfield.ai/) | 
|
| [Dstack](https://dstack.ai/) | 
|
## Copilot Development
| Name (site) | Github |
|------------|------------|
| [copilotkit](https://www.copilotkit.ai/) | 
|
| [OpenCopilot](https://opencopilot.so/) | 
|
## Dataset Engineering
| Name (site) | Github |
|------------|------------|
| [label studio](https://labelstud.io/) | 
|
| [CleanLab](https://cleanlab.ai/) | 
|
| [Snorkel](https://www.snorkel.org/) | 
|
| [Lilac](https://www.lilacml.com/) | 
|
| [litdata](https://github.com/Lightning-AI/litdata) | 
|
## Evaluation
| Name (site) | Github |
|------------|------------|
| [Eval](https://openai.com/) | 
|
| [RAGAS](https://docs.ragas.io/en/stable/) | 
|
| [Giskard](https://www.giskard.ai/) | 
|
| [promptfoo](https://www.promptfoo.dev/) | 
|
| [arize ai](https://phoenix.arize.com/) | 
|
| [uptrain](https://uptrain.ai/) | 
|
| [trulens](https://www.trulens.org/) | 
|
| [tonic-validate](https://docs.tonic.ai/validate) | 
|
| [LangEvals](https://github.com/langwatch/langevals) | 
|
| [Poyro](https://github.com/poyro/poyro) | 
|
## Fine Tuning
| Name (site) | Github |
|------------|------------|
| [Unsloth](https://unsloth.ai/) | 
|
| [ludwig](https://ludwig.ai/latest/) | 
|
| [NeMo/Nvidia](https://docs.nvidia.com/nemo-framework/user-guide/latest/overview.html) | 
|
| [LMFlow](https://optimalscale.github.io/LMFlow/) | 
|
| [litgpt](https://optimalscale.github.io/LMFlow/) | 
|
| [Axolotl](https://github.com/axolotl-ai-cloud/axolotl) | 
|
| [xTuring](https://xturing.stochastic.ai/) | 
|
## Function Calling
| Name (site) | Github |
|------------|------------|
| [Gorilla](https://gorilla.cs.berkeley.edu/) | 
|
| [Tiger](https://docs.upsonic.co/tiger/welcome) | 
|
| [NPI AI](https://www.npi.ai/) | 
|
| [empower](https://www.empower.dev/) | 
|
| [Composio](https://docs.composio.dev/introduction/intro/overview) | 
|
## Graph RAG
| Name (site) | Github |
|------------|------------|
| [graphRAG ](https://microsoft.github.io/graphrag/) | 
|
| [cognee](https://www.cognee.ai/) | 
|
| [FalkorDB](https://www.falkordb.com/) | 
|
| [llm-graph-builder](https://neo4j.com/labs/genai-ecosystem/llm-graph-builder/) | 
|
| [tidb](https://tidb.ai/) | 
|
## Guardrails
| Name (site) | Github |
|------------|------------|
| [NeMo-Guardrails](https://github.com/NVIDIA/NeMo-Guardrails) | 
|
| [Guardrails](https://www.guardrailsai.com/) | 
|
## Local Model Inference
| Name (site) | Github |
|------------|------------|
| [llama cpp](https://github.com/ggerganov/llama.cpp) | 
|
| [whisper cpp](https://github.com/ggerganov/whisper.cpp) | 
|
| [ollama](https://ollama.com/) | 
|
| [gpt4all](https://www.nomic.ai/gpt4all) | 
|
| [private-gpt](https://privategpt.dev/) | 
|
| [open-interpreter](https://www.openinterpreter.com/) | 
|
| [LocalAI](https://localai.io/) | 
|
| [jan](https://jan.ai/) | 
|
| [dalai](https://cocktailpeanut.github.io/dalai/#/) | 
|
## LLM Agent Framework
| Name (site) | Github |
|------------|------------|
| [AutoGPT](https://agpt.co/) | 
|
| [MetaGPT](https://www.deepwisdom.ai/) | 
|
| [AgentGPT](https://www.reworkd.ai/) | 
|
| [Autogen](https://microsoft.github.io/autogen/) | 
|
| [BabyAGI](https://github.com/yoheinakajima/babyagi) | 
|
| [CrewAI](https://www.crewai.com/) | 
|
| [SuperAGI](https://superagi.com/) | 
|
| [TaskingAI](https://www.tasking.ai/) | 
|
| [LaVague](https://www.lavague.ai/) | 
|
| [superagent](https://docs.superagent.sh/overview/overview/introduction) | 
|
| [Rivet AI](https://rivet.ironcladapp.com/) | 
|
| [AGiXT](https://josh-xt.github.io/AGiXT/) | 
|
| [cheshirecat](https://cheshirecat.ai/) | 
|
| [langroid](https://langroid.github.io/langroid/) | 
|
| [Griptape](https://www.griptape.ai/) | 
|
| [Mirascope](https://www.mirascope.io/) | 
|
| [Julep](https://www.julep.ai/) | 
|
| [ControlFlow](https://controlflow.ai/welcome) | 
|
| [Dify](https://dify.ai/) | 
|
| [Flowise](https://flowiseai.com/) | 
|
| [langflow](https://www.langflow.org/) | 
|
| [Haystack](https://haystack.deepset.ai/) | 
|
| [MemGPT](https://memgpt.readme.io/docs/index) | 
|
| [phidata](https://docs.phidata.com/introduction) | 
|
| [PromptFlow](https://microsoft.github.io/promptflow/) | 
|
| [chainlit](https://chainlit.io/) | 
|
| [ragapp](https://github.com/ragapp/ragapp) | 
|
| [burr](https://github.com/dagworks-inc/burr) | 
|
| [Upsonic](https://www.upsonic.ai/) | 
|
## Model Serving
| Name (site) | Github |
|------------|------------|
| [vLLM](https://vllm.ai/) | 
|
| [TensorRT-LLM](https://nvidia.github.io/TensorRT-LLM/) | 
|
| [bentoml](https://bentoml.com/) | 
|
| [lightllm](https://github.com/ModelTC/lightllm) | 
|
| [openfoundry](https://www.openfoundry.ai/) | 
|
| [LitServe](https://lightning.ai/docs/litserve/home) | 
|
| [truss](https://truss.baseten.co/) | 
|
## Observability
| Name (site) | Github |
|------------|------------|
| [pezzo](https://pezzo.ai/) | 
|
| [helicone](https://www.helicone.ai/) | 
|
| [Portkey](https://portkey.ai/) | |
| [Langfuse](https://langfuse.com/) | 
|
| [langtrace](https://www.langtrace.ai/) | 
|
| [traceloop](https://www.traceloop.com/) | 
|
| [trulens](https://www.trulens.org/) | |
| [log10](https://www.log10.io/) | 
|
| [LangWatch](https://github.com/langwatch/langwatch) | 
|
| [burr](https://github.com/dagworks-inc/burr) | |
| [hamilton](https://github.com/dagworks-inc/hamilton) | 
|
## Pre Training
| Name (site) | Github |
|------------|------------|
| [Colossal AI](https://colossalai.org/) | 
|
| [FastChat](https://lmsys.org/projects/) | 
|
| [pytorch-lightning](https://lightning.ai/) | 
|
| [llm c](https://github.com/karpathy/llm.c) | 
|
| [miniGPT](https://github.com/karpathy/minGPT) | 
|
## Prompt Engineering
| Name (site) | Github |
|------------|------------|
| [DSPy](https://dspy-docs.vercel.app/) | 
|
| [Langfuse](https://langfuse.com/) | |
| [hamilton](https://github.com/dagworks-inc/hamilton) | |
## RAG Framework
| Name (site) | Github |
|------------|------------|
| [Langchain](https://www.langchain.com/) | 
|
| [LlamaIndex](https://www.llamaindex.ai/) | 
|
| [FastGPT](https://fastgpt.in/) | 
|
| [ragflow](https://ragflow.io/) | 
|
| [vanna](https://vanna.ai/) | 
|
| [FlagEmbedding](https://github.com/FlagOpen/FlagEmbedding) | 
|
| [llmware](https://llmware-ai.github.io/llmware/) | 
|
| [llm-app](https://pathway.com/) | 
|
| [Cognita](https://cognita.truefoundry.com/) | 
|
| [casibase](https://casibase.org/) | 
|
| [SciPhi](https://r2r-docs.sciphi.ai/introduction) | 
|
| [trieve](https://trieve.ai/) | 
|
| [autollm](https://github.com/safevideo/autollm) | 
|
| [canopy](https://www.pinecone.io/blog/canopy-rag-framework/) | 
|
| [NeumAI](https://www.neum.ai/) | 
|
| [WrenAI](https://www.getwren.ai/) | 
|
| [ragna](https://ragna.chat/en/stable/) | 
|
| [Dify](https://dify.ai/) | |
| [Flowise](https://flowiseai.com/) | |
| [langflow](https://www.langflow.org/) | |
| [Haystack](https://haystack.deepset.ai/) | |
| [MemGPT](https://memgpt.readme.io/docs/index) | |
| [phidata](https://docs.phidata.com/introduction) | |
| [PromptFlow](https://microsoft.github.io/promptflow/) | |
| [chainlit](https://chainlit.io/) | |
| [ragapp](https://github.com/ragapp/ragapp) | |
| [hamilton](https://github.com/dagworks-inc/hamilton) | |
| [RagBuilder](https://github.com/KruxAI/ragbuilder) | 
|
## Security
| Name (site) | Github |
|------------|------------|
| [Armur](https://armur.ai/) | 
|
## Structured Extraction
| Name (site) | Github |
|------------|------------|
| [Unstructured](https://unstructured.io/) | 
|
| [omniparse](https://docs.cognitivelab.in/) | 
|
| [unstract](https://unstract.com/) | 
|
| [indexify](https://getindexify.ai/) | 
|
| [firecrawl](https://www.firecrawl.dev/) | 
|
| [Scrapegraph-ai](https://scrapegraphai.com/) | 
|
| [extractous](https://github.com/yobix-ai/extractous) | 
|
## Structured Generation
| Name (site) | Github |
|------------|------------|
| [guidance](https://github.com/guidance-ai/guidance) | 
|
| [outlines](https://outlines-dev.github.io/outlines/) | 
|
| [instructor](https://useinstructor.com/) | 
|
| [jsonformer](https://github.com/1rgs/jsonformer) | 
|
| [sglang](https://github.com/sgl-project/sglang) | 
|
## Vector DB
| Name (site) | Github |
|------------|------------|
| [milvus](https://milvus.io/) | 
|
| [Qdrant](https://qdrant.tech/) | 
|
| [Chroma](https://www.trychroma.com/) | 
|
| [Weaviate](https://weaviate.io/) | 
|
| [pgvector](https://www.postgresql.org/about/news/pgvector-070-released-2852/) | 
|
| [deeplake](https://www.activeloop.ai/) | 
|
| [txtai](https://neuml.github.io/txtai/) | 
|
| [marqo](https://www.marqo.ai/) | 
|
| [lancedb](https://lancedb.com/) | 
|
| [nucliaDB](https://docs.nuclia.dev/docs/) | 
|
| [oasysdb](https://docs.oasysdb.com/) | 
|
| [lantern](https://lantern.dev/) | 
|
| [vespa](https://vespa.ai/) | 
|