Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/sydverma123/awesome-ai-repositories

A curated list of open source repositories for AI Engineers
https://github.com/sydverma123/awesome-ai-repositories

List: awesome-ai-repositories

agent agents ai awesome awesome-list fine-tune finetuning llama llm llmops rag vector-database vector-search

Last synced: 3 months ago
JSON representation

A curated list of open source repositories for AI Engineers

Awesome Lists containing this project

README

        

## AI Infra Repositories

A curated list of open source repositories for AI Engineers

If you want to contribute to this list, please make a Pull request

## Contents
- [AI Gateway](#ai-gateway)
- [AI Workload Manager](#ai-workload-manager)
- [Copilot Development](#copilot-development)
- [Dataset Engineering](#dataset-engineering)
- [Evaluation](#evaluation)
- [Fine Tuning](#fine-tuning)
- [Function Calling](#function-calling)
- [Graph RAG](#graph-rag)
- [Guardrails](#guardrails)
- [Local Model Inference](#local-model-inference)
- [LLM Agent Framework](#llm-agent-framework)
- [Model Serving](#model-serving)
- [Observability](#observability)
- [Pre Training](#pre-training)
- [Prompt Engineering](#prompt-engineering)
- [RAG Framework](#rag-framework)
- [Structured Extraction](#structured-extraction)
- [Structured Generation](#structured-generation)
- [Vector DB](#vector-db)
- [Voice Agent](#voice-agent)

## AI Gateway

| Name (site) | Github |
|------------|------------|
| [Kong](https://konghq.com/products/kong-ai-gateway) | |
| [Litellm](https://docs.litellm.ai/docs/) | |
| [Portkey](https://portkey.ai/) | |
| [RouteLLM](https://lmsys.org/projects/) | |
| [GPTRouter](https://gpt-router.writesonic.com/) | |
| [missing studio](https://www.missing.studio/) | |

## AI Workload Manager

| Name (site) | Github |
|------------|------------|
| [Ray](https://www.ray.io/) | |
| [higgsfield](https://higgsfield.ai/) | |
| [Dstack](https://dstack.ai/) | |

## Copilot Development

| Name (site) | Github |
|------------|------------|
| [copilotkit](https://www.copilotkit.ai/) | |
| [OpenCopilot](https://opencopilot.so/) | |

## Dataset Engineering

| Name (site) | Github |
|------------|------------|
| [label studio](https://labelstud.io/) | |
| [CleanLab](https://cleanlab.ai/) | |
| [Snorkel](https://www.snorkel.org/) | |
| [Lilac](https://www.lilacml.com/) | |
| [litdata](https://github.com/Lightning-AI/litdata) | |

## Evaluation

| Name (site) | Github |
|------------|------------|
| [Eval](https://openai.com/) | |
| [RAGAS](https://docs.ragas.io/en/stable/) | |
| [Giskard](https://www.giskard.ai/) | |
| [promptfoo](https://www.promptfoo.dev/) | |
| [arize ai](https://phoenix.arize.com/) | |
| [uptrain](https://uptrain.ai/) | |
| [trulens](https://www.trulens.org/) | |
| [tonic-validate](https://docs.tonic.ai/validate) | |
| [LangEvals](https://github.com/langwatch/langevals) | |
| [Poyro](https://github.com/poyro/poyro) | |

## Fine Tuning

| Name (site) | Github |
|------------|------------|
| [Unsloth](https://unsloth.ai/) | |
| [ludwig](https://ludwig.ai/latest/) | |
| [NeMo/Nvidia](https://docs.nvidia.com/nemo-framework/user-guide/latest/overview.html) | |
| [LMFlow](https://optimalscale.github.io/LMFlow/) | |
| [litgpt](https://optimalscale.github.io/LMFlow/) | |
| [Axolotl](https://github.com/axolotl-ai-cloud/axolotl) | |
| [xTuring](https://xturing.stochastic.ai/) | |

## Function Calling

| Name (site) | Github |
|------------|------------|
| [Gorilla](https://gorilla.cs.berkeley.edu/) | |
| [Tiger](https://docs.upsonic.co/tiger/welcome) | |
| [NPI AI](https://www.npi.ai/) | |
| [empower](https://www.empower.dev/) | |
| [Composio](https://docs.composio.dev/introduction/intro/overview) | |

## Graph RAG

| Name (site) | Github |
|------------|------------|
| [graphRAG ](https://microsoft.github.io/graphrag/) | |
| [cognee](https://www.cognee.ai/) | |
| [FalkorDB](https://www.falkordb.com/) | |
| [llm-graph-builder](https://neo4j.com/labs/genai-ecosystem/llm-graph-builder/) | |
| [tidb](https://tidb.ai/) | |

## Guardrails

| Name (site) | Github |
|------------|------------|
| [NeMo-Guardrails](https://github.com/NVIDIA/NeMo-Guardrails) | |
| [Guardrails](https://www.guardrailsai.com/) | |

## Local Model Inference

| Name (site) | Github |
|------------|------------|
| [llama cpp](https://github.com/ggerganov/llama.cpp) | |
| [whisper cpp](https://github.com/ggerganov/whisper.cpp) | |
| [ollama](https://ollama.com/) | |
| [gpt4all](https://www.nomic.ai/gpt4all) | |
| [private-gpt](https://privategpt.dev/) | |
| [open-interpreter](https://www.openinterpreter.com/) | |
| [LocalAI](https://localai.io/) | |
| [jan](https://jan.ai/) | |
| [dalai](https://cocktailpeanut.github.io/dalai/#/) | |

## LLM Agent Framework

| Name (site) | Github |
|------------|------------|
| [AutoGPT](https://agpt.co/) | |
| [MetaGPT](https://www.deepwisdom.ai/) | |
| [AgentGPT](https://www.reworkd.ai/) | |
| [Autogen](https://microsoft.github.io/autogen/) | |
| [BabyAGI](https://github.com/yoheinakajima/babyagi) | |
| [CrewAI](https://www.crewai.com/) | |
| [SuperAGI](https://superagi.com/) | |
| [TaskingAI](https://www.tasking.ai/) | |
| [LaVague](https://www.lavague.ai/) | |
| [superagent](https://docs.superagent.sh/overview/overview/introduction) | |
| [Rivet AI](https://rivet.ironcladapp.com/) | |
| [AGiXT](https://josh-xt.github.io/AGiXT/) | |
| [cheshirecat](https://cheshirecat.ai/) | |
| [langroid](https://langroid.github.io/langroid/) | |
| [Griptape](https://www.griptape.ai/) | |
| [Mirascope](https://www.mirascope.io/) | |
| [Julep](https://www.julep.ai/) | |
| [ControlFlow](https://controlflow.ai/welcome) | |
| [Dify](https://dify.ai/) | |
| [Flowise](https://flowiseai.com/) | |
| [langflow](https://www.langflow.org/) | |
| [Haystack](https://haystack.deepset.ai/) | |
| [MemGPT](https://memgpt.readme.io/docs/index) | |
| [phidata](https://docs.phidata.com/introduction) | |
| [PromptFlow](https://microsoft.github.io/promptflow/) | |
| [chainlit](https://chainlit.io/) | |
| [ragapp](https://github.com/ragapp/ragapp) | |
| [burr](https://github.com/dagworks-inc/burr) | |

## Model Serving

| Name (site) | Github |
|------------|------------|
| [vLLM](https://vllm.ai/) | |
| [TensorRT-LLM](https://nvidia.github.io/TensorRT-LLM/) | |
| [bentoml](https://bentoml.com/) | |
| [lightllm](https://github.com/ModelTC/lightllm) | |
| [openfoundry](https://www.openfoundry.ai/) | |
| [LitServe](https://lightning.ai/docs/litserve/home) | |
| [truss](https://truss.baseten.co/) | |

## Observability

| Name (site) | Github |
|------------|------------|
| [pezzo](https://pezzo.ai/) | |
| [helicone](https://www.helicone.ai/) | |
| [Portkey](https://portkey.ai/) | |
| [Langfuse](https://langfuse.com/) | |
| [langtrace](https://www.langtrace.ai/) | |
| [traceloop](https://www.traceloop.com/) | |
| [trulens](https://www.trulens.org/) | |
| [log10](https://www.log10.io/) | |
| [LangWatch](https://github.com/langwatch/langwatch) | |
| [burr](https://github.com/dagworks-inc/burr) | |
| [hamilton](https://github.com/dagworks-inc/hamilton) | |

## Pre Training

| Name (site) | Github |
|------------|------------|
| [Colossal AI](https://colossalai.org/) | |
| [FastChat](https://lmsys.org/projects/) | |
| [pytorch-lightning](https://lightning.ai/) | |
| [llm c](https://github.com/karpathy/llm.c) | |
| [miniGPT](https://github.com/karpathy/minGPT) | |

## Prompt Engineering

| Name (site) | Github |
|------------|------------|
| [DSPy](https://dspy-docs.vercel.app/) | |
| [Langfuse](https://langfuse.com/) | |
| [hamilton](https://github.com/dagworks-inc/hamilton) | |

## RAG Framework

| Name (site) | Github |
|------------|------------|
| [Langchain](https://www.langchain.com/) | |
| [LlamaIndex](https://www.llamaindex.ai/) | |
| [FastGPT](https://fastgpt.in/) | |
| [ragflow](https://ragflow.io/) | |
| [vanna](https://vanna.ai/) | |
| [FlagEmbedding](https://github.com/FlagOpen/FlagEmbedding) | |
| [llmware](https://llmware-ai.github.io/llmware/) | |
| [llm-app](https://pathway.com/) | |
| [Cognita](https://cognita.truefoundry.com/) | |
| [casibase](https://casibase.org/) | |
| [SciPhi](https://r2r-docs.sciphi.ai/introduction) | |
| [trieve](https://trieve.ai/) | |
| [autollm](https://github.com/safevideo/autollm) | |
| [canopy](https://www.pinecone.io/blog/canopy-rag-framework/) | |
| [NeumAI](https://www.neum.ai/) | |
| [WrenAI](https://www.getwren.ai/) | |
| [ragna](https://ragna.chat/en/stable/) | |
| [Dify](https://dify.ai/) | |
| [Flowise](https://flowiseai.com/) | |
| [langflow](https://www.langflow.org/) | |
| [Haystack](https://haystack.deepset.ai/) | |
| [MemGPT](https://memgpt.readme.io/docs/index) | |
| [phidata](https://docs.phidata.com/introduction) | |
| [PromptFlow](https://microsoft.github.io/promptflow/) | |
| [chainlit](https://chainlit.io/) | |
| [ragapp](https://github.com/ragapp/ragapp) | |
| [hamilton](https://github.com/dagworks-inc/hamilton) | |
| [RagBuilder](https://github.com/KruxAI/ragbuilder) | |

## Security

| Name (site) | Github |
|------------|------------|
| [Armur](https://armur.ai/) | |

## Structured Extraction

| Name (site) | Github |
|------------|------------|
| [Unstructured](https://unstructured.io/) | |
| [omniparse](https://docs.cognitivelab.in/) | |
| [unstract](https://unstract.com/) | |
| [indexify](https://getindexify.ai/) | |
| [firecrawl](https://www.firecrawl.dev/) | |
| [Scrapegraph-ai](https://scrapegraphai.com/) | |

## Structured Generation

| Name (site) | Github |
|------------|------------|
| [guidance](https://github.com/guidance-ai/guidance) | |
| [outlines](https://outlines-dev.github.io/outlines/) | |
| [instructor](https://useinstructor.com/) | |
| [jsonformer](https://github.com/1rgs/jsonformer) | |
| [sglang](https://github.com/sgl-project/sglang) | |

## Vector DB

| Name (site) | Github |
|------------|------------|
| [milvus](https://milvus.io/) | |
| [Qdrant](https://qdrant.tech/) | |
| [Chroma](https://www.trychroma.com/) | |
| [Weaviate](https://weaviate.io/) | |
| [pgvector](https://www.postgresql.org/about/news/pgvector-070-released-2852/) | |
| [deeplake](https://www.activeloop.ai/) | |
| [txtai](https://neuml.github.io/txtai/) | |
| [marqo](https://www.marqo.ai/) | |
| [lancedb](https://lancedb.com/) | |
| [nucliaDB](https://docs.nuclia.dev/docs/) | |
| [oasysdb](https://docs.oasysdb.com/) | |
| [lantern](https://lantern.dev/) | |

## Voice Agent

| Name (site) | Github |
|------------|------------|
| [vocode](https://www.vocode.dev/) | |
| [bolna](https://www.bolna.dev/) | |