awesome-ai-devtools
The open-source map of the AI developer tooling ecosystem
https://github.com/yeaight7/awesome-ai-devtools
Last synced: 1 day ago
JSON representation
-
Browse The Shelves
-
Agent evals
- Agent Eval Framework - grade evaluation and continuous improvement of AI agents across multiple quality dimensions. | Framework · Library | [Repo](https://github.com/goker/agent-eval-framework) |
- Agentic Security - source vulnerability scanner and red-teaming kit for LLM agents and workflows focused on security evaluation. | CLI · Framework · Library | [Repo](https://github.com/msoedov/agentic_security) |
- Async Labs LLM Eval (PHP) - Labs/llm-eval) |
- AWS Agent Evaluation - powered framework from AWS Labs to test virtual agents via multi-turn conversations and CI-friendly workflows. | CLI · Framework · Library | [Docs](https://awslabs.github.io/agent-evaluation/) / [Repo](https://github.com/awslabs/agent-evaluation) |
- DeepEval - backed metrics. | CLI · Framework · Library | [Website](https://deepeval.com) / [Repo](https://github.com/confident-ai/deepeval) |
- DeepTeam - source LLM red teaming framework for simulating attacks and evaluating safety of LLM systems using DeepEval metrics. | CLI · Framework · Library | [Repo](https://github.com/confident-ai/deepteam) |
- Guardrails AI
- LangChain OpenEvals - source collection of ready-made evaluators for LLM applications in the LangChain ecosystem. | Framework · Library | [Repo](https://github.com/langchain-ai/openevals) |
- LangFair - case level LLM bias and fairness assessment using bring-your-own-prompts workflows. | Framework · Library | [Docs](https://cvs-health.github.io/langfair/) / [Repo](https://github.com/cvs-health/langfair) |
- LangSmith Evaluations - based and online eval workflows. | API · Framework · Web | [Website](https://www.langchain.com/langsmith/evaluation) / [Docs](https://docs.smith.langchain.com) |
- LLM Evaluation Framework (Inference-Time) - time methods to evaluate LLM reliability across reasoning strategies. | Framework · Library | [Repo](https://github.com/mmjerge/LLM-Evaluation-Framework) |
- nuclia-eval - eval/) / [Repo](https://github.com/nuclia/nuclia-eval) |
- Open RAG Eval - RAG style metrics. | CLI · Framework · Library | [Website](https://www.vectara.com/blog/introducing-open-rag-eval-the-open-source-framework-for-comparing-rag-solutions) / [Docs](https://docs.vectara.com/docs/hallucination-and-evaluation/open-eval-framework) / [Repo](https://github.com/vectara/open-rag-eval) |
- OpenAI HumanEval Harness - eval) |
- PyHDL-Eval - specific LLM evaluation framework for assessing hardware design code generation using Python-embedded DSLs and RTL tasks. | CLI · Framework · Library | [Repo](https://github.com/cornell-brg/pyhdl-eval) |
- RAG Evaluation Harnesses - evaluation-harness for retrieval-augmented generation tasks. | CLI · Framework · Library | [Repo](https://github.com/RulinShao/RAG-evaluation-harnesses) |
- RAGAS - source toolkit for automated evaluation of RAG systems using reference-free and reference-based metrics. | CLI · Framework · Library | [Website](https://docs.ragas.io) / [Docs](https://docs.ragas.io/en/latest/) / [Repo](https://github.com/vibrantlabsai/ragas) |
- Rhesis AI - source collaborative testing platform for LLM and agentic applications with UI, SDK, and CI integration. | API · CLI · Framework · Web | [Website](https://www.rhesis.ai) / [Docs](https://docs.rhesis.ai) / [Repo](https://github.com/rhesis-ai/rhesis) |
- Unitxt - backed library and catalog for textual data preparation and evaluation of generative language models across many tasks. | CLI · Framework · Library | [Website](https://www.unitxt.ai) / [Docs](https://www.unitxt.ai/en/main/docs/introduction.html) / [Repo](https://github.com/ibm/unitxt) |
- Vectara Open Evaluation UI - evaluation) / [Docs](https://docs.vectara.com/docs/hallucination-and-evaluation/open-eval-framework) |
- Promptfoo - source framework and CLI for testing prompts, models, RAG pipelines, and LLM security via automated evals and red teaming. | CLI · Framework · Library · Web | [Website](https://www.promptfoo.dev) / [Docs](https://www.promptfoo.dev/docs) / [Repo](https://github.com/promptfoo/promptfoo) |
-
Agent observability
- Amazon CloudWatch GenAI Observability - observability.html) / [Repo](https://github.com/aws-samples/sample-amazon-cloudwatch-generative-ai-observability) |
- Arize AX - agents/agent-observability/) / [Docs](https://arize.com/docs/ax/observe/quickstart-llm) |
- Datadog LLM Observability - observability/) / [Docs](https://docs.datadoghq.com/tracing/llm_observability/) / [Repo](https://github.com/DataDog/llm-observability) |
- Dunetrace - source anomaly detection layer that monitors agent traces for structural failures and alerts in real time. | API · Self-hosted | [Website](https://dunetrace.dev) / [Docs](https://github.com/dunetrace/dunetrace#readme) / [Repo](https://github.com/dunetrace/dunetrace) |
- Flexible GraphRAG Observability Stack - hosted | [Docs](https://github.com/stevereiner/flexible-graphrag/blob/main/docs/DEVELOPER/OBSERVABILITY/OBSERVABILITY.md) / [Repo](https://github.com/stevereiner/flexible-graphrag) |
- LangSmith - platform) / [Docs](https://www.langchain.com/langsmith/observability) |
- Monocle
- Noveum AI Agent Monitoring - time tracing of LLM calls, RAG steps, and tool interactions. | API · Web · Hosted | [Website](https://noveum.ai/en/solutions/ai-agent-monitoring) |
- Okahu - based applications. | API · Web · Hosted | [Website](https://www.okahu.ai) / [Docs](https://docs.okahu.ai) / [Repo](https://github.com/okahu-demos) |
- OpenAI Traces and Evals - in OpenAI platform capabilities for tracing agent workflows and running evaluations on traces and datasets. | API · Web · Hosted | [Website](https://platform.openai.com) / [Docs](https://developers.openai.com/api/docs/guides/agent-evals) / [Repo](https://github.com/openai/evals) |
- OpenClaw Monitor - time monitoring dashboard for OpenClaw agents — track task execution, token usage, and agent activity with an intuitive UI. | Web · Self-hosted | [Repo](https://github.com/flik2002/openclaw-monitor) |
- OpenInference - source OpenTelemetry-based specification and instrumentations for tracing AI and LLM applications. | Library · Local | [Docs](https://arize-ai.github.io/openinference/) / [Repo](https://github.com/Arize-ai/openinference) |
- OpenObserve LLM Observability - source observability platform that unifies infrastructure and LLM observability with logs, metrics, and traces. | API · Web · Hybrid | [Website](https://openobserve.ai) / [Docs](https://openobserve.ai/docs) / [Repo](https://github.com/openobserve/openobserve) |
- Weights & Biases Weave
- Zenity AI Observability Platform - focused AI observability platform for discovering and monitoring agents across SaaS, endpoints, and environments. | API · Web · Hosted | [Website](https://zenity.io/platform/ai-observability) |
- Braintrust
- Evidently AI - source library and cloud service for evaluating, testing, and monitoring ML and LLM systems, including RAG and agents. | API · Web · Hybrid | [Website](https://www.evidentlyai.com) / [Docs](https://docs.evidentlyai.com) / [Repo](https://github.com/evidentlyai/evidently) |
- Keywords AI - time traces, logs, metrics, and quality scores across many models. | API · Web · Hosted | [Website](https://keywordsai.co) / [Docs](https://docs.keywordsai.co) |
- Langtrace - source OpenTelemetry-based observability tool and dashboard for tracing, evaluating, and debugging LLM applications. | API · Web · Self-hosted | [Website](https://langtrace.ai) / [Docs](https://docs.langtrace.ai) / [Repo](https://github.com/Scale3-Labs/langtrace) |
- Mastra Observability - ai/mastra) |
- Maxim AI - to-end AI evaluation and observability platform for testing and monitoring agents and LLM applications. | API · Web · Hosted | [Website](https://getmaxim.ai) / [Docs](https://docs.getbifrost.ai/features/observability/maxim) / [Repo](https://github.com/maximhq) |
- MLflow AI Observability
- WhyLabs OpenLLMTelemetry
-
Agent skill packs
- Agent Skills Specification
- AgentSkills MCP - compatible agent with progressive disclosure architecture. | MCP · Local | [Repo](https://github.com/zouyingcao/agentskills-mcp) |
- Anthropic Knowledge Work Plugins - source plugins for Claude Cowork and Claude Code with skills, commands, and MCP connectors for knowledge workers. | MCP · Local | [Repo](https://github.com/anthropics/knowledge-work-plugins) |
- Astronomer Agents
- Awesome Agent Skills - curated directory of agent skills, tutorials, and guides for Claude, Copilot, Codex, and other AI assistants. | Skill Pack | [Repo](https://github.com/heilcheng/awesome-agent-skills) |
- Awesome Cursorrules - cursorrules) |
- Awesome GitHub Copilot - copilot) |
- Awesome Rules - rules) |
- Azure DevOps Skills - devops-skills) |
- CC DevOps Skills - ozer/cc-devops-skills) |
- Cursor Rules - rules) |
- Cursorrules Collection - ok/cursorrules-collection) |
- Custom Modes for Roo Code - first principles. | Skill Pack · Template · Local | [Repo](https://github.com/jtgsystems/Custom-Modes-Roo-Code) |
- dbt Agent Skills - labs/dbt-agent-skills) |
- dotskills
- helderberto/skills
- Invariant Testing - ai/testing) |
- Microsoft Skills
- Pulumi Agent Skills - as-code workflows teaching AI assistants Pulumi migrations, components, and secrets management. | Skill Pack · Template · Local | [Repo](https://github.com/pulumi/agent-skills) |
- roomode
- rules
- Superpowers Lab - demand MCP server usage. | Skill Pack · Local | [Repo](https://github.com/obra/superpowers-lab) |
- Swarms - agent orchestration skills for Claude Code and Codex with dependency-aware planning and wave-based parallel execution. | Framework · Skill Pack · Local | [Repo](https://github.com/am-will/swarms) |
- wshobson/agents
-
Browser agents
- Agent Browser - based headless browser automation CLI designed for AI agents, wrapping Chromium control behind a simple command-line tool. | CLI | [Repo](https://github.com/vercel-labs/agent-browser) |
- Agent-E - source agent system focused on browser automation, offering a natural-language web automation API and local agent runtime. | Framework · Library | [Repo](https://github.com/EmergenceAI/Agent-E) |
- Agent-WebVoyager - style agent that navigates and extracts data from sites via visual interactions. | Framework · Library | [Repo](https://github.com/mrmoxon/Agent-WebVoyager) |
- Browser MCP
- BrowserPilot - driven browser. | Library | [Repo](https://github.com/handrew/browserpilot) |
- Charlotte MCP Server - source MCP server that renders web pages into structured, token-efficient representations using headless Chromium for agents. | MCP · Self-hosted | [Docs](https://vibehackers.io/mcp/charlotte) / [Repo](https://github.com/TickTockBent/charlotte) |
- Firecrawl Web Agent - use to execute web tasks over an HTTP API for downstream applications. | API · Framework | [Repo](https://github.com/firecrawl/web-agent) |
- HyperAgent
- Komos - automation-tools) / [Docs](https://docs.komos.ai/) |
- LaVague - based browser interactions for AI web agents. | Framework · Library | [Repo](https://github.com/lavague-ai/LaVague) |
- OpenAI Computer Use - computer-use) |
- Skyvern - step workflows across websites via an API and SDK. | API · Library · Hybrid | [Docs](https://pypi.org/project/skyvern/0.1.70/) / [Repo](https://github.com/Skyvern-AI/skyvern) |
- Steel Browser - source browser API that lets AI apps and agents perform programmatic browsing tasks without managing browser processes directly. | API · Library | [Website](https://steel.dev) / [Repo](https://github.com/steel-dev/steel-browser) |
- Tarsier - backed views of pages by tagging interactable elements. | Library | [Repo](https://github.com/reworkd/tarsier) |
- Webagent (webagent-cloud) - cloud/webagent) |
- WebVoyager - powered web agent that completes end-to-end tasks on real websites using visual and textual signals in a Selenium environment. | Framework · Library | [Repo](https://github.com/MinorJerry/WebVoyager) |
- Anchor Browser - hosted browser fleet built for AI agents, providing human-like Chromium instances and deterministic browser task execution APIs. | API · Hosted | [Docs](https://anchorbrowser.io) |
- Browser Use - source Python library that lets AI agents control browsers via Playwright using natural language to navigate, extract, and automate web tasks. | API · Framework · Library · Hybrid | [Website](https://browser-use.com) / [Repo](https://github.com/browser-use/browser-use) |
- Stagehand
-
Coding agents
- Amazon Q Developer - ug/what-is.html) |
- Amp - centric coding agent with deep codebase context, editor links, and automation-oriented SDK features. | API · CLI · Hybrid | [Website](https://ampcode.com/) / [Docs](https://ampcode.com/manual) |
- Augment Code - aware coding agent for editors and terminal that edits files, uses tools, and understands large codebases. | CLI · IDE · Hybrid | [Website](https://www.augmentcode.com/) / [Docs](https://docs.augmentcode.com/introduction) |
- Claude Code
- Cursor - assisted development workflows. | CLI · Desktop · IDE · Hybrid | [Website](https://cursor.com/) / [Docs](https://cursor.com/docs) |
- Devin - started/devin-intro) |
- Ellipsis
- Factory Droid
- Ivy Tendril - source AI coding orchestrator that manages Claude Code, Codex, Antigravity, Copilot and more through a plan-based lifecycle with verification gates and self-improving memory. | Desktop · Local | [Website](https://tendril.ivy.app) / [Docs](https://tendril.ivy.app/getting-started/installation) |
- Jules
- Junie - assistant/junie-agent.html) / [Repo](https://github.com/JetBrains/junie) |
- OpenAI Codex CLI
- Plandex - source terminal agent for long-running tasks across large projects and real repositories. | CLI · Local | [Website](https://plandex.ai/) / [Docs](https://docs.plandex.ai/quick-start) / [Repo](https://github.com/plandex-ai/plandex) |
- Qwen Code - source terminal coding agent optimized for Qwen models and large repository tasks. | CLI · Local | [Website](https://qwen.ai/) / [Repo](https://github.com/QwenLM/qwen-code) |
- Refact.ai - vscode) |
- SWE-agent - source agent for resolving real repository issues and automating software engineering tasks. | CLI · Local | [Website](https://swe-agent.com/) / [Docs](https://swe-agent.com/latest/) / [Repo](https://github.com/swe-agent/swe-agent) |
- Sweep - focused coding assistant with agent mode, repo edits, AI code review, and MCP integration. | IDE · Hybrid | [Website](https://sweep.dev/) / [Docs](https://docs.sweep.dev/) / [Repo](https://github.com/sweepai/sweep) |
- Windsurf Editor - aware agent workflows for multi-file edits and developer automation. | Desktop · Hybrid | [Website](https://windsurf.com/) / [Docs](https://docs.windsurf.com/) |
-
Documentation agents
- AI Document Creator - generates and updates multi-level repository documentation via pull requests. | GitHub app · Web · Hosted | [Website](https://woden-ai.com) / [Docs](https://github.com/marketplace/ai-document-creator) |
- ai-doc-gen - agent CLI that analyzes codebases and generates repository documentation and READMEs using LLMs. | CLI · Local | [Repo](https://github.com/divar-ir/ai-doc-gen) |
- AIGNE DocSmith - driven documentation generator that builds structured multi-language docs directly from code repositories. | CLI | [Website](https://www.aigne.io) / [Repo](https://github.com/AIGNE-io/aigne-doc-smith) |
- AutoCodeDocs
- AWS Documentation MCP Server - documentation-mcp-server) / [Repo](https://github.com/awslabs/mcp) |
- Code2Docs - ai) / [Repo](https://github.com/xKarinSan/Code2Docs) |
- DeepDocs - native AI agent that keeps READMEs, API docs, SDK guides, and tutorials in sync with code changes. | GitHub app · Web · Hosted | [Website](https://deepdocs.dev) / [Docs](https://deepdocs.dev/homepage/) |
- DeepWiki - powered service that turns GitHub repositories into interactive wiki-style documentation with Q&A. | Web · Hosted | [Website](https://deepwiki.com) / [Docs](https://deepwiki.directory) |
- Docs.dev - assisted docs-as-code platform that generates and audits Markdown documentation from your codebase. | GitHub app · Web · Hosted | [Website](https://docs.dev) / [Docs](https://learn.docs.dev/) |
- Docudoodle - focused AI documentation generator that creates Markdown docs from existing codebases. | CLI · Local | [Repo](https://github.com/genericmilk/docudoodle) |
- DocuWriter.ai - documentation) |
- DocWhizz
- GitBook AI (Assistant & Agent) - native documentation assistant and agent for writing, updating, and searching GitBook docs. | Web · Hosted | [Website](https://www.gitbook.com) / [Docs](https://gitbook.com/docs) |
- GitCrafts
- Gitdocs AI - powered README generator and developer documentation platform integrated with Git hosting. | Web · Hosted | [Website](https://www.gitdocs.cloud) / [Docs](https://gitdocs.space) |
- Google Developer Knowledge API & MCP Server
- Mintlify - native documentation platform that generates and maintains docs and API references from repositories. | GitHub app · Web · Hosted | [Website](https://www.mintlify.com) / [Docs](https://www.mintlify.com/docs) |
- RepoGPT - source GitHub assistant that can generate documentation and answer questions about repositories. | Web | [Repo](https://github.com/mbarinov/repogpt) |
- RepoMix - friendly file using heuristics and optional LLM support. | CLI · Local | [Docs](https://github.com/microsoft/repomix#readme) / [Repo](https://github.com/microsoft/repomix) |
- write-the - powered Python tool that auto-generates documentation and tests from code, and assists with refactoring. | CLI · Library · Local | [Docs](https://github.com/Wytamma/write-the#readme) / [Repo](https://github.com/Wytamma/write-the) |
- Documentation.AI
- ReadMe Agent & Ask AI
- Stenography - powered codebase documenter with API and editor extensions for automatic code explanations and docs. | API · IDE · Hosted | [Docs](https://stenography.dev) |
-
IDE assistants
- GitHub Copilot - of-github-copilot/about-github-copilot) |
- Qodo
-
Local LLM developer tools
- AutoGPTQ - only quantization of Transformer language models for efficient local inference. | Library · Local | [Docs](https://github.com/AutoGPTQ/AutoGPTQ#readme) / [Repo](https://github.com/AutoGPTQ/AutoGPTQ) |
- ChromaDB - style similarity search. | API · Library · Local | [Website](https://www.trychroma.com) / [Docs](https://docs.trychroma.com) / [Repo](https://github.com/chroma-core/chroma) |
- Docker Model Runner - integrated local model runtime that runs GGUF models via an OpenAI-compatible API. | API · CLI · Local | [Website](https://www.docker.com/products/model-runner) / [Docs](https://docs.docker.com/ai/model-runner/) |
- ExLlamaV2 - quantized LLMs on modern consumer GPUs with high performance. | CLI · Library · Local | [Docs](https://github.com/turboderp-org/exllamav2#readme) / [Repo](https://github.com/turboderp-org/exllamav2) |
- GPT4All - compatible API server on localhost. | API · Desktop · Library · Local | [Website](https://gpt4all.io) / [Docs](https://docs.gpt4all.io) / [Repo](https://github.com/nomic-ai/gpt4all) |
- Haystack - source framework for building RAG pipelines, agents, and semantic search over private data. | API · Framework · Local | [Docs](https://docs.haystack.deepset.ai) / [Repo](https://github.com/deepset-ai/haystack) |
- Intel Neural Compressor - source compression toolkit supporting quantization and pruning for deep learning and LLM workloads. | Library · Local | [Docs](https://intel.github.io/neural-compressor) / [Repo](https://github.com/intel/neural-compressor) |
- LiteLLM Gateway - in proxy that unifies many LLM providers behind an OpenAI-compatible API, with logging and rate limiting. | API · CLI · Self-hosted | [Docs](https://docs.litellm.ai) / [Repo](https://github.com/BerriAI/litellm) |
- LlamaIndex - llama/llama_index) |
- LLM Compressor - compressor/en/latest/) / [Repo](https://github.com/vllm-project/llm-compressor) |
- llm-llamafile - llamafile#readme) / [Repo](https://github.com/simonw/llm-llamafile) |
- LMDeploy - compatible API server for deploying multimodal models with LMDeploy on GPUs, locally or via Docker. | API · CLI · Self-hosted | [Website](https://lmdeploy.readthedocs.io) / [Docs](https://lmdeploy.readthedocs.io/en/latest/multi_modal/api_server_vl.html) / [Repo](https://github.com/InternLM/lmdeploy) |
- Mistral Inference - hosted | [Docs](https://github.com/mistralai/mistral-inference#readme) / [Repo](https://github.com/mistralai/mistral-inference) |
- mistral.rs - based engine for fast, flexible LLM inference with OpenAI-compatible APIs, web UI, and extensive quantization options. | API · CLI · Library · Web · Self-hosted | [Docs](https://github.com/EricLBuehler/mistral.rs/blob/master/docs/README.md) / [Repo](https://github.com/EricLBuehler/mistral.rs) |
- MLC LLM - hosted | [Website](https://mlc.ai) / [Docs](https://llmc-en.readthedocs.io/en/stable/backend/mlcllm.html) / [Repo](https://github.com/mlc-ai/mlc-llm) |
- MLX Engine for LM Studio - based inference engine used by LM Studio to run quantized text and vision models locally on macOS. | Library · Local | [Docs](https://github.com/lmstudio-ai/mlx-engine#readme) / [Repo](https://github.com/lmstudio-ai/mlx-engine) |
- mlx-lm - based Python package for running and fine-tuning LLMs on Apple silicon, with an HTTP server similar to OpenAI chat API. | API · CLI · Library · Local | [Docs](https://github.com/ml-explore/mlx-lm#readme) / [Repo](https://github.com/ml-explore/mlx-lm) |
- PydanticAI - based framework for building typed LLM apps and agents with validation, tools, and structured outputs. | Framework · Library · Local | [Docs](https://ai.pydantic.dev) / [Repo](https://github.com/pydantic/pydantic-ai) |
- TabbyAPI - based backend server for ExLlamaV2 that exposes local text generation over HTTP for coding and chat workloads. | API · Self-hosted | [Docs](https://github.com/theroyallab/tabbyAPI#readme) / [Repo](https://github.com/theroyallab/tabbyAPI) |
- Text Generation Inference - performance Rust and Python server for deploying and serving open-source LLMs via HTTP and gRPC. | API · CLI · Self-hosted | [Website](https://huggingface.co/docs/text-generation-inference) / [Docs](https://huggingface.co/docs/text-generation-inference/index) / [Repo](https://github.com/huggingface/text-generation-inference) |
- text-generation-webui - hosted Gradio/Web UI and API for running diverse local text generation models on CPUs and GPUs. | CLI · Web · Self-hosted | [Docs](https://github.com/oobabooga/text-generation-webui#readme) / [Repo](https://github.com/oobabooga/text-generation-webui) |
- WebLLM - browser LLM inference engine using WebGPU that exposes an OpenAI-compatible API surface for local models. | Library · Web · Local | [Website](https://webllm.mlc.ai) / [Docs](https://github.com/mlc-ai/web-llm#readme) / [Repo](https://github.com/mlc-ai/web-llm) |
-
MCP servers
- Anki MCP Server - repetition workflows. | MCP · Local | [Website](https://ankimcp.ai) / [Repo](https://github.com/ankimcp/anki-mcp-server) |
- ArXiv MCP Server - mcp-server) |
- Exa MCP Server - labs/exa-mcp-server) |
- Google MCP Servers
- Next.js DevTools MCP - devtools-mcp) |
- Playwright MCP Server - started-mcp) / [Repo](https://github.com/microsoft/playwright-mcp) |
- Supabase MCP Server - community/supabase-mcp) |
- Playwright Code Runner - related tool for running Playwright code as part of browser automation workflows. | MCP · Local | [Website](https://playwright.dev) / [Repo](https://github.com/exe-language/playwright-mcp) |
-
MCP tooling
- cheqd MCP Toolkit - toolkit#readme) / [Repo](https://github.com/cheqd/mcp-toolkit) |
- MCP C# SDK - sdk) |
- MCP Clients Registry - maintained registry mapping MCP client identifiers to official client names and metadata. | Library | [Repo](https://github.com/TianqiZhang/mcp-client-registry) |
- MCP Framework (QuantGeekDev) - first framework and CLI for building MCP servers with automatic discovery and multi-transport support. | CLI · Framework | [Docs](https://mcp-framework.com/) / [Repo](https://github.com/QuantGeekDev/mcp-framework) |
- MCP Registry Server (KBB99) - hosted | [Website](https://mcpservers.org/servers/KBB99/mcp-registry-server) / [Repo](https://github.com/KBB99/mcp-registry-server) |
- Model Context Protocol TypeScript SDK - sdk) |
- Smithery MCP Installer Server - hosted | [Repo](https://github.com/smithery-ai/smithery-cli-mcp) |
-
Repo automation tools
- auto-changelog (cookpete) - changelog) |
- automerge-action - pull-requests-automerge-action) / [Repo](https://github.com/pascalgn/automerge-action) |
- Bito AI Code Review Agent - code-review-agent/) / [Docs](https://docs.bito.ai/ai-code-reviews-in-git/install-run-using-bito-cloud/guide-for-github) |
- changelog-generator (jaywcjlove) - generator) |
- dbt-semguard - semguard#readme) / [Repo](https://github.com/yeaight7/dbt-semguard) |
- GitHub Dependabot - native service that configures and runs automated security and version dependency update pull requests. | GitHub app · Hosted | [Docs](https://docs.github.com/en/copilot/tutorials/copilot-chat-cookbook/analyze-security/manage-dependency-updates) |
- GitHub Stacked PRs (gh stack) - stack/) |
- GitHub Stale Action
- Pull Request Labeler (actions/labeler)
- Qodo-Cover - powered tool that automatically generates unit tests and improves code coverage, runnable as a CLI or in CI. | CLI · GitHub app · Hybrid | [Docs](https://github.com/qodo-ai/qodo-cover#readme) / [Repo](https://github.com/qodo-ai/qodo-cover) |
- Release Please - please-action) / [Repo](https://github.com/googleapis/release-please) |
- release-it - it/release-it) |
- Renovate
- semantic-release - release.gitbook.io/semantic-release/recipes/ci-configurations/github-actions) / [Repo](https://github.com/semantic-release/semantic-release) |
- Shelfi AI GitHub Bot - powered GitHub bot that analyzes pull requests and suggests documentation updates tied to code changes. | GitHub app · Web · Hosted | [Docs](https://shelfi.sh/features/github-ai-bot/) |
- stack-attack - attack) |
- stack-pr - pr) |
- stale-repos Action - repos) / [Repo](https://github.com/github/stale-repos) |
- UpdateBot - x/updatebot) |
-
Self-hosted AI dev stacks
- Clawix AI Platform - source, self-hosted multi-agent AI orchestration platform running agents in isolated Docker containers. | CLI · Web · Self-hosted | [Docs](https://github.com/ClawixAI/clawix#readme) / [Repo](https://github.com/ClawixAI/clawix) |
- DevBox AI Dev Stack - trust dev environment repository including an AI dev stack installer for Docker-based tools on a VPS. | CLI · Self-hosted | [Docs](https://github.com/gl0bal01/devbox#readme) / [Repo](https://github.com/gl0bal01/devbox) |
- Local LLM Docker (mythrantic) - hosted | [Docs](https://github.com/mythrantic/ollama-docker#readme) / [Repo](https://github.com/mythrantic/ollama-docker) |
- OpenRAG - source RAG stack combining Langflow, Docling, and OpenSearch with single-command Docker Compose deployment. | API · Web · Self-hosted | [Docs](https://github.com/langflow-ai/openrag#readme) / [Repo](https://github.com/langflow-ai/openrag) |
- Paddler - source LLMOps platform for hosting and scaling AI models in your own infrastructure. | API · CLI · Web · Self-hosted | [Docs](https://github.com/intentee/paddler#readme) / [Repo](https://github.com/intentee/paddler) |
- Pleng - hosted AI platform engineer that installs a Docker-based PaaS with AI agents and automation on your own cloud. | CLI · Web · Self-hosted | [Website](https://pleng.dev) / [Docs](https://github.com/mutonby/pleng#readme) / [Repo](https://github.com/mutonby/pleng) |
- Scalable Agentic RAG Platform (FareedKhan-dev) - grade agentic RAG platform with Kubernetes, Ray, LangGraph, and multi-plane architecture. | CLI · Self-hosted | [Docs](https://github.com/FareedKhan-dev/scalable-rag-pipeline#readme) / [Repo](https://github.com/FareedKhan-dev/scalable-rag-pipeline) |
- Self-hosted AI Package - source Docker Compose starter kit bundling Ollama, n8n, Supabase, Open WebUI, Flowise, Neo4j, Langfuse, and related tools. | API · Web · Self-hosted | [Website](https://sourceforge.net/projects/self-hosted-ai-package.mirror/) / [Repo](https://github.com/coleam00/ai-agents-masterclass) |
- Synaplan AI Platform - source, self-hosted AI platform with full stack deployment via Docker Compose and local inference via Ollama. | API · Web · Self-hosted | [Website](https://synaplan.com/solutions/developers) / [Docs](https://synaplan.com/docs) |
- Winy RAG Sample Stack - hosted | [Docs](https://github.com/mfranzon/winy#readme) / [Repo](https://github.com/mfranzon/winy) |
-
Terminal agents
-
-
Comparison Matrix
-
Automate repo work
- Athenaeum - hosted AI dev stacks | Yes | Yes | Yes | No | No | Yes | [Docs](https://github.com/herakles-dev/athenaeum#readme) / [Repo](https://github.com/herakles-dev/athenaeum) |
- Gemini CLI - code-assist/docs/gemini-cli) / [Repo](https://github.com/google-gemini/gemini-cli) |
- Goose - docs.ai/) / [Docs](https://goose-docs.ai/docs/quickstart/) / [Repo](https://github.com/aaif-goose/goose) |
-
Programming Languages
Sub Categories
Agent skill packs
24
Agent observability
23
Documentation agents
23
Local LLM developer tools
22
Agent evals
21
Test generation agents
20
Automate repo work
19
Repo automation tools
19
Browser agents
19
Coding agents
18
Self-hosted AI dev stacks
15
MCP servers
8
MCP tooling
7
Agent skills and plugins
5
Open-source coding agents
4
Local-first picks
3
MCP tools
3
IDE assistants
2
Terminal agents
1
Observability and evals
1
Keywords
llm
14
ai
13
python
9
agents
5
mcp-server
5
mcp
5
cursor
4
rag
4
generative-ai
4
llms
4
large-language-models
4
langchain
4
llmops
3
anthropic
3
model-context-protocol
3
codex
3
skills
3
automation
3
chatgpt
3
awesome
3
cursorrules
2
nlp
2
mlx
2
ai-assistant
2
pytorch
2
quantization
2
nextjs
2
transformers
2
agent-framework
2
anthropic-claude
2
multi-agent
2
agent
2
llm-evaluation
2
golang
2
prompt-engineering
2
rules
2
typescript
2
changelog
2
ai-coding
2
cli
2
claude
2
ollama
2
selenium
2
developer-tools
2
npm
2
openai
2
claude-code
2
github
2
mistralai
1
llm-gateway
1