An open API service indexing awesome lists of open source software.

https://github.com/webfuse-com/awesome-autoresearch

A curated list of autonomous improvement loops, research agents, and autoresearch-style systems inspired by Karpathy's autoresearch.
https://github.com/webfuse-com/awesome-autoresearch

List: awesome-autoresearch

agentic-systems ai-agents ai-research ai-tools autonomous-agents autoresearch awesome-list claude-code experiment-loops karpathy karpathy-inspired llm-agents research-agents scientific-discovery self-improving-systems

Last synced: 1 day ago
JSON representation

A curated list of autonomous improvement loops, research agents, and autoresearch-style systems inspired by Karpathy's autoresearch.

Awesome Lists containing this project

README

          

# πŸ”¬ Awesome Autoresearch

**A curated, high-signal index of autonomous improvement loops, research agents, and descendants inspired by** [**karpathy/autoresearch**](https://github.com/karpathy/autoresearch).

[![Awesome](https://awesome.re/badge.svg)](https://awesome.re)
[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat-square)](./CONTRIBUTING.md)
![License: CC0-1.0](https://img.shields.io/badge/license-CC0--1.0-blue.svg?style=flat-square)

## Contents

- [πŸ› οΈ General-purpose descendants](#-general-purpose-descendants)
- [πŸ”¬ Research-agent systems](#-research-agent-systems)
- [πŸ’» Platform ports and hardware forks](#-platform-ports-and-hardware-forks)
- [🎯 Domain-specific adaptations](#-domain-specific-adaptations)
- [πŸ“Š Evaluation & benchmarks](#-evaluation--benchmarks)
- [πŸ“ˆ Notable use cases and writeups](#-notable-use-cases-and-writeups)
- [πŸ“š Related resources](#-related-resources)
- [πŸ“„ License](#-license)

## πŸ› οΈ General-purpose descendants

- [kayba-ai/recursive-improve](https://github.com/kayba-ai/recursive-improve) - Recursive self-improvement framework where agents capture execution traces, analyze failure patterns, and apply targeted fixes with keep-or-revert evaluation. ![GitHub stars](https://img.shields.io/github/stars/kayba-ai/recursive-improve?style=social)
- [vukrosic/auto-research](https://github.com/vukrosic/auto-research) - Docs-only control plane for an open autonomous AI research lab β€” file-based operating model for human direction and agent execution. ![GitHub stars](https://img.shields.io/github/stars/vukrosic/auto-research?style=social)
- [uditgoenka/autoresearch](https://github.com/uditgoenka/autoresearch) - Claude Code skill that generalizes autoresearch into a reusable loop for software, docs, security, shipping, debugging, and other measurable goals. ![GitHub stars](https://img.shields.io/github/stars/uditgoenka/autoresearch?style=social)
- [leo-lilinxiao/codex-autoresearch](https://github.com/leo-lilinxiao/codex-autoresearch) - Codex-native autoresearch skill with resume support, lessons across runs, optional parallel experiments, and mode-specific workflows. ![GitHub stars](https://img.shields.io/github/stars/leo-lilinxiao/codex-autoresearch?style=social)
- [SeeleAI/Thoth](https://github.com/SeeleAI/Thoth) - Dashboard-first Claude Code and Codex runtime for autoresearch, with durable runs, locked work items, visible ledgers, and reviewable verdicts. ![GitHub stars](https://img.shields.io/github/stars/SeeleAI/Thoth?style=social)
- [supratikpm/gemini-autoresearch](https://github.com/supratikpm/gemini-autoresearch) - Gemini CLI skill that generalises autoresearch to any measurable goal. Gemini-native: uses Google Search grounding as a live verification source inside the loop, true headless overnight mode via --yolo --prompt, and 1M token context. Also works in Antigravity IDE via .agents/skills/. ![GitHub stars](https://img.shields.io/github/stars/supratikpm/gemini-autoresearch?style=social)
- [davebcn87/pi-autoresearch](https://github.com/davebcn87/pi-autoresearch) - `pi` extension plus dashboard for persistent experiment loops, live metrics, confidence tracking, and resumable autoresearch sessions. ![GitHub stars](https://img.shields.io/github/stars/davebcn87/pi-autoresearch?style=social)
- [drivelineresearch/autoresearch-claude-code](https://github.com/drivelineresearch/autoresearch-claude-code) - Claude Code plugin/skill port of `pi-autoresearch`, with a clean experiment-loop workflow and a concrete biomechanics case study. ![GitHub stars](https://img.shields.io/github/stars/drivelineresearch/autoresearch-claude-code?style=social)
- [greyhaven-ai/autocontext](https://github.com/greyhaven-ai/autocontext) - Closed-loop control plane for repeated agent improvement, with evaluation, persistent knowledge, staged validation, and optional distillation into cheaper local runtimes. ![GitHub stars](https://img.shields.io/github/stars/greyhaven-ai/autocontext?style=social)
- [Necmttn/ax](https://github.com/Necmttn/ax) - Local retro loop for AI coding agents: captures session traces, turns repeated friction into proposals, and tracks accepted fixes as experiments. ![GitHub stars](https://img.shields.io/github/stars/Necmttn/ax?style=social)
- [jmilinovich/goal-md](https://github.com/jmilinovich/goal-md) - Generalizes autoresearch into a `GOAL.md` pattern for repos where the agent must first construct a measurable fitness function before it can optimize. ![GitHub stars](https://img.shields.io/github/stars/jmilinovich/goal-md?style=social)
- [james-s-tayler/lazy-developer](https://github.com/james-s-tayler/lazy-developer) - Claude Code skill that orchestrates autoresearch across a prioritized sequence of optimization goals (coverage, test speed, build speed, complexity, LOC, performance) using GOAL.md as the engine. Supports standalone and Ralph Mode multi-instance execution. ![GitHub stars](https://img.shields.io/github/stars/james-s-tayler/lazy-developer?style=social)
- [mutable-state-inc/autoresearch-at-home](https://github.com/mutable-state-inc/autoresearch-at-home) - Collaborative fork of upstream autoresearch that adds experiment claiming, shared best-config syncing, hypothesis exchange, and swarm-style coordination across many single-GPU agents. ![GitHub stars](https://img.shields.io/github/stars/mutable-state-inc/autoresearch-at-home?style=social)
- [zkarimi22/autoresearch-anything](https://github.com/zkarimi22/autoresearch-anything) - Generalizes autoresearch to **any measurable metric** β€” system prompts, API performance, landing pages, test suites, config tuning, SQL queries. "If you can measure it, you can optimize it." ![GitHub stars](https://img.shields.io/github/stars/zkarimi22/autoresearch-anything?style=social)
- [Entrpi/autoresearch-everywhere](https://github.com/Entrpi/autoresearch-everywhere) - Cross-platform expansion that auto-detects hardware config and starts the loop. The "glue and generalization" half of autoresearch. ![GitHub stars](https://img.shields.io/github/stars/Entrpi/autoresearch-everywhere?style=social)
- [ShengranHu/ADAS](https://github.com/ShengranHu/ADAS) - **Automated Design of Agentic Systems** β€” ICLR 2025. Meta-agents that invent novel agent architectures by programming them in code. ![GitHub stars](https://img.shields.io/github/stars/ShengranHu/ADAS?style=social)
- [MaximeRobeyns/self_improving_coding_agent](https://github.com/MaximeRobeyns/self_improving_coding_agent) - **SICA**: Self-Improving Coding Agent that edits its own codebase. ICLR 2025 Workshop paper demonstrating scaffold-level self-improvement on coding benchmarks. ![GitHub stars](https://img.shields.io/github/stars/MaximeRobeyns/self_improving_coding_agent?style=social)
- [peterskoett/self-improving-agent](https://github.com/peterskoett/self-improving-agent) - Alternative self-improving agent architecture with reflection and meta-learning cycles. ![GitHub stars](https://img.shields.io/github/stars/peterskoett/self-improving-agent?style=social)
- [metauto-ai/HGM](https://github.com/metauto-ai/HGM) - **Huxley-GΓΆdel Machine** for coding agents β€” applies self-improvement to SWE-bench performance via meta-level optimization. ![GitHub stars](https://img.shields.io/github/stars/metauto-ai/HGM?style=social)
- [gepa-ai/gepa](https://github.com/gepa-ai/gepa) - **GEPA (Genetic-Pareto)** β€” ICLR 2026 Oral. Reflective prompt evolution that outperforms RL (GRPO) on benchmarks. Optimizes any textual parameters against any metric using natural language reflection. ![GitHub stars](https://img.shields.io/github/stars/gepa-ai/gepa?style=social)
- [sentient-agi/EvoSkill](https://github.com/sentient-agi/EvoSkill) - Automated skill discovery for coding agents: evolves reusable skills and prompts from failed trajectories against benchmarks, with support for Claude Code, Codex CLI, OpenCode, OpenHands, and Goose. ![GitHub stars](https://img.shields.io/github/stars/sentient-agi/EvoSkill?style=social)
- [MrTsepa/autoevolve](https://github.com/MrTsepa/autoevolve) - GEPA-inspired autoresearch for self-play: mutate code strategies, evaluate head-to-head, rate with Elo/Bradley-Terry, branch from the Pareto front. Agent reads match traces to target mutations. Works as a Claude Code skill. ![GitHub stars](https://img.shields.io/github/stars/MrTsepa/autoevolve?style=social)
- [HKUDS/ClawTeam](https://github.com/HKUDS/ClawTeam) - Agent swarm intelligence for autoresearch β€” spawns parallel GPU research directions, distributes work across agents, aggregates results. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/ClawTeam?style=social)
- [Orchestra-Research/AI-Research-SKILLs](https://github.com/Orchestra-Research/AI-Research-SKILLs) - Comprehensive skill library including autoresearch orchestration with two-loop architecture (inner optimization + outer synthesis). ![GitHub stars](https://img.shields.io/github/stars/Orchestra-Research/AI-Research-SKILLs?style=social)
- [WecoAI/aideml](https://github.com/WecoAI/aideml) - **AIDE**: Tree-search ML engineering agent that autonomously improves model performance via iterative code generation and evaluation. ![GitHub stars](https://img.shields.io/github/stars/WecoAI/aideml?style=social)
- [weco.ai](https://weco.ai) - **Weco**: Cloud platform for AIDE with observability, experiment tracking, and managed runs β€” brings the autoresearch loop into production.

## πŸ”¬ Research-agent systems

- [aiming-lab/AutoResearchClaw](https://github.com/aiming-lab/AutoResearchClaw) - End-to-end research pipeline that turns a topic into literature review, experiments, analysis, peer review, and paper drafts; broader than autoresearch, but clearly in the same lineage. ![GitHub stars](https://img.shields.io/github/stars/aiming-lab/AutoResearchClaw?style=social)
- [OpenRaiser/NanoResearch](https://github.com/OpenRaiser/NanoResearch) - End-to-end autonomous research engine that plans experiments, generates code, runs jobs locally or on SLURM, analyzes real results, and writes papers grounded in those outputs. ![GitHub stars](https://img.shields.io/github/stars/OpenRaiser/NanoResearch?style=social)
- [kaust-ark/ARK](https://github.com/kaust-ark/ARK) - **ARK (Automatic Research Kit)**: idea + venue β†’ paper pipeline orchestrating 6 agents β€” proposal analysis, literature search, Slurm experiments, LaTeX drafting, iterative peer review. Controlled via CLI, web dashboard, or Telegram. ![GitHub stars](https://img.shields.io/github/stars/kaust-ark/ARK?style=social)
- [wanshuiyin/Auto-claude-code-research-in-sleep](https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep) - Markdown-first research workflows for Claude Code and other agents, centered on autonomous literature review, experiments, paper iteration, and cross-model critique. ![GitHub stars](https://img.shields.io/github/stars/wanshuiyin/Auto-claude-code-research-in-sleep?style=social)
- [skyllwt/AutoSci](https://github.com/skyllwt/AutoSci) - Wiki-centric full-lifecycle research platform built on Claude Code, realizing Karpathy's LLM-Wiki vision. 20+ skills cover the full loop: ingest β†’ ideate β†’ novelty check β†’ experiment design / run / eval β†’ paper writing. Research state lives in a structured knowledge wiki with an interactive graph. ![GitHub stars](https://img.shields.io/github/stars/skyllwt/AutoSci?style=social)
- [Sibyl-Research-Team/AutoResearch-SibylSystem](https://github.com/Sibyl-Research-Team/AutoResearch-SibylSystem) - Fully autonomous AI scientist built on Claude Code, with explicit AutoResearch lineage, multi-agent research iteration, GPU experiment execution, and a self-evolving outer loop. ![GitHub stars](https://img.shields.io/github/stars/Sibyl-Research-Team/AutoResearch-SibylSystem?style=social)
- [eimenhmdt/autoresearcher](https://github.com/eimenhmdt/autoresearcher) - Early open-source package for automating scientific workflows, currently centered on literature-review generation with an ambition toward broader autonomous research. ![GitHub stars](https://img.shields.io/github/stars/eimenhmdt/autoresearcher?style=social)
- [hyperspaceai/agi](https://github.com/hyperspaceai/agi) - Distributed, peer-to-peer research network where autonomous agents run experiments, gossip findings, maintain CRDT leaderboards, and archive results to GitHub across multiple research domains. ![GitHub stars](https://img.shields.io/github/stars/hyperspaceai/agi?style=social)
- [Human-Agent-Society/CORAL](https://github.com/Human-Agent-Society/CORAL) - **CORAL**: Autonomous multi-agent evolution for open-ended discovery ([arXiv:2604.01658](https://arxiv.org/abs/2604.01658)). Long-running agents with shared persistent memory, asynchronous execution, and heartbeat-based interventions; SOTA on 10 math/algorithmic/systems tasks. ![GitHub stars](https://img.shields.io/github/stars/Human-Agent-Society/CORAL?style=social)
- [SakanaAI/AI-Scientist](https://github.com/SakanaAI/AI-Scientist) - **The AI Scientist**: First comprehensive system for fully automatic scientific discovery. From idea generation to paper writing with minimal human supervision. ![GitHub stars](https://img.shields.io/github/stars/SakanaAI/AI-Scientist?style=social)
- [SakanaAI/AI-Scientist-v2](https://github.com/SakanaAI/AI-Scientist-v2) - Workshop-level automated scientific discovery via agentic tree search. Removes template dependency from v1, generalizes across research domains. ![GitHub stars](https://img.shields.io/github/stars/SakanaAI/AI-Scientist-v2?style=social)
- [AweAI-Team/AiScientist](https://github.com/AweAI-Team/AiScientist) - **AiScientist**: long-horizon ML research lab with hierarchical orchestration and File-as-Bus coordination β€” workspace files act as the durable system of record. Drives autonomous paper-reproduction (PaperBench) and competition-style MLE-Bench iteration loops under fixed compute/time budgets. ([arXiv 2604.13018](https://arxiv.org/abs/2604.13018)) ![GitHub stars](https://img.shields.io/github/stars/AweAI-Team/AiScientist?style=social)
- [HKUDS/AI-Researcher](https://github.com/HKUDS/AI-Researcher) - NeurIPS 2025 paper. Full end-to-end research automation: hypothesis β†’ experiments β†’ manuscript β†’ peer review. Production version at [novix.science](https://novix.science/chat). ![GitHub stars](https://img.shields.io/github/stars/HKUDS/AI-Researcher?style=social)
- [openags/Auto-Research](https://github.com/openags/Auto-Research) - **OpenAGS**: Orchestrates a team of AI agents across the full research lifecycle β€” lit review, hypothesis generation, experiments, manuscript writing, and peer review. ![GitHub stars](https://img.shields.io/github/stars/openags/Auto-Research?style=social)
- [SamuelSchmidgall/AgentLaboratory](https://github.com/SamuelSchmidgall/AgentLaboratory) - End-to-end autonomous research workflow: idea β†’ literature review β†’ experiments β†’ report. Supports both autonomous and co-pilot modes. ![GitHub stars](https://img.shields.io/github/stars/SamuelSchmidgall/AgentLaboratory?style=social)
- [AgentRxiv](https://agentrxiv.github.io/) - Collaborative autonomous research framework where agent laboratories share a preprint server to build on each other's work iteratively.
- [JinheonBaek/ResearchAgent](https://github.com/JinheonBaek/ResearchAgent) - Iterative research idea generation over scientific literature with LLMs. Multi-agent review and feedback loops. ![GitHub stars](https://img.shields.io/github/stars/JinheonBaek/ResearchAgent?style=social)
- [du-nlp-lab/MLR-Copilot](https://github.com/du-nlp-lab/MLR-Copilot) - Autonomous ML research framework β€” generates ideas, implements experiments, analyzes results. ![GitHub stars](https://img.shields.io/github/stars/du-nlp-lab/MLR-Copilot?style=social)
- [MASWorks/ML-Agent](https://github.com/MASWorks/ML-Agent) - Reinforcing LLM agents for autonomous ML engineering. Learns from trial and error to improve model performance. ![GitHub stars](https://img.shields.io/github/stars/MASWorks/ML-Agent?style=social)
- [PouriaRouzrokh/LatteReview](https://github.com/PouriaRouzrokh/LatteReview) - Low-code Python package for **automated systematic literature reviews** via AI-powered agents. ![GitHub stars](https://img.shields.io/github/stars/PouriaRouzrokh/LatteReview?style=social)
- [LitLLM/LitLLM](https://github.com/LitLLM/LitLLM) - AI-powered literature review assistant using RAG for accurate, well-structured related-work sections in academic writing. ![GitHub stars](https://img.shields.io/github/stars/LitLLM/LitLLM?style=social)
- [Agent Laboratory](https://agentlaboratory.github.io/) - Three-phase research pipeline: Literature Review β†’ Experimentation β†’ Report Writing, with specialized agents for each phase.

## πŸ’» Platform ports and hardware forks

- [gianfrancopiana/openclaw-autoresearch](https://github.com/gianfrancopiana/openclaw-autoresearch) - OpenClaw port of pi-autoresearch; autonomous experiment loop for any optimization target with statistical confidence scoring. ![GitHub stars](https://img.shields.io/github/stars/gianfrancopiana/openclaw-autoresearch?style=social)
- [miolini/autoresearch-macos](https://github.com/miolini/autoresearch-macos) - Widely adopted macOS fork that adapts upstream autoresearch for Apple Silicon / MPS while preserving the original loop shape. ![GitHub stars](https://img.shields.io/github/stars/miolini/autoresearch-macos?style=social)
- [trevin-creator/autoresearch-mlx](https://github.com/trevin-creator/autoresearch-mlx) - MLX-native Apple Silicon port that keeps the upstream fixed-budget `val_bpb` loop while removing the PyTorch/CUDA dependency entirely. ![GitHub stars](https://img.shields.io/github/stars/trevin-creator/autoresearch-mlx?style=social)
- [jsegov/autoresearch-win-rtx](https://github.com/jsegov/autoresearch-win-rtx) - Windows-native RTX fork focused on consumer NVIDIA GPUs, with explicit VRAM floors and a practical desktop setup path. ![GitHub stars](https://img.shields.io/github/stars/jsegov/autoresearch-win-rtx?style=social)
- [iii-hq/n-autoresearch](https://github.com/iii-hq/n-autoresearch) - Multi-GPU autoresearch infrastructure with structured experiment tracking, adaptive search strategy, crash recovery, and queryable orchestration around the classic `train.py` loop. ![GitHub stars](https://img.shields.io/github/stars/iii-hq/n-autoresearch?style=social)
- [lucasgelfond/autoresearch-webgpu](https://github.com/lucasgelfond/autoresearch-webgpu) - Browser/WebGPU port that lets agents generate training code, run experiments in-browser, and feed results back into the loop without a Python setup. ![GitHub stars](https://img.shields.io/github/stars/lucasgelfond/autoresearch-webgpu?style=social)
- [tonitangpotato/autoresearch-engram](https://github.com/tonitangpotato/autoresearch-engram) - Fork with **persistent cognitive memory** β€” frequency-weighted retrieval of cross-session knowledge for improved experiment continuity. ![GitHub stars](https://img.shields.io/github/stars/tonitangpotato/autoresearch-engram?style=social)
- [Colab/Kaggle T4 port](https://github.com/karpathy/autoresearch/issues/208) - Adapts autoresearch for free T4 GPUs (Google Colab / Kaggle) with zero cost and zero local setup. Key changes: Flash Attention 3 β†’ PyTorch SDPA, removes H100-only kernel dependency.
- [ArmanJR-Lab/autoautoresearch](https://github.com/ArmanJR-Lab/autoautoresearch) - Jetson AGX Orin port with a **director** β€” a Go binary that acts as a "creative director" injecting novelty (arxiv papers + DeepSeek Reasoner) into the loop to escape local minima. Includes multi-experiment comparison (baseline vs director-guided) with detailed stall analysis. ![GitHub stars](https://img.shields.io/github/stars/ArmanJR-Lab/autoautoresearch?style=social)

## 🎯 Domain-specific adaptations

- [mattprusak/autoresearch-genealogy](https://github.com/mattprusak/autoresearch-genealogy) - Applies the autoresearch pattern to genealogy, using structured prompts, archive guides, source checks, and vault workflows to iteratively expand and verify family-history research. ![GitHub stars](https://img.shields.io/github/stars/mattprusak/autoresearch-genealogy?style=social)
- [ArchishmanSengupta/autovoiceevals](https://github.com/ArchishmanSengupta/autovoiceevals) - Uses adversarial callers plus keep-or-revert prompt edits to harden voice AI agents across Vapi, Smallest AI, and ElevenLabs. ![GitHub stars](https://img.shields.io/github/stars/ArchishmanSengupta/autovoiceevals?style=social)
- [chrisworsey55/atlas-gic](https://github.com/chrisworsey55/atlas-gic) - Applies the autoresearch keep-or-revert loop to trading agents, optimizing prompts and portfolio orchestration against rolling Sharpe ratio instead of model loss. ![GitHub stars](https://img.shields.io/github/stars/chrisworsey55/atlas-gic?style=social)
- [RightNow-AI/autokernel](https://github.com/RightNow-AI/autokernel) - Applies the autoresearch loop to GPU kernel optimization: profile bottlenecks, edit one kernel, benchmark, keep or revert, repeat. ![GitHub stars](https://img.shields.io/github/stars/RightNow-AI/autokernel?style=social)
- [ElliotXie/autozyme](https://github.com/ElliotXie/autozyme) - Multi-agent framework that applies the autoresearch keep-or-revert loop to CPU-side scientific software: profile a target function, generate one optimization candidate, benchmark for speed while preserving the original outputs, keep or revert, repeat. ![GitHub stars](https://img.shields.io/github/stars/ElliotXie/autozyme?style=social)
- [Agent-Analytics/autoresearch-growth](https://github.com/Agent-Analytics/autoresearch-growth) - Applies autoresearch to landing-page positioning and A/B test candidates, using analytics snapshots and measured experiment results to seed subsequent rounds. ![GitHub stars](https://img.shields.io/github/stars/Agent-Analytics/autoresearch-growth?style=social)
- [Rkcr7/autoresearch-sudoku](https://github.com/Rkcr7/autoresearch-sudoku) - Enhanced autoresearch workflow where an AI agent iteratively rewrites and benchmarks a Rust sudoku solver, ultimately beating leading human-built solvers on hard benchmark sets. ![GitHub stars](https://img.shields.io/github/stars/Rkcr7/autoresearch-sudoku?style=social)
- [jeongph/autospec](https://github.com/jeongph/autospec) - Reads natural-language business rules and autonomously builds a Spring Boot service with tests via the keep-or-revert loop. Evaluates with Gradle build + JUnit XML. 119-line skeleton to 950 lines in 5 cycles. ![GitHub stars](https://img.shields.io/github/stars/jeongph/autospec?style=social)
- [vlasenkoalexey/tpu_performance_autoresearch_wiki](https://github.com/vlasenkoalexey/tpu_performance_autoresearch_wiki) - Applies the autoresearch keep-or-revert loop to TPU model performance (MFU / tokens-per-sec) on v6e hardware: profiles each run through an XProf MCP server, makes one model-code change per experiment, and keeps or reverts against measured MFU. Pairs the loop with a Karpathy-style LLM wiki for domain knowledge and per-experiment optimization traces; includes Llama3-8B and Qwen3-8B case studies across JAX and torchax lanes. ![GitHub stars](https://img.shields.io/github/stars/vlasenkoalexey/tpu_performance_autoresearch_wiki?style=social)

## πŸ“Š Evaluation & benchmarks

- [snap-stanford/MLAgentBench](https://github.com/snap-stanford/MLAgentBench) - Benchmark suite for evaluating AI agents on ML experimentation tasks. 13 tasks from CIFAR-10 to BabyLM. ![GitHub stars](https://img.shields.io/github/stars/snap-stanford/MLAgentBench?style=social)
- [OpenAI/mle-bench](https://github.com/openai/mle-bench) - OpenAI's benchmark for measuring how well AI agents perform at ML engineering. ![GitHub stars](https://img.shields.io/github/stars/openai/mle-bench?style=social)
- [chchenhui/mlrbench](https://github.com/chchenhui/mlrbench) - MLR-Bench: Evaluating AI agents on open-ended ML research. 201 tasks from NeurIPS/ICLR/ICML workshops. ![GitHub stars](https://img.shields.io/github/stars/chchenhui/mlrbench?style=social)
- [gersteinlab/ML-Bench](https://github.com/gersteinlab/ML-Bench) - Evaluates LLMs and agents for ML tasks on repository-level code. ![GitHub stars](https://img.shields.io/github/stars/gersteinlab/ML-Bench?style=social)
- [THUDM/AgentBench](https://github.com/THUDM/AgentBench) - Comprehensive benchmark for LLM-as-Agent evaluation across 8 distinct environments. ICLR 2024. ![GitHub stars](https://img.shields.io/github/stars/THUDM/AgentBench?style=social)

## πŸ“ˆ Notable use cases and writeups

- [Shopify Liquid optimization](https://github.com/Shopify/liquid/pull/2056) - Tobi LΓΌtke shared an autoresearch-style optimization run on Shopify's Liquid engine, with public traces showing major parse/render speedups and allocation reductions. ([tweet](https://x.com/tobi/status/2032212531846971413))
- [Driveline baseball biomechanics](https://x.com/drivelinekyle/status/2032242254035992610) - Public autoresearch-style experiment loop for pitch-velocity prediction from biomechanics data, with large reported gains in model quality.
- [Tennis XGBoost prediction + reward hacking writeup](https://nickoak.com/posts/tennis-xgboost-autoresearch/) - Nick Oak documents an autoresearch-inspired loop for tennis match prediction, including where the optimization setup went wrong. ([repo](https://github.com/buildoak/tennis-xgboost-autoresearch) Β· [gamed branch](https://github.com/buildoak/tennis-xgboost-autoresearch/tree/archived/gamed-iterations))
- [Vesuvius Challenge ink detection swarm](https://scrollprize.substack.com/p/we-are-cooking) - Multi-agent experimental loop applied to ancient-scroll ink detection, with a strong writeup on cross-scroll generalization improvements.
- [Earth system model optimization](https://paragiri.com/blog/2026/autoresearch-earth-system-models/) - Hybrid workflow where an LLM proposes equation structures and a search process tunes parameters, showing how the autoresearch pattern extends into scientific modeling. ([tweet](https://x.com/devparagiri/status/2035075626273739068))
- [The Agentic Researcher](https://arxiv.org/html/2603.15914) - Paper: "A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning." Cites autoresearch as the canonical example of automated ML experiment pipelines.
- [Scaling Autoresearch to GPU Clusters](https://blog.skypilot.co/scaling-autoresearch/) - SkyPilot blog on running autoresearch on H100/H200 clusters with cloud orchestration.
- [Self-Improving Coding Agents](https://addyosmani.com/blog/self-improving-agents/) - Addy Osmani's practical guide to setting up self-improving agent loops with Claude Code.
- [autoresearch@home: Distributed AI Research](https://ensue.dev/blog/autoresearch-at-home/) - SETI@home model applied to autoresearch β€” contribute GPU time to collective model optimization.
- [Claude Code + AutoResearch for Self-Improving Skills](https://www.mindstudio.ai/blog/claude-code-autoresearch-self-improving-skills) - MindStudio guide to building self-improving AI skills using Claude Code with autoresearch patterns.
- [100 ML Experiments Overnight](https://particula.tech/blog/karpathy-autoresearch-autonomous-ml-experiments) - Particula technical breakdown with domain-agnostic fork applications.
- [PM's Guide to Autoresearch](https://www.news.aakashg.com/p/autoresearch-guide-for-pms) - Product manager's guide covering setup, community forks, and real-world applications.
- [Autoresearch 101 Builder's Playbook](https://sidsaladi.substack.com/p/autoresearch-101-builders-playbook) - Substack deep-dive on applying autoresearch patterns to prompts, agents, and workflows with concrete examples.
- [Kingy AI Technical Breakdown](https://kingy.ai/ai/autoresearch-karpathys-minimal-acid-loop-for-autonomous-llm-experimentation/) - Detailed technical walkthrough of the autoresearch loop architecture, mutation operators, and fitness function design.
- [Fortune Feature](https://fortune.com/2026/03/17/andrej-karpathy-loop-autonomous-ai-agents-future/) - Business and industry context on why autoresearch matters for the future of autonomous AI agents.

## πŸ“š Related resources

Curated lists and paper collections for AI agents, autonomous systems, and automated research:

- [ai-agents-2030/awesome-deep-research-agent](https://github.com/ai-agents-2030/awesome-deep-research-agent) - Curated list of deep research agent papers and systems. ![GitHub stars](https://img.shields.io/github/stars/ai-agents-2030/awesome-deep-research-agent?style=social)
- [YoungDubbyDu/LLM-Agent-Optimization](https://github.com/YoungDubbyDu/LLM-Agent-Optimization) - Papers on LLM agent optimization methods. ![GitHub stars](https://img.shields.io/github/stars/YoungDubbyDu/LLM-Agent-Optimization?style=social)
- [VoltAgent/awesome-ai-agent-papers](https://github.com/VoltAgent/awesome-ai-agent-papers) - Curated AI agent papers from 2026 β€” agent engineering, memory, evaluation, workflows, and autonomous systems. ![GitHub stars](https://img.shields.io/github/stars/VoltAgent/awesome-ai-agent-papers?style=social)
- [masamasa59/ai-agent-papers](https://github.com/masamasa59/ai-agent-papers) - AI agent research papers updated biweekly via automated arxiv search with curated selection. ![GitHub stars](https://img.shields.io/github/stars/masamasa59/ai-agent-papers?style=social)
- [tmgthb/Autonomous-Agents](https://github.com/tmgthb/Autonomous-Agents) - Autonomous agents research papers, updated daily. ![GitHub stars](https://img.shields.io/github/stars/tmgthb/Autonomous-Agents?style=social)
- [HKUST-KnowComp/Awesome-LLM-Scientific-Discovery](https://github.com/HKUST-KnowComp/Awesome-LLM-Scientific-Discovery) - EMNLP 2025 survey on LLMs in scientific discovery. ![GitHub stars](https://img.shields.io/github/stars/HKUST-KnowComp/Awesome-LLM-Scientific-Discovery?style=social)
- [openags/Awesome-AI-Scientist-Papers](https://github.com/openags/Awesome-AI-Scientist-Papers) - Collection of AI Scientist / Robot Scientist papers. ![GitHub stars](https://img.shields.io/github/stars/openags/Awesome-AI-Scientist-Papers?style=social)
- [agenticscience.github.io](https://agenticscience.github.io/) - Survey: "From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery."
- [dspy.ai/GEPA](https://dspy.ai/api/optimizers/GEPA/overview/) - DSPy integration of GEPA reflective prompt optimizer for compound AI systems.
- [OpenAI Cookbook: Self-Evolving Agents](https://developers.openai.com/cookbook/examples/partners/self_evolving_agents/autonomous_agent_retraining) - Cookbook for autonomous agent retraining using GEPA-style reflective evolution.
- [WecoAI/awesome-autoresearch](https://github.com/WecoAI/awesome-autoresearch) - Curated list of AutoResearch use cases with verifiable traces and progress charts, organized by domain (LLM training, GPU kernels, voice agents, trading, etc.). ![GitHub stars](https://img.shields.io/github/stars/WecoAI/awesome-autoresearch?style=social)

## πŸ“„ License

This list is released under [CC0-1.0](./LICENSE).