Awesome-Prompt-Engineering
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
https://github.com/promptslab/Awesome-Prompt-Engineering
Last synced: 18 days ago
JSON representation
-
AI Content Detectors
-
Apis
- [Anthropic
- [HuggingFace - Source |
- [OpenAI
-
APIs
-
Anthropic (Claude)
-
Google (Gemini)
-
Meta (Llama)
-
OpenAI
-
Other Notable Providers
-
-
π¬ Autonomous Research & Self-Improving Agents
-
Domain-Specific Adaptations
- mattprusak/autoresearch-genealogy - history research.
- ArchishmanSengupta/autovoiceevals - or-revert prompt edits to harden voice AI agents across Vapi, Smallest AI, and ElevenLabs.
- chrisworsey55/atlas-gic - or-revert loop to trading agents, optimizing prompts and portfolio orchestration against rolling Sharpe ratio instead of model loss.
- RightNow-AI/autokernel
- Rkcr7/autoresearch-sudoku - built solvers on hard benchmark sets.
- jeongph/autospec - language business rules and autonomously builds a Spring Boot service with tests via the keep-or-revert loop. Evaluates with Gradle build + JUnit XML. 119-line skeleton to 950 lines in 5 cycles.
- Agent-Analytics/autoresearch-growth - page positioning and A/B test candidates, using analytics snapshots and measured experiment results to seed subsequent rounds.
- ElliotXie/autozyme - agent framework that applies the autoresearch keep-or-revert loop to CPU-side scientific software: profile a target function, generate one optimization candidate, benchmark for speed while preserving the original outputs, keep or revert, repeat.
- vlasenkoalexey/tpu_performance_autoresearch_wiki - or-revert loop to TPU model performance (MFU / tokens-per-sec) on v6e hardware: profiles each run through an XProf MCP server, makes one model-code change per experiment, and keeps or reverts against measured MFU. Pairs the loop with a Karpathy-style LLM wiki for domain knowledge and per-experiment optimization traces; includes Llama3-8B and Qwen3-8B case studies across JAX and torchax lanes.
-
Evaluation & Benchmarks
- snap-stanford/MLAgentBench - 10 to BabyLM.
- chchenhui/mlrbench - Bench: Evaluating AI agents on open-ended ML research. 201 tasks from NeurIPS/ICLR/ICML workshops.
- gersteinlab/ML-Bench - level code.
- THUDM/AgentBench - as-Agent evaluation across 8 distinct environments. ICLR 2024.
-
General-Purpose Descendants
- kayba-ai/recursive-improve - improvement framework where agents capture execution traces, analyze failure patterns, and apply targeted fixes with keep-or-revert evaluation.
- vukrosic/auto-research - only control plane for an open autonomous AI research lab β file-based operating model for human direction and agent execution.
- uditgoenka/autoresearch
- leo-lilinxiao/codex-autoresearch - native autoresearch skill with resume support, lessons across runs, optional parallel experiments, and mode-specific workflows.
- supratikpm/gemini-autoresearch - native: uses Google Search grounding as a live verification source inside the loop, true headless overnight mode via --yolo --prompt, and 1M token context. Also works in Antigravity IDE via .agents/skills/.
- davebcn87/pi-autoresearch
- drivelineresearch/autoresearch-claude-code - autoresearch`, with a clean experiment-loop workflow and a concrete biomechanics case study.
- greyhaven-ai/autocontext - loop control plane for repeated agent improvement, with evaluation, persistent knowledge, staged validation, and optional distillation into cheaper local runtimes.
- jmilinovich/goal-md
- james-s-tayler/lazy-developer - instance execution.
- mutable-state-inc/autoresearch-at-home - config syncing, hypothesis exchange, and swarm-style coordination across many single-GPU agents.
- zkarimi22/autoresearch-anything
- Entrpi/autoresearch-everywhere - platform expansion that auto-detects hardware config and starts the loop. The "glue and generalization" half of autoresearch.
- ShengranHu/ADAS - agents that invent novel agent architectures by programming them in code.
- MaximeRobeyns/self_improving_coding_agent - Improving Coding Agent that edits its own codebase. ICLR 2025 Workshop paper demonstrating scaffold-level self-improvement on coding benchmarks.
- peterskoett/self-improving-agent - improving agent architecture with reflection and meta-learning cycles.
- metauto-ai/HGM - GΓΆdel Machine** for coding agents β applies self-improvement to SWE-bench performance via meta-level optimization.
- gepa-ai/gepa - Pareto)** β ICLR 2026 Oral. Reflective prompt evolution that outperforms RL (GRPO) on benchmarks. Optimizes any textual parameters against any metric using natural language reflection.
- MrTsepa/autoevolve - inspired autoresearch for self-play: mutate code strategies, evaluate head-to-head, rate with Elo/Bradley-Terry, branch from the Pareto front. Agent reads match traces to target mutations. Works as a Claude Code skill.
- HKUDS/ClawTeam
- Orchestra-Research/AI-Research-SKILLs - loop architecture (inner optimization + outer synthesis).
- WecoAI/aideml - search ML engineering agent that autonomously improves model performance via iterative code generation and evaluation.
- weco.ai
- sentient-agi/EvoSkill
- SeeleAI/Thoth - first Claude Code and Codex runtime for autoresearch, with durable runs, locked work items, visible ledgers, and reviewable verdicts.
- Necmttn/ax
- junjunjunbong/research-loop - style Agent Skill for Codex and Claude Code with a deterministic runner, plan-hash approval, isolated Git worktrees, authoritative metric evaluation, and an append-only experiment ledger.
- xieyulai/steer
-
GitHub Organizations
- awesome-autoresearch - 04-09
-
Platform Ports & Hardware Forks
- gianfrancopiana/openclaw-autoresearch - autoresearch; autonomous experiment loop for any optimization target with statistical confidence scoring.
- miolini/autoresearch-macos
- trevin-creator/autoresearch-mlx - native Apple Silicon port that keeps the upstream fixed-budget `val_bpb` loop while removing the PyTorch/CUDA dependency entirely.
- jsegov/autoresearch-win-rtx - native RTX fork focused on consumer NVIDIA GPUs, with explicit VRAM floors and a practical desktop setup path.
- iii-hq/n-autoresearch - GPU autoresearch infrastructure with structured experiment tracking, adaptive search strategy, crash recovery, and queryable orchestration around the classic `train.py` loop.
- lucasgelfond/autoresearch-webgpu - browser, and feed results back into the loop without a Python setup.
- tonitangpotato/autoresearch-engram - weighted retrieval of cross-session knowledge for improved experiment continuity.
- upstream issue #208
- ArmanJR-Lab/autoautoresearch - experiment comparison (baseline vs director-guided) with detailed stall analysis.
-
Related Resources
- ai-agents-2030/awesome-deep-research-agent
- YoungDubbyDu/LLM-Agent-Optimization
- VoltAgent/awesome-ai-agent-papers
- masamasa59/ai-agent-papers
- tmgthb/Autonomous-Agents
- HKUST-KnowComp/Awesome-LLM-Scientific-Discovery
- openags/Awesome-AI-Scientist-Papers
- agenticscience.github.io
- dspy.ai/GEPA
- OpenAI Cookbook: Self-Evolving Agents - style reflective evolution.
- WecoAI/awesome-autoresearch
-
Research-Agent Systems
- aiming-lab/AutoResearchClaw - to-end research pipeline that turns a topic into literature review, experiments, analysis, peer review, and paper drafts; broader than autoresearch, but clearly in the same lineage.
- OpenRaiser/NanoResearch - to-end autonomous research engine that plans experiments, generates code, runs jobs locally or on SLURM, analyzes real results, and writes papers grounded in those outputs.
- wanshuiyin/Auto-claude-code-research-in-sleep - first research workflows for Claude Code and other agents, centered on autonomous literature review, experiments, paper iteration, and cross-model critique.
- Sibyl-Research-Team/AutoResearch-SibylSystem - agent research iteration, GPU experiment execution, and a self-evolving outer loop.
- eimenhmdt/autoresearcher - source package for automating scientific workflows, currently centered on literature-review generation with an ambition toward broader autonomous research.
- hyperspaceai/agi - to-peer research network where autonomous agents run experiments, gossip findings, maintain CRDT leaderboards, and archive results to GitHub across multiple research domains.
- SakanaAI/AI-Scientist
- SakanaAI/AI-Scientist-v2 - level automated scientific discovery via agentic tree search. Removes template dependency from v1, generalizes across research domains.
- HKUDS/AI-Researcher - to-end research automation: hypothesis β experiments β manuscript β peer review. Production version at [novix.science](https://novix.science/chat).
- openags/Auto-Research
- SamuelSchmidgall/AgentLaboratory - to-end autonomous research workflow: idea β literature review β experiments β report. Supports both autonomous and co-pilot modes.
- AgentRxiv
- JinheonBaek/ResearchAgent - agent review and feedback loops.
- du-nlp-lab/MLR-Copilot
- MASWorks/ML-Agent
- PouriaRouzrokh/LatteReview - code Python package for **automated systematic literature reviews** via AI-powered agents.
- LitLLM/LitLLM - powered literature review assistant using RAG for accurate, well-structured related-work sections in academic writing.
- Agent Laboratory - phase research pipeline: Literature Review β Experimentation β Report Writing, with specialized agents for each phase.
- Human-Agent-Society/CORAL - agent evolution for open-ended discovery ([arXiv:2604.01658](https://arxiv.org/abs/2604.01658)). Long-running agents with shared persistent memory, asynchronous execution, and heartbeat-based interventions; SOTA on 10 math/algorithmic/systems tasks.
- skyllwt/OmegaWiki - centric full-lifecycle research platform built on Claude Code, realizing Karpathy's LLM-Wiki vision. 20+ skills cover the full loop: ingest β ideate β novelty check β experiment design / run / eval β paper writing. Research state lives in a structured knowledge wiki with an interactive graph.
- AweAI-Team/AiScientist - horizon ML research lab with hierarchical orchestration and File-as-Bus coordination β workspace files act as the durable system of record. Drives autonomous paper-reproduction (PaperBench) and competition-style MLE-Bench iteration loops under fixed compute/time budgets. ([arXiv 2604.13018](https://arxiv.org/abs/2604.13018))
- kaust-ark/ARK
- skyllwt/AutoSci - centric full-lifecycle research platform built on Claude Code, realizing Karpathy's LLM-Wiki vision. 20+ skills cover the full loop: ingest β ideate β novelty check β experiment design / run / eval β paper writing. Research state lives in a structured knowledge wiki with an interactive graph.
- happyhappy-jun/writing-driven-autoresearch - style harness that keeps a submittable paper from the first minute and drives every experiment from the claims in that draft, looping modify β measure β verify β revise. 1st place at the [Ralphthon@ICML 2026](https://luma.com/hjuo7auc) autonomous-research hackathon.
- AutoResearch-Factory/Agon - to-end research orchestrator built on one cornerstone principle, Prompt Economy (reusable loops, not one-off prompts), plus five supporting rules; runs scientist/coder/auditor loops across 10+ disciplines, same reusable-loop lineage as autoresearch but scaled to full research programs.
-
-
Communities
-
Discord Servers
- Learn Prompting
- Hugging Face Discord
- FlowGPT - E, Stable Diffusion, Claude.
-
Forums and Platforms
- OpenAI Developer Community
- Hugging Face Community - source AI collaboration.
- DeepLearning.AI Community
- LessWrong - depth technical posts on AI capabilities and safety.
- AI Alignment Forum
- CivitAI
-
GitHub Organizations
- LangChain - source LLM app framework. 100K+ stars.
- Promptslab - Engineering | LLMs
- Hugging Face
- OpenAI - source models, benchmarks, and tools.
-
Reddit
- r/PromptEngineering
- r/ChatGPT
- r/LocalLLaMA - source LLMs locally.
- r/ClaudeAI
- r/MachineLearning - oriented ML research discussions.
- r/OpenAI
- r/StableDiffusion
- r/ChatGPTPromptGenius
-
-
Courses
-
Free Platform Courses
- Hugging Face LLM Course - driven course covering transformers, fine-tuning, building reasoning models.
- Hugging Face AI Agents Course
-
Free Short Courses
- Building Systems with the ChatGPT API - step LLM system design for production. (DeepLearning.AI)
- AI Agents in LangGraph
- Building Agentic RAG with LlamaIndex
- Functions, Tools and Agents with LangChain
-
University and Platform Courses
- Prompt Engineering Specialization (Vanderbilt) - course series by Dr. Jules White covering foundational to advanced PE. (Coursera)
- Generative AI with LLMs (DeepLearning.AI + AWS)
- Stanford CS336: Language Modeling from Scratch - to-end. (Stanford, 2024β2026)
- MIT 6.S191: Introduction to Deep Learning
- The Complete Prompt Engineering for AI Bootcamp - 5, DSPy, LangGraph, agent architectures. 58K+ ratings. (Udemy, updated Feb 2026)
-
- ChatGPT Prompt Engineering for Developers
- Prompt Engineering for Vision Models
- ChatGPT for Everyone
- Introduction to Prompt Engineering
- Advanced Prompt Engineering
- Introduction to Generative AI Agents for Business Professionals
- Introduction to Prompt Hacking
- Introduction to Generative AI in Marketing
- Advanced Prompt Hacking
- Image Creation with DALLΒ·E 3
- AI Safety
- Runway ML for Everyone
- Advanced OpenAI Playground
- Boost Your Day-to-Day Efficiency With Generative AI
- Introduction to Large Language Models (LLMs) for Business Professionals
- Introduction to Retrieval-Augmented Generation (RAG) for Business Professionals
- Introduction to Generative AI for Business Professionals
-
-
Datasets
-
Datasets and Benchmarks
-
Leaderboards and Meta-Benchmarks
-
Major Benchmarks (2024β2026)
-
Prompt and Instruction Datasets
-
Red Teaming and Adversarial Datasets
-
-
Models
Programming Languages
Categories
Sub Categories
Vibe Coding and AI Coding Assistants
42
General-Purpose Descendants
28
Research-Agent Systems
25
Agent Frameworks
17
Community and Independent Guides
14
Related Resources
11
Major Benchmarks (2024β2026)
11
Red Teaming and Prompt Security
9
Reasoning Advances
9
Domain-Specific Adaptations
9
Platform Ports & Hardware Forks
9
MCP (Model Context Protocol)
8
Prompt Injection and Security
8
Prompt Optimization and Automatic Prompting
8
LLM Evaluation Tools
8
Major Surveys
8
Prompt Management and Testing
8
Reddit
8
Agentic Prompting and Multi-Agent Systems
7
Other Notable Repositories
7
Free and Research Detectors
6
Forums and Platforms
6
GitHub Organizations
5
University and Platform Courses
5
Evaluation & Benchmarks
4
Multimodal Prompting
4
Free Short Courses
4
Other Notable Providers
4
Discord Servers
3
Prompt Compression
3
Official Provider Guides
3
Leaderboards and Meta-Benchmarks
3
Prompt and Instruction Datasets
3
Free Platform Courses
2
In-Context Learning
2
Red Teaming and Adversarial Datasets
2
Leading Commercial Detectors
2
Prompt Optimization Tools
2
Applications of Prompt Engineering
2
Foundational Papers (Pre-2024)
1
Structured Output and Format Control
1
Meta (Llama)
1
Google (Gemini)
1
OpenAI
1
Anthropic (Claude)
1
Keywords
ai
40
llm
40
agents
22
openai
19
ai-agents
18
mcp
17
prompt-engineering
17
chatgpt
14
python
13
developer-tools
13
llmops
12
llms
12
claude-code
12
machine-learning
10
large-language-models
10
open-source
9
autoresearch
9
agentic-ai
9
agent
9
anthropic
8
autonomous-agents
8
cli
8
llm-evaluation
8
rag
8
framework
7
gpt-3
7
typescript
7
gpt-4
7
evaluation
7
claude
6
prompts
6
codex
6
deep-learning
6
generative-ai
6
artificial-intelligence
6
llm-agents
5
langchain
5
genai
5
awesome-list
5
mcp-server
5
transformers
5
orchestration
4
multi-agent
4
multi-agent-systems
4
self-hosted
4
ai-tools
4
language-model
4
vibe-coding
4
harness
4
autonomous-research
4