Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with dspy

A curated list of projects in awesome lists tagged with dspy .

https://github.com/langwatch/langwatch

The platform for LLM evaluations and AI agent testing

ai analytics datasets dspy evaluation gpt llm llm-ops llmops low-code observability openai prompt-engineering

Last synced: 27 Aug 2026

https://github.com/teilomillet/gollm

Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.

ai anthropic dspy genai generative-ai generative-ai-tools go golang groq language-model llm openai prompt-engineering prompt-optimization structured-output

Last synced: 13 May 2025

https://github.com/Haozhe-Xing/agent_learning

A systematic AI Agent development tutorial covering LLM agents, RAG, tool use, memory systems, multi-agent systems, LangChain, LangGraph, MCP, and agentic RL.｜从零开始学 AI Agent 开发 | 系统、全面、实战导向的 Agent 开发教程 | 每日自动追踪 arXiv 最新论文 | Learn AI Agent Development from Scratch

agent-learning agentic-workflow ai-agent ai-agent-tutorial dspy grpo langchain large-language-models llm mcp memory-system multi-agents rag

Last synced: 31 Jul 2026

https://github.com/GenseeAI/cognify

Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower execution latency, and lower execution cost. Also has a simple agent/workflow framework

agent agentic-workflow agents ai automl autotuning dspy langchain langgraph model-selection optimization prompt-tuning

Last synced: 21 Jul 2025

https://github.com/genseeai/cognify

Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower execution latency, and lower execution cost. Also has a simple agent/workflow framework

agent agentic-workflow agents ai automl autotuning dspy langchain langgraph model-selection optimization prompt-tuning

Last synced: 08 Oct 2025

https://github.com/tom-doerr/dspy_nodes

WIP - Allows you to create DSPy pipelines using ComfyUI

agents comfyui comfyui-nodes dspy llms

Last synced: 13 May 2025

https://github.com/weaviate/structured-rag

Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models

dspy retrieval-augmented-generation structured-generation

Last synced: 10 Mar 2026

https://github.com/RamXX/zettelvault

Transform an Obsidian vault into PARA + Zettelkasten structure using DSPy and RLM

dspy dspy-rlm obsidian zettelkasten

Last synced: 07 Apr 2026

https://github.com/technoculture/personal-graph

Simple Graph Memory for AI applications

database dspy graph sqlite3 vector-database

Last synced: 13 May 2025

https://github.com/evalops/dspy-micro-agent

Minimal agent runtime built with DSPy modules and a thin Python loop. Includes CLI, FastAPI server, and eval harness with OpenAI/Ollama support.

agent agent-runtime ai cli dspy fastapi llm ollama openai python

Last synced: 05 Apr 2026

https://github.com/cmpnd-ai/dspy-cli

dspy-cli is a tool for creating, developing, testing, and deploying DSPy programs as HTTP APIs.

dspy

Last synced: 24 Dec 2025

https://github.com/ngshya/easyrag

Build your own RAG and run it locally on your laptop: ColBERT + DSPy + Streamlit

chatbot colbert-ai dspy genai rag streamlit

Last synced: 13 May 2025

https://github.com/S1M0N38/dspy-arxiv

Explore the use of DSPy for extracting features from PDFs 🔎

arxiv classification dspy nlp prompt-engineering

Last synced: 06 May 2025

https://github.com/s1m0n38/dspy-arxiv

Explore the use of DSPy for extracting features from PDFs 🔎

arxiv classification dspy nlp prompt-engineering

Last synced: 04 Sep 2025

https://github.com/mbakgun/dspy-examples

This codebase demonstrates various DSPy functionalities through practical examples.

ai dspy dspy-ai llm python

Last synced: 13 May 2025

https://github.com/neoxelox/dspy-inspector

DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.

dspy dspy-inspector inspector jupyter jupyter-notebook notebook pipeline plugin program vscode widget

Last synced: 04 Sep 2025

https://github.com/Neoxelox/dspy-inspector

DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.

dspy dspy-inspector inspector jupyter jupyter-notebook notebook pipeline plugin program vscode widget

Last synced: 06 May 2025

https://github.com/zerosumeval/zerosumeval

A framework for pitting LLMs against each other in an evolving library of games ⚔

dspy games large-language-models llm-evaluation open-source prompt-optimization

Last synced: 13 May 2025

https://github.com/OmidZamani/dspy-skills

Collection of Claude Skills for DSPy framework - program language models, optimize prompts, and build RAG pipelines systematically

agent-skills claude-code claude-skills dspy llm prompt-optimization rag

Last synced: 07 Feb 2026

https://github.com/aptible/unpage

Unpage is the open source framework for building SRE agents with infrastructure context and secure access to any dev tool.

agent agentic-workflow agents ai-agent ai-sre aiops automation devops dspy incident-response incident-response-tooling mcp monitoring observability site-reliability-engineering sre sre-agent

Last synced: 08 Sep 2025

https://github.com/jmanhype/aidevos

🤖 AIDevOS: AI-Driven Autonomous DevOps System | Multi-agent collaboration framework with DSPy integration for automated application development and deployment via Durable Objects

artificial-intelligence automation autonomous-systems devops dspy durable-objects llm microservices multi-agent

Last synced: 10 Oct 2025

https://github.com/voicetestdev/voicetest

Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM judges.

bland dspy livekit llm retell testing vapi voice-ai

Last synced: 19 Apr 2026

https://github.com/ramxx/fridaymusic

Determines your "mood" for the week and uses AI to generate a music playlist.

ai dspy roon

Last synced: 13 May 2025

https://github.com/iowarp/clio-agent

A science agent supporting any general AI agent in performing data management operations at scale. Builds upon the heritage of the IOWarp platform and proudly represents work done at Gnosis Research Center at Illinois Tech. Supported by NSF.

a2a ai ai4hpc ai4science dspy hpc hpc-ai mcp

Last synced: 05 Jun 2026

https://github.com/jbeno/sentiment

Sentiment analysis of DynaSent and SST reviews using ELECTRA and GPT collaboration

dspy dynasent electra-model gpt-4o gpt-4o-mini sentiment-analysis sentiment-classification sst

Last synced: 13 May 2025

https://github.com/strategic-automation/arachne

DSPy-native autonomous AI agent runtime — describe your goal, Arachne weaves the agent graph, executes with full observability, and evolves on failure.

agent-runtime agents ai autonomous-agents dspy graph-orchestration llm pydantic python self-healing

Last synced: 01 Jul 2026

https://github.com/shresthakamal/understanding-dspy

Understanding DSPy with RAG approach

dspy genai generative-ai llm openai

Last synced: 13 May 2025

https://github.com/ovshake/bookstore-copilot

A PoC of using Weaviate + DSPy to make a BookStore CoPilot

dspy rag vector-database

Last synced: 11 Oct 2025

https://github.com/ashad001/roomaligner

A focus on aligning room elements for better flow and space utilization.

dspy dspy-ai floorplan groq interior-design llama3-2-vision llm raster roboflow vlm

Last synced: 13 May 2025

https://github.com/ten24bytes/dspy-demo

A comprehensive demonstration project for DSPy, showcasing various advanced features and patterns for programming foundation models.

dspy dspy-ai python

Last synced: 20 Apr 2026

https://github.com/Strategic-Automation/arachne

DSPy-native autonomous AI agent runtime — describe your goal, Arachne weaves the agent graph, executes with full observability, and evolves on failure.

agent-runtime agents ai autonomous-agents dspy graph-orchestration llm pydantic python self-healing

Last synced: 30 Jun 2026

https://github.com/cs194group/multi-agent-misconceptions

A multi-agent system predicting student misconceptions using the Exchange-of-Thought (EoT) framework, utilizing dspy and OpenAI to process questions, generate misconceptions, and evaluate semantic similarities.

dspy eot machine-learning multi-agent-systems openai-api

Last synced: 13 May 2025

https://github.com/gulabpatel/llms

Alpaca, Bloom, DeciLM, Falcon, Vicuna, Llama2, Zephyr, Mistral(MoE), RAG, Reranking, Langchain, Langsmith..

alpaca bloom dolly2 dollyv2 dspy langchain llama2 mixtral rag reranking stablevicuna vicuna

Last synced: 13 May 2025

https://github.com/ttcs60cntt3/meta-ai-orchestrator

🐙 Meta-AI Orchestrator unifies multiple LLMs with dynamic routing, RAG search, and DAG pipelines for enterprise AI workloads across providers, with observability and QA.

async automation context-management copilot dspy game-ai-framework llm llm-orchestration machine-learning multi-agent-systems multi-llm openai opentelemetry performance prompt-optimization rag vector-database workflow

Last synced: 07 Apr 2026

https://github.com/viig99/step_dspy

STEP Web agent for WebArena using dspy.

agents dspy dspy-ai step

Last synced: 13 Feb 2026

https://github.com/awebisam/deconstruction_toolkit

An LLM proxy to kill hidden narratives in texts.

dspy llm vibe-coding

Last synced: 03 Jul 2025

https://github.com/vicentereig/dspy.rb

The Ruby framework for programming—rather than prompting—language models.

ai dspy llm rails ruby

Last synced: 07 Mar 2026

https://github.com/avnlp/rag-pipelines

Advanced RAG Pipelines and Evaluation: Self-Reflective RAG, Corrective RAG, Adaptive RAG, Sub-Query Generation and Routing, DSPy, DeepEval

crag deepeval dspy llm pinecone rag self-rag

Last synced: 13 May 2025

https://github.com/ako1983/llm_research_assistant

An AI-powered research assistant that leverages Retrieval-Augmented Generation (RAG) to provide accurate responses to user queries by retrieving relevant documents and reasoning through complex questions.

agent-based-modeling agents anthropic chromadb dspy langchain-python langgraph-python llm openai rag reasoning

Last synced: 11 Apr 2026

https://github.com/tenemos/langwatch

The open LLM Ops platform - Traces, Analytics, Evaluations, Datasets and Prompt Optimization ✨

ai analytics datasets dspy evaluation gpt llm llmops low-code observability openai prompt-engineering

Last synced: 20 Apr 2026

https://github.com/evalops/override-cascade-dspy

DSPy framework for detecting and preventing safety override cascades in LLM systems. Research-grade implementation for studying when completion urgency overrides safety constraints.

ai-safety cognitive-architecture dspy llm-evaluation llm-safety machine-learning override-cascade python research-framework safety-research

Last synced: 19 Sep 2025

https://github.com/kuzudb/dspy-kuzu-demo

Intro to using DSPy with Kuzu for an entity resolution task on the Nobel Laureate mentorship network

data-engineering dspy entity-resolution graph graph-database knowledge-graph kuzu llm

Last synced: 18 Apr 2026

https://github.com/zombat/scrub-mcp

A 22-tool MCP server and CI-ready CLI that cuts cloud LLM token usage on code quality tasks. Deterministic tools handle what they can. A local LLM (via DSPy) handles the rest. Cloud models plan and review. Nothing else.

agentic-workflows ai-agents claude-code code-quality code-review devsecops devtools dspy knowledge-distillation linting local-llm mcp mcp-server model-context-protocol python refactoring ruff sbom static-analysis

Last synced: 28 Aug 2026

https://github.com/zhijiexiong/dspy-application

Learning and Application of DSPY Framework

dspy llm

Last synced: 04 May 2026

https://github.com/alessandroannini/dspy-llm-evaluator

An evaluation framework for Large Language Model (LLM) responses using DSPy.

dspy python rouge

Last synced: 24 Apr 2026

https://github.com/gokayfem/dspy-ollama-colab

dspy with ollama and llamacpp on google colab

agents colab-notebook dspy evals evaluation llamacpp llm ollama vlm

Last synced: 06 May 2026

https://github.com/bryaneburr/dorgy

An LLM-powered command line tool to automatically organize your files and directories

command-line-tool dspy llms python

Last synced: 04 Nov 2025

https://github.com/lm-150a/docflash

⚡ AI-powered document processing with structured data extraction. Self-improving prompts, customizable templates, and feedback learning. Supports PDFs, multiple AI providers.

ai dspy information-extraction langextract large-language-models llm nlp ocr python structured-data

Last synced: 19 Aug 2025

https://github.com/mjoudy/rag_dspy

This repository implements a Retrieval-Augmented Generation (RAG) pipeline using the DSPy library.

dspy faiss huggingface llm rag vector-database

Last synced: 07 May 2026

https://github.com/eddyayalagil/override-cascade-dspy

🌐 Detect and prevent safety overrides in LLM systems with this DSPy-based framework, ensuring actions align with safety constraints.

ai-safety cognitive-architecture dspy llm-evaluation llm-safety machine-learning override-cascade python research-framework safety-research

Last synced: 19 May 2026

https://github.com/rdhillbb/ozzss

Agentic application built on Langchain and DSPy

cloud dspy genai-chatbot golang groq langchain llama3 openai python3

Last synced: 15 Apr 2026

https://github.com/ghost146767/openai-agents-python

🤖 Build efficient multi-agent workflows with the OpenAI Agents SDK, supporting OpenAI APIs and 100+ other LLMs for flexible solutions.

agent agent-runtime agentops ai4science api chatgpt cli crewai cursor cursor-agent-tools dspy evals evaluation-metrics framework language-model ollama openai python

Last synced: 30 Apr 2026

https://github.com/uberkael/dspick

AI Shell Completions: Like Navi, but with DSPy under the hood. Ask, Get a CLI command, Done.

agent cheatsheets dspy llms python shell

Last synced: 17 Apr 2026

https://github.com/gayanukaa/essay-evaluator-llm

Build and compare performance of essay evaluator in DSPy

dspy llm local-model sentiment-analysis

Last synced: 17 Apr 2026

https://github.com/memari-majid/agentic-ai-systems

Mastering Agentic AI: Design, Orchestration, and Application

agent ai design dspy langchain langgraph python

Last synced: 07 May 2026

https://github.com/feelice/prompt-studio

🧩 Prompt Studio — a single-file, bilingual (中/EN) prompt generator for LLMs, coding/automation agents & image models. 88 templates, a composable prompt dictionary, promptfoo/DSPy export. No install, runs locally.

ai-agents bilingual chatgpt claude dspy gemini llm midjourney prompt-engineering prompt-generator prompt-templates promptfoo prompts single-file stable-diffusion

Last synced: 27 Jun 2026

https://github.com/talmago/nomenclator

AI-powered Harmonized System (HS) nomenclature toolkit for classification, retrieval, and customs reasoning.

ai-agents bm25 commodity-classification customs dspy harmonized-system hs-classification hs-code hybrid-search rag semantic-search tariff-classification trade-compliance

Last synced: 30 Jul 2026

https://github.com/luucaslfs/nutrigenius

Repositório do NutriGenius, assistente nutricional interativo.

agents dspy gpt llms

Last synced: 17 Apr 2026

https://github.com/nivlewd1/prompt-optimizer

MCP Server that offers high-performance prompt optimization server with real-time streaming, pattern-based enhancement, and comprehensive session management capabilities.

dspy mcp-server prompt-engineering

Last synced: 18 May 2026

https://github.com/voteblake/graph-tot-dspy

Graph Tree-of-Thought with Agent-based retrieval in DSPy

dspy dspy-ai knowledge-graph

Last synced: 04 Apr 2026

https://github.com/vansh-khaneja/chat-multiple-docs-indexify

This GitHub Repository will help you to follow up in making a RAG application to chat with multiple PDFs at a single time with Indexify as the Vector DB, DSPy as framework along with Llama 3 as the language model

dspy indexify llama3 python rag

Last synced: 09 Apr 2026

https://github.com/ganggreentempertatum/dspy-examples

my DSPy playground

agents dspy python

Last synced: 05 May 2026

https://github.com/debu-sinha/coco-reference

CoCo - reference implementation of a natural-language cohort copilot on Databricks. DSPy ReAct agent + Mosaic AI Agent Framework + Lakebase + MLflow Prompt Registry + Unity Catalog + Databricks Apps.

agent databricks dspy healthcare lakebase mlflow mosaic-ai rag reference-implementation unity-catalog

Last synced: 02 May 2026

https://github.com/davidhaas6/hellaprompt

A package for improving and evaluating LLM prompts

automated-prompt-engineering dspy prompt-generator prompt-optimization

Last synced: 04 May 2026

https://github.com/sagarmaddela/math-tutor-an-agentic-rag-model

Math Routing Agent is an Agentic-RAG (Retrieval-Augmented Generation) system designed to replicate a mathematics professor. It provides step-by-step math solutions by intelligently routing queries through knowledge base and web search

dspy guardrails human-in-the-loop langgraph qdrant tavily-mcp

Last synced: 16 May 2026

https://github.com/katerynazakharova/llm-examples

Examples of LLM utilisation: chatbots, fine-tuning, RAG, vector databases

chromadb dspy gpt-35-turbo gpt4 langchain llm rag vector-database

Last synced: 05 May 2026

https://github.com/ztripez/dspy-pdf-rag

A reusable DSPy module for PDF retrieval and question answering with ChromaDB caching and LiteLLM support

chromadb dspy embeddings litellm llm pdf rag retrieval-augmented-generation

Last synced: 07 May 2026

https://github.com/haz3141/ai-dev-lab

AI-Enhanced Dev Lab v3.0 — lab/app split, MCP, DSPy, RAG

ai dev-lab dspy github-actions mcp rag

Last synced: 07 Apr 2026

https://github.com/vericle/intellyweave

AI-powered platform for OSINT intelligence analysis. Features archive discovery with hypothesis-driven investigation, GLiNER entity extraction, Mapbox geospatial visualization, network analysis, and document processing. Built with FastAPI, Next.js, Weaviate, and DSPy.

ai-agents archival-research document-processing dspy entity-extraction fastapi geospatial-visualization gliner historical-research intelligence-analysis knowledge-graph mapbox network-analysis nextjs osint python rag typescript vector-database weaviate

Last synced: 31 Jan 2026

https://github.com/sanskarpan/promptline

Calibrate -> Optimize -> Gate -> Serve: automatic prompt optimization with a calibrated LLM judge, statistical deploy gating, and a versioned serving registry. GEPA/MIPRO/ProTeGi/OPRO from scratch.

dspy evaluation fastapi gepa llm llm-as-judge mlops prompt-engineering prompt-optimization react

Last synced: 29 Jul 2026

https://github.com/evalops/bandit_dspy

A DSPy library for security-aware LLM development using Bandit.

bandit dspy security

Last synced: 15 Apr 2026

https://github.com/chiphennig/dspy-gamerec

Prompt engineering with DSPy to recommend video games

dspy llm prompt-engineering

Last synced: 18 Apr 2026

https://github.com/aadarshvelu/news-archive

Public archive of AI news — deduplicated, AI-summarized, categorized, auto-pushed twice daily by the syndicate pipeline.

ai-news ai-summaries auto-updated dspy json-dataset llm-generated news-archive news-dataset ollama public-dataset summarization syndicate

Last synced: 14 Jul 2026

https://github.com/aryaminus/dspy-proxy

A REST API server for DSPy that enables language model programming from any language. This proxy exposes DSPy's core functionality - signature registration, module execution, optimization, and evaluation - through HTTP endpoints, making it accessible from non-Python environments.

ai chain-of-thought dspy fastapi llm-optimization machine-learning microservice nlp prompt-engineering proxy-server rest-api

Last synced: 12 May 2026

https://github.com/heymumford/cognilateral-trust

AI that tells you when it's guessing. Confidence tiers + accountability for AI agents. pip install cognilateral-trust

accountability agents ai anthropic confidence crewai dspy epistemic guardrails langgraph llm openai python safety trust

Last synced: 01 Apr 2026