Projects in Awesome Lists tagged with agent-testing

https://github.com/langwatch/scenario

Agentic testing for agentic codebases

agent-simulations agent-testing ai-testing javascript-library python-library

Last synced: 08 Mar 2026

https://github.com/LeoYeAI/myclaw-bench

The definitive benchmark for AI agents on OpenClaw. 45 tasks across 4 tiers. Powered by MyClaw.ai

agent-testing ai-agent ai-benchmark benchmark llm-evaluation myclaw openclaw

Last synced: 26 Jun 2026

https://github.com/dowhiledev/nomos

Ship agents you can audit.

agent agent-testing agentic-ai flow-based-agent step-guided-agent

Last synced: 01 Apr 2026

https://github.com/inkog-io/inkog

The pre-flight check for AI agents

agent-testing ai-security cli devsecops golang llm-security owasp owasp-llm-top-10 sast security-tools static-analysis

Last synced: 13 Apr 2026

https://github.com/deep-codeai/agents.kt

Typed Kotlin DSL framework for AI agent systems.

a2a agent-framework agent-oriented-programming agent-testing agentic-framework agentic-workflow ai ai-agents automation compile-time-safety dsl graalvm jvm kotlin kotlin-dsl llm mcp multi-agent-systems open-source type-safety

Last synced: 29 May 2026

https://github.com/vitron-ai/themis

Intent-first unit testing framework for AI agents in Node.js and TypeScript.

agent-testing ai ai-agents ai-testing developer-tools llm nodejs test-framework testing typescript unit-testing

Last synced: 18 Apr 2026

https://github.com/soapbucket/mcptest

The test suite your MCP server is missing. Tool, resource, agent-loop, schema-drift, compliance, and security tests against any Model Context Protocol server, in CI on every commit. One YAML suite, deterministic cassette replay, multi-model comparison, and LLM-judge evals. Rust, Apache-2.0.

agent-testing ai-agents anthropic compliance conformance developer-tools evals llm llm-as-a-judge llm-as-a-jury llm-evaluation llm-testing mcp mcp-testing openai security test-automation testing

Last synced: 26 Jun 2026

https://github.com/kimtth/agent-auto-eval-azure-aoai-sk

Agent testing automation 🤖 by simulating users 👥 and agents 🤝 with judge ⚖️(langwatch-scenario)

agent-testing azure-openai scenario semantic-kernel

Last synced: 05 Aug 2025

https://github.com/vitron-ai/alethia-anvil

Alethia's reference app + Playwright/PW-MCP benchmark. Fork to evaluate Alethia against your own agent or reproduce the numbers.

agent-testing alethia benchmark e2e-testing mcp playwright

Last synced: 06 Jun 2026

https://github.com/lacausecrypto/mcp-wallfacer

Runtime testing harness for MCP servers: fuzz tools, validate schemas, run YAML invariants and multi-step sequences, ship SARIF to CI. 17 embedded packs · stdio + HTTP · 5 install paths.

agent-testing cli fuzzing invariant-testing llm-tools mcp mcp-sdk mcp-server mcp-tools model-context-protocol property-testing runtime-testing rust sarif security testing validation