Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

awesome-testing

A curated list of testing resources
https://github.com/TheJambo/awesome-testing

Last synced: about 16 hours ago
JSON representation

  • Blogs

  • Books

  • Newsletters

    • Mind Mapping & Documentation

      • Coding Jag - Your weekly dose of the latest in Testing, Development, CI/CD, and Automation—keeping you ahead of the curve."
      • Coding Jag - Your weekly dose of the latest in Testing, Development, CI/CD, and Automation—keeping you ahead of the curve."

    • Other

  • Others

  • QA and Testing Road Map

    • Useful References

      • QALadder - A free, sequenced roadmap from manual QA to SDET, with a 150-question interview bank, browser-based practice labs, and QA tools.

  • Software

    • A/B Testing

      • Kirro - A/B testing tool with visual editor, Bayesian statistics, and GA4 conversion tracking.
      • Kirro - A/B testing tool with visual editor, Bayesian statistics, and GA4 conversion tracking.

    • Accessibility & Usability Testing

      • RatedWithAI - AI-powered website accessibility scanner that checks for ADA and WCAG 2.2 compliance with instant actionable audits.
      • WAVE - Suite of evaluation tools that helps authors make their web content more accessible to individuals with disabilities.
      • VertaaUX CLI - UX, accessibility, and conversion audits from the terminal and CI, with score-based quality gates and PR regression detection.
      • RatedWithAI - AI-powered website accessibility scanner that checks for ADA and WCAG 2.2 compliance with instant actionable audits.
      • squirrelscan - Audits websites for accessibility, SEO, performance, and security with 260+ rules and returns exact fixes for your coding agent, from the CLI, cloud, or MCP.
      • Site Punchlist - Crawls a whole site with axe-core and groups repeated findings by the shared component causing them, so one fix covers every page it appears on. Publishes which WCAG 2.2 criteria automation can and cannot reach. Free five-page scan, no account.
      • Site Punchlist - Crawls a whole site with axe-core and groups repeated findings by the shared component causing them, so one fix covers every page it appears on. Publishes which WCAG 2.2 criteria automation can and cannot reach. Free five-page scan, no account.

    • AI & LLM Testing

      • promptfoo - Open-source framework for testing and red teaming LLM applications. Compare prompts, test RAG architectures, run multi-turn adversarial attacks, and catch security vulnerabilities with CI/CD integration.
      • voicetest - Open-source test harness for voice AI agents supporting Retell, VAPI, LiveKit, and Bland with autonomous simulations and LLM-based evaluation.
      • Litmus - Record and replay AI agent LLM calls deterministically for testing and CI, with fault injection and reliability scoring.
      • Tenro - Open-source testing framework for AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.
      • AgentSkeptic - Verifies AI/agent workflows by checking database state after execution, comparing expected vs observed outcomes with read-only SQL.
      • Evaliphy - Test your AI system end-to-end with Evaliphy. It uses a Playwright-style testing approach and generates HTML reports.
      • nika - Workflow engine for AI with testing built in: `nika test` pins a workflow's offline behavior as a golden snapshot (deterministic mock provider, zero keys) and replays it in CI; every run also leaves a hash-chained trace for post-hoc verification.
      • QASkills.sh - Open registry of 400+ QA and testing skills (Playwright, API, LLM evaluation, accessibility, performance) that AI coding agents install and follow via the qaskills CLI. Works with Claude Code, Cursor, and 30+ other agents.
      • crilio - An open-source Python CLI that uses LLM-as-a-Judge to automate semantic regression testing for LLM prompts in CI/CD, blocking GitHub PRs that cause hallucinations or break formatting rules. Supports OpenAI, Anthropic, and local Ollama models.
      • aiexpect - Python assertions for non-deterministic AI text that drop into pytest. Semantic and rule checks work offline; optional LLM judge with your own model; produces a Trust Score and a single-file HTML report.
      • OrcaReplay - Records a coding-agent session below the harness, keeping the verbatim request and response bytes, then replays the same run offline with the network off or forks it from a checkpoint onto other models with a verify command deciding the verdict.
      • flight-recorder - Record every nondeterministic input your code reads (LLM answers, HTTP, database, clock, randomness) as one JSONL tape per request, then replay the tape against the real code offline, bit for bit, with the first divergence named. Open format with Python, Node, .NET, Go, Java and PHP implementations.

    • API Testing

      • Zato API Test - API testing in plain English with extendable Python implementation.
      • Keploy - API Testing Platform that automatically generates unit test cases along with dependency mocks.
      • RestQA - REST API testing framework based on Gherkin.
      • CORS Tester - A tool for developers and API testers to check if an API is CORS-enabled for a given domain and identify gaps.
      • Tests Coverage Tool - Ultimate tool to measure gRPC service coverage from tests.
      • Swagger Coverage Tool - The Swagger Coverage Tool is designed to measure API test coverage based on Swagger documentation. It provides automated tracking and reporting of test coverage for APIs, helping ensure that your endpoints and services are well-tested.
      • SpecTest - Truly declarative API testing framework in Js, or plain JSON.
      • BitDive - Zero-code API testing platform for Java/Kotlin. Captures deep runtime context (HTTP, SQL, methods), auto-generates mocks from real traffic, and enables Live Context Replay for E2E testing and debugging.
      • Vedika API - Vedic astrology API with free sandbox environment for testing. Includes Postman collection, 108+ endpoints, and AI-powered chatbot API for integration testing.
      • Webhook Debugger & Logger - Enterprise-grade tool for testing, debugging, and logging incoming webhooks in real-time.
      • Webhook Debugger - Open-source, self-hosted webhook inspector with signature verification support.
      • Spiderhash - Webhook debugging and request inspection tool for testing callback payloads, headers, and delivery behavior.
      • Polarity - The First AI QA Engineer that does full E2E, API, UI testing. Understands your entire codebase and ensures all relavent tests are conducted with our long running agent setup.
      • Bruno - Open-source API client for exploring and testing APIs.
      • KushoAI - AI-native platform for API contract testing, end-to-end testing, UI testing, and continuous security scanning, with self-healing tests that automatically adapt to code changes in CI/CD.
      • postman2pytest - Convert a Postman Collection v2.1 JSON file into a ready-to-run pytest test suite.
      • funapi - A free mock REST API service designed for practicing API testing, automation, and integration with realistic scenarios and endpoints.

    • Browser Extensions & Utilities

      • Bug Magnet - Field-based value suggestions for form testing.
      • Full Page Screenshot - Capture full-page screenshots.
      • Form Filler - Auto-fill large forms with dummy data.
      • ProxySwitcher - Easy proxy switching for test/prod environments.
      • BugShot - Capture a bug as a screenshot, a screen or tab recording, or a 30-second replay, with console, network, and user action logs collected automatically. Reports go straight from the browser to Jira, GitHub, Linear, Notion, GitLab, Asana, ClickUp, or Slack, with no third-party server in between. Open source, MIT.
      • Anchor Browser - Cloud browser infrastructure with built-in stealth and proxy rotation for automated testing at scale
      • TabQA - Connect, mirror, and control Android devices directly in Chrome via WebUSB without ADB; capture logs, inspect network requests, and record bug reproduction video buffers.

    • Make your life easier

      • Octomind - auto-generated, run and maintained Playwright tests with AI-powered test case discovery.
      • Courgette - Beautifully simple UI testing. Proper declarative BDD scenarios using Gherkin, Gherkin templates and composable YAML-style page and component objects.
      • BareTail - Brings the tail linux command to Windows, coloured lines and REGEX search and loads of other features.
      • ProxySwitcher - We all have to mess with proxies, this makes it a lot easier when using Test/Prod/localhost proxies.
      • Form Filler - Large forms can be really irritating to fill out each time, speed it up with dummy data.
      • Bug Magnet - Suggests values based on the field type.
      • Check All - "Select All" is often not available. Why not bring your own?
      • Fluxguard - Screenshot pixel and DOM change comparisons and regressions.
      • Testomatio
      • Requestly - A lightweight proxy as a browser extension & desktop app to intercept & modify network requests. You can Modify Headers, Redirect Url, Mock API response, Delay/Throttle requests, etc.
      • Robot Framework - Generic open source automation framework. It can be used for testing and robotic process automation (RPA).
      • wopee.io - Autonomous testing platform providing bot for autonomous visual regression testing.
      • Replayable - Desktop dashcam that helps you capture unexpected bugs during manual testing.
      • Ferrum - very simple and easy to get started with frontend/UI testing in small Ruby scripts, high-level API to control Chrome with the CDP - Chrome DevTools Protocol (NO Selenium dependency)
      • TestLink - Open Source test case management system
      • recheck-web - Open Source change comparison tool with local Golden Masters, git-like ignore syntax and "unbreakable selenium" tests.
      • Kiwi TCMS - Open Source test case management system.
      • Captura - Open Source video recording tool.
      • QA Wolf - Open Source Node.js library for creating browser tests 10x faster.
      • DeepfakeHTTP - DeepfakeHTTP is a web server that uses HTTP dumps as a source for responses. This tool allows you to test clients against REST, GraphQL, and other APIs.
      • Touca - Open source continuous regression testing to compare the behavior and performance of software against a previous baseline version.
      • test-each - Repeats tests using different inputs (Data-Driven Testing).
      • playwright-bdd - A module for running Behaviour-Driven Development (BDD) tests with Playwright runner.

    • Other

    • Performance & Load Testing

      • Load Testing Hub Panel - Ultimate web UI for visualizing load test results
      • k6 - Modern load testing tool, scriptable in JavaScript, with cloud and open-source options.
      • JMeterHub - Interactive performance report visualizer for Apache JMeter logs with zero setup, AI conclusions, and shareable reports.

    • Screen Recording & Session Replays

      • PR Preview - MCP for Claude Code that drives your web app in a headed browser and records before/after demo videos of a pull request as MP4 or GIF.
      • rrweb - Records the DOM and user interactions as a typed JSON event stream and replays them pixel-perfect.

    • Security

      • OWASP ZAP - This intercepting proxy allows you to see all HTTP traffic and manipulate it in real time. Easy to scan, catalog and exploit security issues.

    • Security Testing

      • BurpSuite - Intercept API and Reply with changes in realtime with according api manipulations.
      • Nuclei Scanner - nuclie is automated scanner for common vulnerbilty finding on site.
      • Darkmoon - Open-source (GPLv3) autonomous AI penetration-testing CLI with 50 specialist agents and 140+ offensive tools over MCP for DAST-style web and API security assessment.

    • Service Virtualization

      • Beeceptor - Easy to use no-code mock servers for service virtualization. Rest, SOAP, GraphQL supported. Create an API mock server from OpenAPI Specification or Postman collection.
      • WireMock - Open source HTTP mock engine written in Java. Embed in your test code, run as a standalone process, or deploy via Docker.
      • mockd - Open-source multi-protocol mock server supporting HTTP, gRPC, GraphQL, WebSocket, MQTT, and SOAP with chaos engineering and proxy recording.
      • ApiNotes - Drop your OpenAPI spec and get a fully functional mock API server instantly. Export to Bruno API client or test directly.
      • fakecloud - Free, open-source local AWS cloud emulator for integration tests, with 23 services at 100% conformance and first-party test-assertion SDKs in 6 languages.
      • MockServer - Mocking, debugging proxy and chaos engineering tool for multiple protocols (HTTP, gRPC, GraphQL, LLM, MCP, Kafka, TCP and more); mock any dependency, record/replay and inspect traffic, verify requests, and inject faults. Docker, JAR, Helm, multi-language clients.

    • Test Automation Frameworks

      • ai-natural-language-tests - Generates Cypress and Playwright E2E tests from natural language requirements using LangGraph, ChromaDB, and multi-provider LLM support.
      • OpenTester - MCP-First Testing Framwork: AI Agents Can Now Test Like Humans
      • Jumpstarter - Open source hardware-in-the-loop testing framework for automated testing on real and virtual hardware with CI/CD integration.
      • Bats - Bash Automated Testing System.
      • Selenium Boot - Java framework layered on Selenium WebDriver and TestNG. One Maven dependency and one YAML file replace the usual driver-lifecycle, wait, retry and reporting boilerplate, and the raw WebDriver stays accessible.
      • optics-framework - Self-healing test automation for mobile, web and Smart TV. Keyword-driven CSV/YAML tests run on Appium, Selenium and Playwright; when a locator breaks it falls back across XPath, text, OCR and image strategies, with optional AI-powered self-healing.

    • Test Data Management

      • MockHero - REST API for generating synthetic test data. 156 field types, 22 locales, relational data, sub-50ms. Free tier available.
      • DATAMIMIC CE - Open-source, deterministic engine for model-driven synthetic test data and PII pseudonymization. Pin a seed and get byte-identical output with a provenance hash on every run. Python, MIT.
      • Temp Mail 24 - Browser-based receive-only temporary inbox for permitted manual signup-flow testing.
      • sms-florin - Rent a real UK phone number to receive SMS/OTP codes for testing verification flows (WhatsApp, Telegram, Google, and others). Ships a JS/TS SDK for CI/QA automation.
      • JSON Validation Test Cases - Reusable valid, invalid, and edge-case JSON fixtures for testing parsers, validators, APIs, editors, and error handling.
      • MockJutsu - Algorithmic open-source mock data engine generating 390+ format-valid types (IBAN, TCKN, Luhn, VIN, NHS, SWIFT, MRZ and more). CLI + REST API + Python package + JMeter
      • TempMailGrab - Disposable email API for temporary inboxes, OTP extraction, verification links, and webhooks in Playwright, Cypress, and CI tests.
      • dbmask - Masks sensitive data in SQL test databases with deterministic fakes and verifies the masking row by row.
      • Dummy Data Lab - Offline, open-source browser tool for transforming CSV or TXT into controlled dummy data and generating linked test datasets without uploading source files.
      • Fake Data Generator - Browser-based generator for realistic mock/test data. Custom schema or presets, export as JSON, CSV, or SQL INSERT.
      • Sample Files - Free downloadable test file variants across video, audio, document, and archive formats (MP4, MOV, RTF, ZIP, PPTX, etc.), covering codecs, encodings, and edge cases for parser and import testing.
      • FakeNamely - Free web generator and keyless JSON API for fictional identities, addresses and names across 38 countries. Seeded requests return byte-identical records, so a fixture can be committed; addresses pair a real city and a genuinely valid postal code with an invented street.
      • JsonFabrica - API-first service for realistic synthetic JSON test data from reusable templates: relational batches with referential integrity, seed-reproducible output, and an MCP server for AI agents.
      • ARADURU File Format Test Corpus - Open CC0 corpus of deterministic healthy and intentionally broken XLSX, DOCX, PPTX, ZIP, and PDF fixtures with SHA-256 manifests for file validation, parser, upload, and QA testing.
      • Código ao Ponto - Free browser-based test data generators and validators for Brazilian documents (CPF, CNPJ, RG, CNH) with valid check digits, plus test credit cards. No signup.
      • LaunchStock Test Data Generator - Browser generator for six modelled businesses: retail, SaaS, healthcare, banking, logistics and HR. Values agree across tables, not just across keys. Order totals reconcile against their lines, a bank ledger balances forward, and a discharge never precedes its admission. Exports CSV, JSON or a PostgreSQL dump, no account. A paid pack adds your own schema and unlimited rows.
      • postal-code-formats - Postal code formats, validation regexes and 9,000 real sample codes for 31 countries, with every regex tested against the samples in CI.

    • Test Management

      • Gwirian - Open source BDD test management for QA teams. Given/When/Then scenarios, search, dashboards; self-host or hosted.
      • skipper - Real-time test execution control via Google Spreadsheet, enabling instant toggle without code changes.
      • Gwirian - Open source BDD test management for QA teams. Given/When/Then scenarios, search, dashboards; self-host or hosted.
      • qarunbook - Free shared test runbook where testers record a pass or fail per platform with screenshots, and an issue marked fixed sends the check back for a retest.

    • UI & End-to-End Testing

      • Hercules - Open-source end-to-end testing agent.
      • Mocky Balboa - Mock server side network requests in your fullstack apps declaratively at runtime
      • UI Coverage Tool - UI Coverage Tool is an innovative, no-overhead solution for tracking and visualizing UI test coverage — directly on your actual application, not static snapshots.
      • DeviceLab - Private device lab infrastructure for mobile testing. Connect your own iOS/Android devices and run Appium, Maestro, or XCUITest remotely via WebRTC. Zero-trust architecture keeps test data on your network.
      • LambdaTest - Unified enterprise test execution cloud platform for browser and mobile testing.
      • LambdaTest - Unified enterprise test execution cloud platform for browser and mobile testing.
      • flutter-skill - AI-powered E2E testing via MCP for Flutter, React Native, iOS, Android, Electron, Tauri, KMP, and .NET MAUI. Zero test code.
      • agent-qa - Open-source Agentic QA Harness with Memory. Write tests in natural language. agent-qa runs them across web and mobile with execution memory, catching regressions before release.
      • DevAssure - Agentic testing for E2E web UI on real browsers. Agent can be added to Github Actions to test only the flows that have changed in a PR.
      • tapflow - Self-hosted mobile QA tool that streams iOS simulators and Android emulators to the browser for team-wide testing without local setup.
      • Kane CLI - Natural-language browser testing from the terminal, locally or in CI, with export to Playwright and shareable run evidence.
      • qmax-mcp - MCP server and CLI that gives coding agents independent QA evidence before they declare a web change done: scans a URL for console errors, broken links, accessibility issues, Core Web Vitals, SEO, security headers, and cookies/trackers, then generates and runs a deterministic Playwright repro behind a human-approval gate.
      • Waterfall AI Test - Open-source visual workbench for Playwright Test Agents that turns requirements into editable plans and verified Playwright tests with human review, repair workflows, version history, and execution evidence.
      • blastproof - Open-source AI agent that runs plain-English e2e tests in a real browser. It reads the pull request diff, runs only the tests for the pages that changed and can block the merge on a score. Runs locally or in CI with your own LLM key.
      • BugBug - No-code test automation tool for web applications.
      • cloudf.one - Rent a real Samsung Android phone in Singapore on a Singtel or M1 SIM and use it from a browser tab, to check how an app behaves for Singapore users. Manual use only, no Appium or scripts.
      • Drengr - Mobile tests written as plain-English tasks instead of selectors, driven by an agent on real Android devices and iOS simulators. Works where there is no accessibility tree — canvas, games, Flutter without semantics labels — by falling back to vision and coordinates. Runs locally or in CI; bring your own model key.
      • Drengr Runner - Drive an iOS simulator over HTTP from any language. A 479-line Swift XCTest target replacing WebDriverAgent on simulators. Apache-2.0.
      • TestMu AI (formerly LambdaTest) - Full-Stack Agentic AI Quality Engineering platform that empowers teams to test intelligently and ship faster.
      • VibeView - Run & test iOS, Android, Apple TV and Android TV apps right in your browser, with Roku in beta. Build tests by recording a flow or write steps in plain English, flows can be ran cross-platform, and wired into pull requests. When a step fails - AI agent takes over so the rest of the run still completes, and the report tells you what changed based on failed steps and visual diff.

    • Visual Testing

      • Fluxguard - Screenshot pixel and DOM change comparisons.
      • TestingBot - Supports automated, manual, and visual testing.
      • Lambda testing Tool - UI Testing Frawnework.
      • Sherlo - Visual testing platform for React Native Storybook. Captures screenshots on iOS and Android simulators in the cloud and detects visual changes automatically.
      • SmartUI by TestMu AI (formerly LambdaTest) - AI-Native Visual Testing Tool for Flawless UIs across browsers, apps, websites, and PDFs.
      • Frostbyte Screenshot Action - GitHub Action for automated website screenshots in CI/CD pipelines. Supports multiple viewports, full-page capture, and dark mode emulation.
      • Lastest - Visual regression testing for Playwright with AI flake triage and baseline review.
      • Image Diff - Free, browser-based pixel diff tool for comparing two images and highlighting exactly what changed, with an adjustable sensitivity threshold. No upload, no sign-up.
      • Happo - Cross-browser screenshot and visual regression testing service, integrates with tools like Storybook, Playwright, and Cypress.

    • Web3 and Blockchain

      • Dapp.tools - Command line tools and smart contract libraries for Ethereum smart contract development.
      • Hardhat - Multichain Ethereum development environment.
      • Cannon - Continuous configuration automation & development cli multi-tool. Like Terraform, Docker and NPM for Ethereum.
      • Foundry - Blazing fast, portable and modular toolkit for Ethereum application development written in Rust.
      • Robot Framework Solidity Testing Toolkit - This combines popular smart contract testing and deployment libraries with Robot Framework.

  • Suggested Awesome Lists

    • Must Read

      • Falsehoods - A funny and educational list of why nothing in Software Development is ever easy. Think you can store a marriage in a DB?
      • Unicode - A great resource for learning how unicode works and the issues it can cause.
      • Naughty Strings - This is the famous list of Naughty Strings. If you're doing some field validation, look no further for inspiration.

    • Useful References

      • Learn to Code - Learning to code, for those looking to make the move to automation
      • Application Security - Incredibly extensive, but you'll find something to fit the bill.
      • Selenium - Better than searching Google if you know what you want.
      • Security - This is mostly focused on Infrastructure, but if you're testing a series of systems, this is very useful.
      • Awesome JMeter - A curated collection of resources around Apache JMeter.
Programming Languages
TypeScript 16 Python 12 HTML 6 Java 4 Go 4 JavaScript 4 Rust 3 PHP 2 Dart 1 Markdown 1
Categories
Software 145 Books 30 Suggested Awesome Lists 15 Blogs 8 Training (Includes developer training for automation testers) 7 Others 4 Newsletters 3 License 1 QA and Testing Road Map 1
Sub Categories
Other 27 Make your life easier 23 UI & End-to-End Testing 20 Mind Mapping & Documentation 19 Useful References 18 Test Data Management 17 API Testing 17 AI & LLM Testing 12 Visual Testing 9 Accessibility & Usability Testing 7 Browser Extensions & Utilities 7 Test Automation Frameworks 6 Service Virtualization 6 Web3 and Blockchain 5 A/B Testing 5 Test Management 4 Performance & Load Testing 3 Security Testing 3 Must Read 3 Screen Recording & Session Replays 2 Security 1
Keywords
testing 22 test-automation 14 testing-tools 13 awesome-list 11 awesome 10 developer-tools 9 llm 9 ai-testing 7 mcp 7 automation 7 qa 6 playwright 6 ai-agents 6 cli 6 ai 6 security 5 python 5 agents 4 javascript 4 observability 4 llm-evaluation 4 end-to-end-testing 4 gherkin 4 mock-server 4 e2e-testing 3 devops 3 react-native 3 test 3 rest-api 3 cucumber 3 bdd 3 load-testing 3 performance-testing 3 automated-testing 3 qa-automation 3 llm-testing 3 self-hosted 3 software-testing 3 agentic-ai 3 opensource 2 fuzzing 2 rust 2 pentesting 2 prompt-engineering 2 prompt-testing 2 snapshot-testing 2 rag 2 nodejs 2 code-quality 2 ai-test-automation 2