awesome-regression-testing
š¶ļø A curated list of resources around the topic: visual regression testing
https://github.com/mojoaxel/awesome-regression-testing
Last synced: 17 days ago
JSON representation
Blog posts (a-zā)
- Garris Shipon: Visual Regression Testing For Angular Applications - Tutorial using BackstopJS.
- Angela Riggs: Visual Regression Testing with BackstopJS - Tutorial using BackstopJS.
- Garris Shipon: Automating CSS Regression Testing - Tutorial using BackstopJS.
- Phillip Gourley: Making visual regression useful - Why you should use BackstopJS.
- Chromeless, Chrominator, Chromy, Navalia, Lambdium, GhostJS, AutoGCD - Headless Chrome is shaking up traditional approaches to test automation.
- Make visual regression testing easier - Introduction to Differencify and how to use it.
- Automated screenshot comparison tests with headless Chrome, Puppeteer and Pixelmatch, in Bitbucket pipeline
- Automatic visual diffing with Puppeteer
- Visual regression testing for Hugo with Github-CI and BackstopJS - How to automate regression testing for Hugo with BackstopJS
- UI Visual Regression Testing with Micoo - Introduction about how to do visual regression testing with Micoo service
- Poor man's visual regression testing - Improved manual visual regression testing with the PerfectPixel chrome plugin.
- Everything you need to know about Visual Regression Testing in 2022 - Intro to visual regression testing with tools updated as of 2022.
- Visual regression testing using Jest, Chromeless and AWS Lambda - Tutorial using Chromeless and jest-image-snapshot.
- Visual Regression Test with WebdriverIO & WebdriverCSS - Tutorial using WebdriverIO and WebdriverCSS with Spec Reporter
- Kevin Lamping: The 5 best visual regression testing tools - Compares: Wraith, PhantomCSS, Gemini, WebdriverCSS and Spectre.
- Keeping a React Design System consistent: using visual regression testing to save time and headaches - Using percy, and jest puppeteer to visually test a React component library.
- theheadless.dev - Blog with practical guides and runnable examples on Playwright and Puppeteer.
- Pavels Jelisejevs: Visual Regression Testing with PhantomCSS - Introduction to PhantomCSS.
- Visual Regression Testing with Puppeteer & Jest - Tutorial to setup visual testing with Puppeteer, Jest and VisWiz.io.
Browser automation
- Cypress.io - An automation framework that runs in-browser.
- Selenium - Browser automation framework and ecosystem.
- SlimerJS - Scriptable browser like PhantomJS, based on Firefox.
- Webdriver.io - Node.js bindings implementation for the W3C WebDriver protocol.
Deprecated (a-zā)
- PhantomJS - Scriptable Headless WebKit. No longer maintained since 2 June 2018.
- PhantomCSS - Visual/CSS regression testing with PhantomJS or SlimerJS. No longer maintained since 22 Dec 2017.
- DalekJS - Automated cross browser testing with JavaScript. No longer maintained since 4 Jun 2017.
- dpxdt - End-to-end testing with Python.
- Visual Review - A human-friendly tool for testing and reviewing visual regressions.
- Huxley - Python framework based on Selenium Webdriver.
- Gemini - Feature rich framework with support for Selenium and CasperJS. Gemini is deprecated, use hermione instead.
- OcularJS - uses PhantomJS.
- trifleJS - Headless automation for Internet Explorer. (last update 2016)
- CasperJS - Navigation scripting and testing utility for PhantomJS and SlimerJS. (archived 2018)
- Navalia - Browser Automation based on headless Chrome and GraphQL. (archived 2018)
- Chromeless - Chrome automation made simple. Runs locally or headless on AWS Lambda. (archived 2018)
- PhantomFlow - Experimental approach to UI testing, based on Decision Trees.
- WebdriverCSS - WebdriverCSS sits on top of Webdriver.io and hooks into Selenium.
Foreword
General information
Miscellaneous
License
Online services (a-zā)
- BugBug.io - Lightweight test automation tool for web applications. Easy to learn and doesn't require coding. It's free, with unlimited tests. For an additional monthly fee, you also get cloud monitoring and CI/CD integration.
- HeadSpin - HeadSpin's Regression testing gives you a powerful comparison tool for analysing degradation across new app builds, OS releases, feature additions, locations, and more.
- TestGrid - Perform End to End test automation be it cross browser testing, mobile app testing, performance testing or API testing on cloud or on-premise.
- LambdaTest - Perform Automated and Live Interactive Cross Browser Testing on 2000+ Real Browsers and Operating Systems Online.
- CrossBrowserTesting - Manual & exploratory testing on 1500+ real browsers and mobile devices.
- Chromatic - Visual testing and UI review for component libraries. Cloud-based. Video
- Happo - Cloud-based screenshot testing service with support for multiple browsers.
- Visual Knight - Cloud-based visual testing platform with realtime results for testing tools.
- Axcept - Testing for the whole team. Up to 100 tests in parallel. Endpoint Mocking. Code Coverage.
- Vidiff - Cloud-based visual regression testing across stages.
- Browser Shots - Screenshots only.
- Pixeleye - Open-source, multi-browser visual review and testing platform with the option to self-host. It has first-class support for Storybook, Cypress, Playwright & Puppeteer.
- Visual Regression Tracker - Open Source selfhosted service for visual regression testing
- Micoo - Open source service for all UI application visual regression solution
- Testomat.io Reporter - Allows to collect tests to a Test Case Management System (TCMS) like testomat.io and sync manual and automated tests in one place.
- Fluxguard - Screenshot pixel and DOM change comparisons and regressions.
- Preflight: Cypress Recorder - Create AI-powered Cypress Tests/POM models in your browser and automate Email & Visual testing for Cypress.
- Preflight - Easiest Visual regression testing and Automated Web Testing tool. (Limited) free use.
- TestingBot - Provides +3600 browsers to run automated visual tests. Free for Open Source.
- Sherlo - Visual testing platform for React Native Storybook. Captures screenshots on iOS and Android simulators in the cloud and detects visual changes automatically.
- applitools - Cloud base visual tests.
- Diffy - Cloud based visual regression tool that focuses on Drupal and WordPress. Full page screenshots and minimal number of false positives. Just provide URLs of your sites to get started. No coding required.
- Ghost Inspector - See introduction video.
- PageBolt - Screenshot, video recording, PDF, and page inspection API with device emulation, ad blocking, and cookie banner removal.
- testRigor - E2E functional test automation tool for web, mobile, and desktop tests.
- VisWiz.io - Flexible visual regression testing service.
- Argos - The open source visual testing platform for modern engineering teams.
- browserling - LIVE interactive cross-browser testing.
- BrowserStack - Free for Open Source. Supports Selenium Webdriver.
- Keploy - Open-source regression testing tool that automatically generates test cases and mocks from real API calls.
- Meticulous.ai - Easily create frontend tests without writing code. Use Meticulous to record workflows on your web app. You can then replay those flows on new frontend code, and create a test by diffing two replays.
- percy.io - Continuous visual reviews for web apps.
- Reflect - Visual regression testing and test automation tool.
- screener.io - For React, looks open source.
- screenster.io - Cloud based automation testing platform for web and mobile UI.
- stateofpixel - Catch UI regressions before they merge. Your CI takes the screenshots with Playwright, Storybook or any tool that writes PNGs, and a person approves each change on the pull request. Open source and self-hostable.
- VRTs - Visual Regression Tests - updating screenshots on content updates, preventing false positives.
- Wopee.io - Autonomous visual regression testing platform with AI-powered test agents. Integrates with Playwright, Cypress, and Robot Framework.
Slideshows, talks and videos (a-zā)
- Visual Regression Testing - from a tool to a process - How the Mobile Web team in Badoo converted and integrated PhantomCSS into their workflow and connected it to their CI process.
- Scaling up your Screenshot Testing, without the Friction - Mobile focussed talk from Droidcon/Fluttercon India. Explains the bottlenecks with scaling up screenshot testing and how to solve them.
- CSS Regression Testing with Wraith - Screencast: Basic introduction to wraith, a screenshot comparison tool.
- Cypress in 100 Seconds - Introduction video by Fireship.
- Look-alike - visual regression testing tool - Demo what the Look-alike Chrome extension is, how it works and how and why it was build.
- Screencast on CSS critic - a lightweight testing framework for CSS - How to write your first CSS test with CSS critic, make it pass, break it, and make it pass again.
- Screenster Tutorial - Tutorial on how to create visual automated tests with Screenster.
- Visual Regression Testing with PhantomCSS - Talk by Jon Bellah on how to use PhantomCSS during wordpress development.
- Visual Regression Testing with Shoov - How to setup shoov and get your first test written.
- Visual Regression Testing: Sanity Checks With BackstopJS - Screencast with code demo and best practices.
Tools and frameworks (a-zā)
- basset - Open source platform for generating and reviewing visual differences. Supports multiple browsers, integrations for github and slack.
- qd_screenshottests - CasperJS-based UI regression and functional testing focused on Drupal 8 sites.
- Loki - Visual regression testing for Storybook using Chrome in docker et al.
- Karma - A test runner by the AngularJS team, that fits all our needs.
- OSnap - The speedy and easy to use Snapshot Testing tool for your project (1200 snapshots will run in under 3 minutes).
- AyeSpy - 44 image comparisons in 90 seconds.
- BackstopJS - Config-driven automated screenshot test framework.
- Galen - Java framework based on Selenium.
- CSSCritic - Lightweight CSS regression testing.
- Spectre - Provides image comparison capabilities and an admin interface for managing screenshots.
- Shoov - UI regression and functional testing focused on Drupal 7 sites.
- Look-alike - Chrome Extension for taking and comparing screenshots.
- Hardy - Selenium-driven, cucumber-powered CSS testing.
- TestCafe - Automated browser testing for the modern web development stack.
- Needle - Needle is a tool for testing visuals with Selenium and nose (Python).
- gatling - Integrated visual RSpec matcher which makes real visual testing easy (Ruby).
- grunt-photobox - Plugin to prevent your project of broken layout via screenshot photo sessions of your site.
- vrtest - JavaScript library for running visual regression tests on your components cross browser via selenium.
- Happo - Visual diffing in CI for user interfaces.
- Playwright - Node library to automate Chromium, Firefox and WebKit with a single API.
- reg-suit - Visual regression testing suite which compares images, stores snapshots, and notifies the difference to your GitHub repo.
- Differencify - A library for visual regression testing using Puppeteer.
- Muppeteer - Visual regression testing framework for Chrome using Mocha and Puppeteer.
- ember-visual-test - Simple visual regression testing for Ember.
- Wendigo - Test-oriented browser automation library based on Puppeteer.
- FuncUnit - A functional test suite based on jQuery
- Nightwatch - Automated testing and continuous integration framework based on Node.js and using the Webdriver protocol.
- Protractor - E2E test framework for Angular apps.
- jest-puppeteer-react - Visual regression testing with Jest and puppeteer for React components
- jest-image-snapshot - Jest matcher that performs image comparisons using pixelmatch
- test-crawler - Visual regression testing, by crawling a website and providing snapshot comparison reports.
- wdio-visual-regression - Visual regression tool for webdriver.io
- Selenide - Framework powered by Selenium WebDriver for writing easy-to-read and easy-to-maintain automated tests in Java.
- Touca - Open source continuous regression testing without the hassle of managing snapshot files.
- Lost Pixel - Holistic visual regression testing for full pages, components (via Storybook and Ladle integration), and custom shots (e.g. via Cypress).
- Puppeteer - Headless Google Chrome Node API.
- AET - Scalable testing tool providing visual regression testing, accessibility and performance validation, markup analysis and more.
- Wraith - Easy to use ruby tool with docker support.
- Creevey - Cross-browser visual testing with magic. Feature-rich tool with UI Runner, Tests Hot Reloading, Docker and Storybook integration.
- reg-cli - Visual regression test tool which output easy-to-read single file html report.
- ResembleJS - Analyse and compare images with Javascript and HTML5.
- Zombie.js - Insanely fast, headless full-stack testing using Node.js.
- Nightmare - High-level browser automation library based on Electron.
- BitDive - BitDive is a zero-code regression testing tool for Java/Kotlin applications. It captures real runtime behavior (methods, SQL, HTTP) and enables Live Context Replay with automatic mocking to detect semantic drift between versions.
- DiffGoblin Action - GitHub Action that screenshots two URLs and posts a visual diff as a PR comment. Zero config, no external service needed.
- Lastest - Visual regression testing platform built on Playwright with screenshot diffing, baseline review, and AI flake triage. Self-hostable via docker-compose or k8s.
- BFFless - Self-hosted platform for hosting and viewing visual regression screenshots from CI/CD pipelines with GitHub Actions integration.
- CodeceptJS - Modern Era Acceptance Testing Framework for NodeJS.