An open API service indexing awesome lists of open source software.

https://github.com/coherent-oss/pytest-ignore-flaky

ignore failures from flaky tests (pytest plugin)
https://github.com/coherent-oss/pytest-ignore-flaky

pytest pytest-plugin python testing

Last synced: 3 months ago
JSON representation

ignore failures from flaky tests (pytest plugin)

Awesome Lists containing this project

README

          

.. image:: https://img.shields.io/pypi/v/pytest-ignore-flaky.svg
:target: https://pypi.org/project/pytest-ignore-flaky

.. image:: https://img.shields.io/pypi/pyversions/pytest-ignore-flaky.svg

.. image:: https://github.com/coherent-oss/pytest-ignore-flaky/actions/workflows/main.yml/badge.svg
:target: https://github.com/coherent-oss/pytest-ignore-flaky/actions?query=workflow%3A%22tests%22
:alt: tests

.. image:: https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json
:target: https://github.com/astral-sh/ruff
:alt: Ruff

.. image:: https://readthedocs.org/projects/pytest-ignore-flaky/badge/?version=latest
:target: https://pytest-ignore-flaky.readthedocs.io/en/latest/?badge=latest

.. image:: https://img.shields.io/badge/skeleton-2025-informational
:target: https://blog.jaraco.com/skeleton

pytest-ignore-flaky
====================

ignore failures from flaky tests (pytest plugin)

A "flaky" test is a test that usually pass but sometimes it fails.
You should always avoid flaky tests but not always possible.

This plugin can be used to optionally ignore failures from flaky tests.

First "mark" your tests with the `flaky` marker::

import random
import pytest

@pytest.mark.flaky
def test_mf():
assert 0 == random.randint(0, 1)

By default this mark is just ignored, unless the plugin is activated from the
command line (or `py.test` config file)::

py.test --ignore-flaky

If a flaky test pass it will be reported normally as test succeed.
If the test fails, instead of being reported as failure it will be reported as
a `xfail`.

pytest compatibility
====================

Tested with pytest 6.2 (2021-04-23).

Project Details
===============

- Project code + issue track on github - https://github.com/coherent-oss/pytest-ignore-flaky
- PyPI - https://pypi.python.org/pypi/pytest-ignore-flaky

license
=======

The MIT License
Copyright (c) 2015-2019 Eduardo Naufel Schettino and Marcos Alfredo Camargo Leal Pinto

see LICENSE file