{"id":28625331,"url":"https://github.com/marwan116/flakycode","last_synced_at":"2025-06-12T08:10:25.086Z","repository":{"id":188339088,"uuid":"677841370","full_name":"marwan116/flakycode","owner":"marwan116","description":"A showcase of flaky tests in python","archived":false,"fork":false,"pushed_at":"2023-09-08T14:12:20.000Z","size":94,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-21T22:11:35.855Z","etag":null,"topics":["pytest","python","testing"],"latest_commit_sha":null,"homepage":"https://www.marwansarieddine.com/posts/flaky_tests","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/marwan116.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-08-12T20:19:23.000Z","updated_at":"2023-09-08T14:02:02.000Z","dependencies_parsed_at":"2023-08-18T11:45:29.172Z","dependency_job_id":null,"html_url":"https://github.com/marwan116/flakycode","commit_stats":null,"previous_names":["marwan116/flakycode"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/marwan116/flakycode","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marwan116%2Fflakycode","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marwan116%2Fflakycode/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marwan116%2Fflakycode/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marwan116%2Fflakycode/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/marwan116","download_url":"https://codeload.github.com/marwan116/flakycode/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marwan116%2Fflakycode/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259427060,"owners_count":22855564,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["pytest","python","testing"],"created_at":"2025-06-12T08:10:17.185Z","updated_at":"2025-06-12T08:10:25.060Z","avatar_url":"https://github.com/marwan116.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Flaky Test Code\n\n## Motivation\nA package showcasing common examples of flaky tests\n\n## Overview\nThis package contains a number of tests that are flaky and will fail intermittently. For each flaky test, a reliable counterpart test is provided. \n\nAll of the code is located under the `tests` directory. The package is solely set up to create a cli tool that would walk through the tests and run them but it is not implemented yet.\n\n### Running the tests\nTo run the tests, instead of using `pytest`, use `python` given each test's main module is executable and would run `pytest` multiple times, with different arguments, plugins and will compute a percent of failures.\n\nFor example, to run the `test_flaky.py` test under `tests/inter_test/resource_leak/memory_usage_flaky.csv`, run the following command:\n\n```\npython tests/inter_test/resource_leak/memory_usage_flaky.csv/test_flaky.py\n```\n\n\n### Layout\nThe tests are organized in the following way:\n```\ntests\n├── __init__.py\n├── external_resource\n│   ├── __init__.py\n│   ├── async_wait\n│   │   ├── __init__.py\n│   │   ├── test_flaky.py\n│   │   └── test_reliable.py\n│   ├── io\n│   ├── network\n│   │   ├── __init__.py\n│   │   ├── test_flaky.py\n│   │   └── test_reliable.py\n│   └── time\n│       ├── test_flaky.py\n│       └── test_reliable.py\n├── inter_test\n│   ├── __init__.py\n│   ├── order_dependence\n│   │   ├── __init__.py\n│   │   ├── fixture_scoping\n│   │   │   ├── __init__.py\n│   │   │   ├── test_flaky.py\n│   │   │   └── test_reliable.py\n│   │   ├── polluted_mock\n│   │   │   ├── __init__.py\n│   │   │   ├── test_flaky.py\n│   │   │   └── test_reliable.py\n│   │   └── shared_resource\n│   │       ├── __init__.py\n│   │       ├── database_isolation\n│   │       │   ├── __init__.py\n│   │       │   ├── test_flaky.py\n│   │       │   └── test_reliable.py\n│   │       └── filesystem_conflict\n│   │           ├── __init__.py\n│   │           ├── test_flaky.py\n│   │           └── test_reliable.py\n│   └── resource_leak\n│       ├── __init__.py\n│       ├── memory_usage_flaky.csv\n│       ├── memory_usage_flaky.png\n│       ├── memory_usage_reliable.csv\n│       ├── memory_usage_reliable.png\n│       ├── test_flaky.py\n│       └── test_reliable.py\n└── intra_test\n    ├── __init__.py\n    ├── concurrency\n    │   ├── __init__.py\n    │   ├── test_flaky.py\n    │   └── test_reliable.py\n    ├── floating_point\n    │   ├── __init__.py\n    │   └── rounding\n    │       ├── __init__.py\n    │       ├── overflow\n    │       │   ├── __init__.py\n    │       │   ├── test_flaky.py\n    │       │   └── test_reliable.py\n    │       └── precision_loss\n    │           ├── __init__.py\n    │           ├── test_flaky.py\n    │           └── test_reliable.py\n    ├── randomness\n    │   ├── __init__.py\n    │   └── algorithmic_non_determinism\n    │       ├── __init__.py\n    │       ├── test_flaky.py\n    │       └── test_reliable.py\n    ├── timeout\n    │   ├── __init__.py\n    │   ├── test_flaky.py\n    │   └── test_reliable.py\n    └── too_restrictive\n        ├── __init__.py\n        ├── test_flaky.py\n        ├── test_fuzzing.py\n        └── test_reliable.py\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmarwan116%2Fflakycode","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmarwan116%2Fflakycode","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmarwan116%2Fflakycode/lists"}