{"id":17002989,"url":"https://github.com/50-course/pytest-distributed","last_synced_at":"2025-10-23T17:04:16.873Z","repository":{"id":219626760,"uuid":"748562480","full_name":"50-Course/pytest-distributed","owner":"50-Course","description":"A pytest plugin that cuts down test execution time (of CI pipelines) for organizations to move faster. Ship faster \u0026 better, with this alternative plugin to pytest-xdist :eyes:","archived":false,"fork":false,"pushed_at":"2024-01-29T01:21:46.000Z","size":17,"stargazers_count":0,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-27T09:41:26.339Z","etag":null,"topics":["developer-tools","django"],"latest_commit_sha":null,"homepage":"","language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/50-Course.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":"50-Course"}},"created_at":"2024-01-26T09:01:33.000Z","updated_at":"2024-03-02T02:45:18.000Z","dependencies_parsed_at":null,"dependency_job_id":"3988f164-6dec-4b51-aabe-febc8d8aeefb","html_url":"https://github.com/50-Course/pytest-distributed","commit_stats":null,"previous_names":["50-course/pytest-distributed"],"tags_count":0,"template":false,"template_full_name":"50-Course/py-template","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/50-Course%2Fpytest-distributed","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/50-Course%2Fpytest-distributed/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/50-Course%2Fpytest-distributed/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/50-Course%2Fpytest-distributed/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/50-Course","download_url":"https://codeload.github.com/50-Course/pytest-distributed/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244937738,"owners_count":20535124,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["developer-tools","django"],"created_at":"2024-10-14T04:29:30.829Z","updated_at":"2025-10-23T17:04:16.785Z","avatar_url":"https://github.com/50-Course.png","language":"Dockerfile","readme":"# pytest-distributed\n[![pre-commit](https://img.shields.io/badge/pre--commit-enabled-brightgreen?logo=pre-commit\u0026logoColor=white)](https://github.com/pre-commit/pre-commit)\n[![Code style: black](https://img.shields.io/badge/code%20style-black-black)](https://github.com/psf/black)\n\n\n### Description\n\n\u003e Given when people touch on large codebases, and run pytest they burn a significant period of time in the order of hours on test suites. \n\u003e `pytest-distributed` greatly simplify that process, in hence, we are creating an complementary plugin to `pytest-xdist`,  with true parralelism at play\n\n\nSo let's begin!\n\n### Ideas Bank\n\n* True Parallelism: first thing that comes to mind here, is use of parallel algorithms.\n\n    - What if we can go beyond Parallel Task Queue implementation? Say, MapReduce - Divide test suites into micro-units (map) and aggregate results (reduce)\n\n* Dynamic Test Distribution: distribute tests across available CPU cores to optimize performance\n\nPossible Strats for True Parallelism:\n\n    Test Distribution by Module?\n\n    Test Distribution by Dependency Graph - I would have to research on this...\n\n    Dynamic Work Stealing: a work-stealing algorithm where idle workers steal work from busy workers, ensuring optimal CPU core utilization.\n\n* Customization Options: Give users access to customize settings based on their specific requirements but not too much power.\n\n\n### Success Criteria\n\nThe project is considered success if:\n\n- It could perform successful parallel test execution in the slightest way possible\n","funding_links":["https://github.com/sponsors/50-Course"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F50-course%2Fpytest-distributed","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F50-course%2Fpytest-distributed","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F50-course%2Fpytest-distributed/lists"}