{"id":13472190,"url":"https://github.com/soravux/scoop","last_synced_at":"2025-10-21T06:20:11.446Z","repository":{"id":29158454,"uuid":"32688797","full_name":"soravux/scoop","owner":"soravux","description":"SCOOP (Scalable COncurrent Operations in Python)","archived":false,"fork":false,"pushed_at":"2023-03-17T14:55:03.000Z","size":5878,"stargazers_count":649,"open_issues_count":35,"forks_count":88,"subscribers_count":37,"default_branch":"master","last_synced_at":"2025-03-06T11:18:24.877Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://github.com/soravux/scoop","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"lgpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/soravux.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.txt","contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2015-03-22T18:25:14.000Z","updated_at":"2025-03-03T19:13:32.000Z","dependencies_parsed_at":"2024-01-29T18:51:44.014Z","dependency_job_id":null,"html_url":"https://github.com/soravux/scoop","commit_stats":{"total_commits":912,"total_committers":28,"mean_commits":32.57142857142857,"dds":"0.33442982456140347","last_synced_commit":"65e3b76a08265266d5c64d94ce5bf9078f4fb328"},"previous_names":[],"tags_count":16,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soravux%2Fscoop","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soravux%2Fscoop/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soravux%2Fscoop/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/soravux%2Fscoop/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/soravux","download_url":"https://codeload.github.com/soravux/scoop/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245681347,"owners_count":20655173,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T16:00:52.770Z","updated_at":"2025-10-21T06:20:06.407Z","avatar_url":"https://github.com/soravux.png","language":"Python","readme":"![SCOOP logo](http://scoop.readthedocs.org/en/latest/_images/logo.png)\n\nSCOOP (Scalable COncurrent Operations in Python) is a distributed task\nmodule allowing concurrent parallel programming on various environments,\nfrom heterogeneous grids to supercomputers. Its documentation is available on http://scoop.readthedocs.org/ .\n\nPhilosophy\n==========\n\nSCOOP was designed from the following ideas:\n\n  * The **future** is parallel;\n  * Simple is beautiful;\n  * Parallelism should be simpler.\n    \nThese tenets are translated concretely in a **minimum number of functions** \nallowing **maximum parallel efficiency** while keeping at **minimum the \ninner knowledge required** to use them. It is implemented with Python 3 in mind \nwhile being compatible with Python 2.6+ to allow fast prototyping without sacrificing \nefficiency and speed.\n\nSome comments we received on SCOOP:\n\n  * \"I must say that that was by far the easiest upgrade I have probably ever done.  I still need to build and test it on the cluster, but on my development machine it took about 10 minutes to upgrade and test.\" [deap mailing list](https://groups.google.com/d/msg/deap-users/chQY-2HHZWM/4qZRkQuvbbIJ EBo)\n\nFeatures\n========\n\nSCOOP features and advantages over \n[futures](http://docs.python.org/dev/library/concurrent.futures.html),\n[multiprocessing](http://docs.python.org/dev/library/multiprocessing.html)\nand similar modules are as follows:\n\n  * Harness the power of **multiple computers** over network;\n  * Ability to spawn multiple tasks inside a task;\n  * API compatible with [PEP-3148](http://www.python.org/dev/peps/pep-3148/);\n  * Parallelizing serial code with only minor modifications;\n  * Efficient load-balancing.\n\nAnatomy of a SCOOPed program\n----------------------------\n\nSCOOP can handle multiple diversified multi-layered tasks. With it, you can submit your different functions and data simultaneously and effortlessly while the framework executes them locally or remotely. Contrarily to most multiprocessing frameworks, it allows to launch subtasks within tasks.\n\n![Intro tree](http://scoop.readthedocs.org/en/latest/_images/introductory_tree.png)\n\nThrough SCOOP, you can execute simultaneously tasks that are different by \nnature, shown by the task color, or different by complexity, shown by the task radius. The module will handle the physical considerations of parallelization, such as task distribution over your resources (load balancing), communications, etc.\n\nApplications\n------------\n\nThe common applications of SCOOP consist but is not limited to:\n\n  * Evolutionary Algorithms\n  * Monte Carlo simulations\n  * Data mining\n  * Data processing\n  * Graph traversal\n\nCiting SCOOP\n============\n\nAuthors of scientific papers including results generated using SCOOP are encouraged to cite the following paper.\n\n{{{\n@inproceedings{SCOOP_XSEDE2014,\n  title={Once you SCOOP, no need to fork},\n  author={Hold-Geoffroy, Yannick and Gagnon, Olivier and Parizeau, Marc},\n  booktitle={Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment},\n  pages={60},\n  year={2014},\n  organization={ACM}\n}\n}}}\n\nUseful links\n============\n\nYou can [download the latest stable version](https://pypi.python.org/pypi/scoop/), check the [project  documentation](http://scoop.readthedocs.org/), post to the [mailing list](http://groups.google.com/group/scoop-users) or [submit an issue](https://github.com/soravux/scoop/issues) if you've found one.\n","funding_links":[],"categories":["Concurrency and Parallelism","Python","资源列表","Algorithms and Design Patterns","HarmonyOS","并发和并行","Concurrency and Parallelism [🔝](#readme)","Awesome Python"],"sub_categories":["并发和并行","Windows Manager","Concurrency and Parallelism"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsoravux%2Fscoop","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsoravux%2Fscoop","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsoravux%2Fscoop/lists"}