{"id":19182020,"url":"https://github.com/hypershell/hypershell","last_synced_at":"2026-03-17T16:38:57.001Z","repository":{"id":42204296,"uuid":"228245712","full_name":"hypershell/hypershell","owner":"hypershell","description":"Cross-platform, high-throughput computing utility for processing shell commands over a distributed, asynchronous queue.","archived":false,"fork":false,"pushed_at":"2025-06-19T18:01:12.000Z","size":3852,"stargazers_count":41,"open_issues_count":3,"forks_count":3,"subscribers_count":2,"default_branch":"master","last_synced_at":"2026-02-21T14:39:43.483Z","etag":null,"topics":["cluster","command-line-tool","distributed-computing","hacktoberfest","high-performance-computing","shell-scripting"],"latest_commit_sha":null,"homepage":"https://hypershell.org","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hypershell.png","metadata":{"files":{"readme":"README.rst","changelog":null,"contributing":"docs/contributing.rst","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":"docs/roadmap.rst","authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-12-15T20:15:21.000Z","updated_at":"2026-01-29T16:24:58.000Z","dependencies_parsed_at":"2024-04-08T02:46:23.544Z","dependency_job_id":"aa7d9d32-62a8-4d4f-accb-4fc72ce2f09d","html_url":"https://github.com/hypershell/hypershell","commit_stats":{"total_commits":368,"total_committers":1,"mean_commits":368.0,"dds":0.0,"last_synced_commit":"67fbbdd6dfe354332b16f4f4dfb2bc58ec7711cb"},"previous_names":["glentner/hypershell","hypershell/hypershell"],"tags_count":38,"template":false,"template_full_name":null,"purl":"pkg:github/hypershell/hypershell","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hypershell%2Fhypershell","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hypershell%2Fhypershell/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hypershell%2Fhypershell/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hypershell%2Fhypershell/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hypershell","download_url":"https://codeload.github.com/hypershell/hypershell/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hypershell%2Fhypershell/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30627241,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-17T14:16:03.965Z","status":"ssl_error","status_checked_at":"2026-03-17T14:16:03.380Z","response_time":56,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cluster","command-line-tool","distributed-computing","hacktoberfest","high-performance-computing","shell-scripting"],"created_at":"2024-11-09T10:56:17.209Z","updated_at":"2026-03-17T16:38:56.993Z","avatar_url":"https://github.com/hypershell.png","language":"Python","readme":"HyperShell v2: Distributed Task Execution for HPC\n=================================================\n\n.. image:: https://img.shields.io/badge/license-Apache-blue.svg?style=flat\n    :target: https://www.apache.org/licenses/LICENSE-2.0\n    :alt: License\n\n.. image:: https://img.shields.io/github/v/release/hypershell/hypershell?sort=semver\n    :target: https://github.com/hypershell/hypershell/releases\n    :alt: Github Release\n\n.. image:: https://img.shields.io/badge/Python-3.9+-blue.svg\n    :target: https://www.python.org/downloads\n    :alt: Python Versions\n\n.. image:: https://static.pepy.tech/badge/hypershell/month\n    :target: https://pypi.org/project/hypershell/\n    :alt: PyPI Monthly Downloads\n\n.. image:: https://img.shields.io/badge/Contributor%20Covenant-2.1-4baaaa.svg\n    :target: https://www.contributor-covenant.org/version/2/1/code_of_conduct/\n    :alt: Code of Conduct\n\n.. image:: https://readthedocs.org/projects/hypershell/badge/?version=latest\n    :target: https://hypershell.readthedocs.io/en/latest/?badge=latest\n    :alt: Documentation Status\n\n.. image:: https://github.com/hypershell/hypershell/actions/workflows/tests.yml/badge.svg\n    :target: https://github.com/hypershell/hypershell/actions/workflows/tests.yml\n    :alt: Tests\n\n|\n\n*HyperShell* is an elegant, cross-platform, high-throughput computing utility for\nprocessing shell commands over a distributed, asynchronous queue. It is a highly\nscalable workflow automation tool for *many-task* scenarios.\n\nBuilt on Python and tested on Linux, macOS, and Windows.\n\nSeveral tools offer similar functionality but not all together in a single tool with\nthe user ergonomics we provide. Novel design elements include but are not limited to\n\n* **Cross-platform:** run on any platform where Python runs. In fact, the server and\n  client can run on different platforms in the same cluster.\n* **Client-server:** workloads do not need to be monolithic. Run the server as a\n  stand-alone service with SQLite or Postgres as a persistent database and dynamically\n  scale clients as needed.\n* **Staggered launch:** At the largest scales (1000s of nodes, 100k+ of workers),\n  the launch process can be challenging. Come up gradually to balance the workload.\n* **Database in-the-loop:** run in-memory for quick, ad-hoc workloads. Otherwise,\n  include a database for persistence, recovery when restarting, and search.\n\n\nDocumentation\n-------------\n\nDocumentation is available at `hypershell.readthedocs.io \u003chttps://hypershell.readthedocs.io\u003e`_.\nFor basic usage information on the command line use: ``hs --help``. For a more\ncomprehensive usage guide on the command line you can view the manual page with \n``man hs``.\n\n\nContributions\n-------------\n\nContributions are welcome. If you find bugs or have questions, open an *Issue* here.\nWe've added a Code of Conduct recently, adapted from the\n`Contributor Covenant \u003chttps://www.contributor-covenant.org/\u003e`_, version 2.0.\n\n\nCitation\n--------\n\nIf *HyperShell* has helped in your research please consider citing us.\n\n.. code-block:: bibtex\n\n    @inproceedings{lentner_2022,\n        author = {Lentner, Geoffrey and Gorenstein, Lev},\n        title = {HyperShell v2: Distributed Task Execution for HPC},\n        year = {2022},\n        isbn = {9781450391610},\n        publisher = {Association for Computing Machinery},\n        url = {https://doi.org/10.1145/3491418.3535138},\n        doi = {10.1145/3491418.3535138},\n        booktitle = {Practice and Experience in Advanced Research Computing},\n        articleno = {80},\n        numpages = {3},\n        series = {PEARC '22}\n    }\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhypershell%2Fhypershell","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhypershell%2Fhypershell","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhypershell%2Fhypershell/lists"}