{"id":18843453,"url":"https://github.com/ai-hypercomputer/pathways-utils","last_synced_at":"2026-04-04T05:03:34.570Z","repository":{"id":256274453,"uuid":"843534664","full_name":"AI-Hypercomputer/pathways-utils","owner":"AI-Hypercomputer","description":"Package of Pathways-on-Cloud utilities","archived":false,"fork":false,"pushed_at":"2026-01-21T23:42:26.000Z","size":240,"stargazers_count":23,"open_issues_count":10,"forks_count":10,"subscribers_count":2,"default_branch":"main","last_synced_at":"2026-01-22T11:55:11.600Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AI-Hypercomputer.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-08-16T18:18:59.000Z","updated_at":"2026-01-19T20:20:07.000Z","dependencies_parsed_at":"2024-09-10T00:24:55.832Z","dependency_job_id":"401d33c9-2840-4a72-bf04-8290be2f5bb4","html_url":"https://github.com/AI-Hypercomputer/pathways-utils","commit_stats":null,"previous_names":["google/pathways-utils","ai-hypercomputer/pathways-utils"],"tags_count":8,"template":false,"template_full_name":null,"purl":"pkg:github/AI-Hypercomputer/pathways-utils","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AI-Hypercomputer%2Fpathways-utils","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AI-Hypercomputer%2Fpathways-utils/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AI-Hypercomputer%2Fpathways-utils/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AI-Hypercomputer%2Fpathways-utils/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AI-Hypercomputer","download_url":"https://codeload.github.com/AI-Hypercomputer/pathways-utils/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AI-Hypercomputer%2Fpathways-utils/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28794637,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-26T21:49:50.245Z","status":"ssl_error","status_checked_at":"2026-01-26T21:48:29.455Z","response_time":59,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-08T02:57:50.908Z","updated_at":"2026-01-27T01:06:47.006Z","avatar_url":"https://github.com/AI-Hypercomputer.png","language":"Python","readme":"# Package of Pathways-on-Cloud utilities\n\nPathways is a novel compute orchestration method that enables single controller runtime ML workloads.\nThis approach unlocks a range of new capabilities for training resiliency, multihost inference and interactive development on cluster of arbitrary scale.\nPathways simplifies large-scale machine learning computations by enabling a single JAX client to orchestrate workloads across multiple large TPU slices, potentially spanning hundreds or thousands of TPU chips. Pathways is used internally at Google to train large models like Gemini. Pathways on Cloud brings the same benefits to Google Cloud customers.\n\nTo make it as easy as possible for you to leverage Pathways on Cloud, we've bundled the necessary cloud-specific integrations into a single Python package and a set of container images.\nThis package handles the underlying adaptations required for the cloud environment, allowing you to focus on your core workflows with minimal setup.\n\n# Further Reading\n[Pathways Research Paper](https://arxiv.org/abs/2203.12533)\n\n[More resources coming Soon]\n\n\n# How to get access to Pathways on Cloud\n\nPathways on Cloud is currently in Preview.\nPlease contact your Google Cloud account representative to request access to Pathways.\n\n\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fai-hypercomputer%2Fpathways-utils","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fai-hypercomputer%2Fpathways-utils","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fai-hypercomputer%2Fpathways-utils/lists"}