{"id":18421982,"url":"https://github.com/spcl/nopfs","last_synced_at":"2026-01-23T11:47:23.385Z","repository":{"id":135158955,"uuid":"381089440","full_name":"spcl/NoPFS","owner":"spcl","description":"Near-optimal Prefetching System","archived":false,"fork":false,"pushed_at":"2021-11-17T17:53:19.000Z","size":63,"stargazers_count":33,"open_issues_count":0,"forks_count":6,"subscribers_count":18,"default_branch":"main","last_synced_at":"2025-02-10T00:57:55.611Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/spcl.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-06-28T16:03:56.000Z","updated_at":"2024-10-18T02:18:06.000Z","dependencies_parsed_at":null,"dependency_job_id":"57ef400e-8511-43eb-a955-0ce49f89b6ca","html_url":"https://github.com/spcl/NoPFS","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spcl%2FNoPFS","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spcl%2FNoPFS/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spcl%2FNoPFS/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spcl%2FNoPFS/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/spcl","download_url":"https://codeload.github.com/spcl/NoPFS/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248710445,"owners_count":21149190,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T04:27:35.222Z","updated_at":"2026-01-23T11:47:18.360Z","avatar_url":"https://github.com/spcl.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# NoPFS\n\nNoPFS is the Near-optimal Prefetching System, an I/O middleware that optimizes distributed machine learning I/O at scale.\n\nFor more details, check our paper from Supercomputing 2021: [Clairvoyant Prefetching for Distributed Machine Learning I/O](https://arxiv.org/abs/2101.08734).\n```\n@inproceedings{dryden2021clairvoyant,\n  title={CLairvoyant Prefetching for Distributed Machine Learning {I/O}},\n  author={Nikoli Dryden and Roman B\\\"{o}hringer and Tal Ben-Nun and Torsten Hoefler},\n  booktitle={Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC)},\n  year={2021},\n  eprint={2101.08734},\n  archivePrefix={arXiv},\n  primaryClass={cs.DC}\n}\n```\n\n----\n\nWe are currently preparing a more \"production-ready\" release, which will be out soon! If you are interested in the original \"research\" code, look at the `old-nopfs` branch.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspcl%2Fnopfs","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fspcl%2Fnopfs","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspcl%2Fnopfs/lists"}