https://github.com/facebookresearch/spdl

Scalable and Performant Data Loading
https://github.com/facebookresearch/spdl

dl ml

Last synced: 5 months ago
JSON representation

Scalable and Performant Data Loading

• Host: GitHub
• URL: https://github.com/facebookresearch/spdl
• Owner: facebookresearch
• License: bsd-2-clause
• Created: 2024-06-27T19:57:35.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-05-14T01:55:54.000Z (5 months ago)
• Last Synced: 2025-05-14T03:28:51.322Z (5 months ago)
• Topics: dl, ml
• Language: Python
• Homepage: https://facebookresearch.github.io/spdl/main/
• Size: 12.7 MB
• Stars: 258
• Watchers: 10
• Forks: 13
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Citation: CITATION.cff
  • Authors: AUTHORS

Awesome Lists containing this project

README

          
# SPDL

SPDL (Scalable and Performant Data Loading) is a library and project to

explore the design and performance of data loading with thread-based

parallelism.

## Documentation

Please checkout [the documentation](https://facebookresearch.github.io/spdl).

## License

SPDL is BSD 2-Clause licensed, as found in the LICENSE file.