Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists by webdataset
A curated list of projects in awesome lists by webdataset .
https://github.com/webdataset/webdataset
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
data-augmentation deep-learning pytorch webdataset webdataset-format
Last synced: 07 Jan 2025
https://github.com/webdataset/tarp
Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.
Last synced: 14 Nov 2024
https://github.com/webdataset/webdataset.jl
A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library
deep-learning julia julia-multithreading shards tar-files
Last synced: 14 Nov 2024
https://github.com/webdataset/wdsconversions
conversions of standard pytorch datasets to webdataset format
Last synced: 14 Nov 2024