{"id":15677519,"url":"https://github.com/rasbt/datapipes-blog","last_synced_at":"2025-10-29T15:04:07.809Z","repository":{"id":66172042,"uuid":"501854544","full_name":"rasbt/datapipes-blog","owner":"rasbt","description":"Code for the DataPipes article","archived":false,"fork":false,"pushed_at":"2022-06-14T13:36:57.000Z","size":21,"stargazers_count":13,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-31T04:41:18.241Z","etag":null,"topics":["deep-learning","machine-learning","python","pytorch"],"latest_commit_sha":null,"homepage":"https://sebastianraschka.com/blog/2022/datapipes.html","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rasbt.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-06-10T00:56:00.000Z","updated_at":"2024-02-29T04:57:55.000Z","dependencies_parsed_at":null,"dependency_job_id":"0d4c3bc5-a7a4-4463-8177-ad2b6a02f3b0","html_url":"https://github.com/rasbt/datapipes-blog","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rasbt%2Fdatapipes-blog","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rasbt%2Fdatapipes-blog/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rasbt%2Fdatapipes-blog/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rasbt%2Fdatapipes-blog/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rasbt","download_url":"https://codeload.github.com/rasbt/datapipes-blog/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252793568,"owners_count":21805055,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","machine-learning","python","pytorch"],"created_at":"2024-10-03T16:09:47.746Z","updated_at":"2025-10-29T15:04:02.779Z","avatar_url":"https://github.com/rasbt.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"## About\n\nThis is the complementary code for the article [Taking Datasets, DataLoaders, and PyTorch’s New DataPipes for a Spin](https://sebastianraschka.com/blog/2022/datapipes.html).\n\n\n\nTo recreate the environment used in this blogpost, you can use \n\n\n```bash\nconda create --name datapipes python=3.8\nconda activate datapipes\npip install -r requirements.txt\n```\n\n\n\nThe code was run using\n\n```\nPython version: 3.8.13\n\ntorch: 1.11.0\ntorchdata: 0.3.0\n```\n\n\n\n## Running the Code\n\n\n\nRun the [`0_download-and-prep-data.ipynb`](0_download-and-prep-data.ipynb) notebook first to download the dataset. The data loading scripts are all independent and self-contained and can be run in any order\n\n- [1_dataset-csv.py](1_dataset-csv.py): `python 1_dataset-csv.py`\n- [2_imagefolder.py](2_imagefolder.py):  `python 2_imagefolder.py`\n- [3_datapipes-csv.py](3_datapipes-csv.py): `python 3_datapipes-csv.py`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frasbt%2Fdatapipes-blog","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frasbt%2Fdatapipes-blog","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frasbt%2Fdatapipes-blog/lists"}