https://github.com/saturncloud/poc-large-file-transfer
POC for how to download and extract large numbers of files to parquet format for reading by a Dask cluster.
https://github.com/saturncloud/poc-large-file-transfer
Last synced: about 1 month ago
JSON representation
POC for how to download and extract large numbers of files to parquet format for reading by a Dask cluster.
- Host: GitHub
- URL: https://github.com/saturncloud/poc-large-file-transfer
- Owner: saturncloud
- Created: 2021-12-06T16:49:49.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2021-12-06T17:36:10.000Z (over 4 years ago)
- Last Synced: 2024-04-16T02:03:25.806Z (about 2 years ago)
- Language: Jupyter Notebook
- Homepage: https://saturncloud.io/docs/examples/python/load-data/qs-load-data-s3/
- Size: 12.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0