Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/honza/s3-glacier-uploader
https://github.com/honza/s3-glacier-uploader
Last synced: about 8 hours ago
JSON representation
- Host: GitHub
- URL: https://github.com/honza/s3-glacier-uploader
- Owner: honza
- License: gpl-3.0
- Created: 2022-05-23T13:14:20.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2022-05-23T13:16:18.000Z (over 2 years ago)
- Last Synced: 2024-06-20T20:38:04.145Z (5 months ago)
- Language: Go
- Size: 16.6 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
s3-glacier-uploader
===================A CLI tool for uploading large files to AWS S3 Glacier
We assume that you have the AWS tools configured, and we use that for
authentication. When uploading a file, you need to give us a bucket name, and
a region. We set the storage class to "Deep Archive".## Usage
To upload a file:
```
$ s3-glacier-uploader --bucket --region
```Your file is uploaded in 50MB chunks, and can be really big. AWS produces an MD5
checksum for each chunk so we verify the integrity of the data.## TODO
* Resuming a failed upload
## Prior art
Originally based on
https://mehranjnf.medium.com/s3-multipart-upload-with-goroutines-92a7aebe831b