Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jmoney/s3-multipart-upload
Upload files in a directory to s3 via multipart uploads. The uploaded parts are checkpointed to a local file for restarting purposes.
https://github.com/jmoney/s3-multipart-upload
aws github-site homebrew-formula license-updater mkdocs
Last synced: about 2 months ago
JSON representation
Upload files in a directory to s3 via multipart uploads. The uploaded parts are checkpointed to a local file for restarting purposes.
- Host: GitHub
- URL: https://github.com/jmoney/s3-multipart-upload
- Owner: jmoney
- License: apache-2.0
- Created: 2023-08-26T19:20:57.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-01-01T03:05:59.000Z (about 1 year ago)
- Last Synced: 2024-11-24T20:07:29.582Z (2 months ago)
- Topics: aws, github-site, homebrew-formula, license-updater, mkdocs
- Language: Go
- Homepage: https://www.jmoney.dev/s3-multipart-upload
- Size: 22.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# s3-multipart-upload
Upload files in a directory to s3 via multipart uploads. The uploaded parts are checkpointed to a local file for restarting purposes.
## Overview
| Arguemment | Description | Default Value |
| --- | --- | --- |
| bucket | The bucket name to multipart upload too. | No Default |
| checkpoint | The directory to store the checkpoint files. | ./.checkpoints |
| dir | The directory of all the files to multipart upload with. This directory will be mirrored into s3. | No Default |
| partSize | The size of each part to upload. | 100MB |## Installation
```bash
brew tap jmoney/aws
brew install s3-multipart-upload
```## Run Locally
```bash
go run cmd/cli/main.go -bucket test-bucket -dir sample
```This will mirror the contents of the directory `sample` into the root of bucket `test-bucket` and store the checkpoint files for the multipart-uploads into the `./.checkpoints`.