Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/jmoney/s3-multipart-upload

Upload files in a directory to s3 via multipart uploads. The uploaded parts are checkpointed to a local file for restarting purposes.
https://github.com/jmoney/s3-multipart-upload

aws github-site homebrew-formula license-updater mkdocs

Last synced: about 2 months ago
JSON representation

Upload files in a directory to s3 via multipart uploads. The uploaded parts are checkpointed to a local file for restarting purposes.

Awesome Lists containing this project

README

        

# s3-multipart-upload

Upload files in a directory to s3 via multipart uploads. The uploaded parts are checkpointed to a local file for restarting purposes.

## Overview

| Arguemment | Description | Default Value |
| --- | --- | --- |
| bucket | The bucket name to multipart upload too. | No Default |
| checkpoint | The directory to store the checkpoint files. | ./.checkpoints |
| dir | The directory of all the files to multipart upload with. This directory will be mirrored into s3. | No Default |
| partSize | The size of each part to upload. | 100MB |

## Installation

```bash
brew tap jmoney/aws
brew install s3-multipart-upload
```

## Run Locally

```bash
go run cmd/cli/main.go -bucket test-bucket -dir sample
```

This will mirror the contents of the directory `sample` into the root of bucket `test-bucket` and store the checkpoint files for the multipart-uploads into the `./.checkpoints`.