https://github.com/mikhailadvani/aws_s3sync

Upload files to AWS S3
https://github.com/mikhailadvani/aws_s3sync

aws aws-s3 backup sync

Last synced: about 1 month ago
JSON representation

Upload files to AWS S3

• Host: GitHub
• URL: https://github.com/mikhailadvani/aws_s3sync
• Owner: mikhailadvani
• License: apache-2.0
• Created: 2017-04-19T15:14:14.000Z (about 9 years ago)
• Default Branch: master
• Last Pushed: 2017-05-02T11:33:50.000Z (about 9 years ago)
• Last Synced: 2026-03-20T09:46:31.238Z (4 months ago)
• Topics: aws, aws-s3, backup, sync
• Language: Python
• Size: 14.6 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# aws_s3sync

## Installation

`pip install aws_s3sync`

## Execution

#### Pre-requisites

Setup the following environment variables

* **AWS_ACCESS_KEY_ID**

* **AWS_SECRET_ACCESS_KEY**

#### Commands

`sync_to_s3`

`sync_from_s3`

#### Arguments

```

  -h, --help            show this help message and exit

  -b BUCKET, --bucket BUCKET

                        Upload: Selects the S3 bucket to upload data to.

                        Download: Selects the S3 bucket to download data from

  -f FILE_PATH, --file_path FILE_PATH

                        Upload: Path of the file to be uploaded. Download:

                        Path to download file to

  -k KEY, --key KEY     Key of the object. Same as file_path is undefined for

                        upload

  -m {auto,sync,single-part-upload}, --mode {auto,sync,single-part-upload}

                        Mode of upload/download

  --chunk_size CHUNK_SIZE

                        Size of chunk in multipart upload in MB

  --multipart_threshold MULTIPART_THRESHOLD

                        Minimum size in MB to upload using multipart

```

##### Mode

* `auto` : Upload: Single-part upload or multi-part upload will be chosen based on the file being smaller/larger than `multipart_threshold`

* `sync` : Upload/downloand file to/from S3 only if the local/remote file have different signatures. Checked based on ETag/MD5

* `single-part-upload` : Force single-part upload. Applicable only for files of size larger than `multipart_threshold`