https://github.com/paultuckey/s3_bucket_to_bucket_copy_py

Script to copy an AWS S3 Bucket to another bucket using many threads in Python
https://github.com/paultuckey/s3_bucket_to_bucket_copy_py

Last synced: 27 days ago
JSON representation

Script to copy an AWS S3 Bucket to another bucket using many threads in Python

• Host: GitHub
• URL: https://github.com/paultuckey/s3_bucket_to_bucket_copy_py
• Owner: paultuckey
• Created: 2012-12-18T20:00:01.000Z (almost 12 years ago)
• Default Branch: master
• Last Pushed: 2015-03-13T22:34:11.000Z (over 9 years ago)
• Last Synced: 2024-05-02T00:46:57.414Z (7 months ago)
• Language: Python
• Size: 189 KB
• Stars: 53
• Watchers: 5
• Forks: 32
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
s3_bucket_to_bucket_copy.py

===========================

Script to copy all files (or files with given prefix) from an AWS S3 Bucket in one region to another bucket in a different region using many

threads in Python.

Add a file, .s3cfg, to your home directory with the following format (or download s3cmd and run "s3cmd --configure"):

```

[default]

access_key = 

secret_key = 

```

Then run:

```

s3_bucket_to_bucket_copy.py [/]  

```

Note, For OSX users, make sure the Python boto package is installed:

```

sudo easy_install boto

pip install -U boto

```

When dealing with a very large number of files, you might want to try to use more worker threads:

```

s3_bucket_to_bucket_copy.py [/]  -t 100

```

Developed by us guys at [Showcase Workshop](http://www.showcaseworkshop.com).

Other Contributors:

* Joshua Richardson [Chegg, Inc.](http://chegg.com).