https://github.com/rvalieris/hyperdrive

run snakemake workflows on AWS.
https://github.com/rvalieris/hyperdrive

aws snakemake

Last synced: 3 months ago
JSON representation

run snakemake workflows on AWS.

• Host: GitHub
• URL: https://github.com/rvalieris/hyperdrive
• Owner: rvalieris
• License: mit
• Created: 2020-10-09T15:38:30.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2020-10-15T17:12:16.000Z (over 5 years ago)
• Last Synced: 2025-03-11T18:07:03.339Z (over 1 year ago)
• Topics: aws, snakemake
• Language: Python
• Homepage:
• Size: 52.7 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          

# hyperdrive

run [snakemake](https://snakemake.readthedocs.io/) workflows on AWS.

## features

- uses spot instances

- dynamically picks instance-types according to cpus, memory, disk, price and other features

- uses instance storage when possible to reduce costs

- does not need a shared filesystem, all data is stored on S3

- stream all logs in real time to cloudwatch logs

- distributes instances across all AZs of a region

## getting started

read the [guide](docs/guide.md) and the [q&a](docs/qea.md).

## disclaimer

I wrote hyperdrive to scratch my own itch, it still has many rough edges, do not use it unless you understand how it works.