https://github.com/slacky300/streamvault
StreamVault is a high-performance S3 bulk downloader platform that solves a critical AWS S3 limitation: efficiently downloading entire folder hierarchies with thousands of files. Built with a memory-optimized streaming architecture, it handles massive downloads (50GB+ tested, theoretically unlimited) while maintaining minimal memory footprint.
https://github.com/slacky300/streamvault
aws-s3 bullmq docker nodejs redis zip-stream
Last synced: 5 months ago
JSON representation
StreamVault is a high-performance S3 bulk downloader platform that solves a critical AWS S3 limitation: efficiently downloading entire folder hierarchies with thousands of files. Built with a memory-optimized streaming architecture, it handles massive downloads (50GB+ tested, theoretically unlimited) while maintaining minimal memory footprint.
- Host: GitHub
- URL: https://github.com/slacky300/streamvault
- Owner: Slacky300
- License: isc
- Created: 2025-04-28T16:55:38.000Z (5 months ago)
- Default Branch: master
- Last Pushed: 2025-05-03T16:41:04.000Z (5 months ago)
- Last Synced: 2025-05-07T03:52:39.618Z (5 months ago)
- Topics: aws-s3, bullmq, docker, nodejs, redis, zip-stream
- Language: TypeScript
- Homepage: https://stream-vault-landing.vercel.app
- Size: 82 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0