https://github.com/guangie88/spark-addons-docker

Dockerfile setup with GS and S3 JARs add-ons to Spark
https://github.com/guangie88/spark-addons-docker

dockerfile gcs s3 spark

Last synced: 12 days ago
JSON representation

Dockerfile setup with GS and S3 JARs add-ons to Spark

• Host: GitHub
• URL: https://github.com/guangie88/spark-addons-docker
• Owner: guangie88
• License: mit
• Created: 2019-01-29T01:13:23.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2019-02-07T03:17:28.000Z (over 7 years ago)
• Last Synced: 2025-02-28T20:26:29.741Z (over 1 year ago)
• Topics: dockerfile, gcs, s3, spark
• Size: 4.88 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# `spark-addons-docker`

Dockerfile setup with GS and S3 JARs add-ons to

[`spark`](https://github.com/guangie88/spark-docker).

If this is set up as a Spark slave, then it would be able to read directly from

both Google Storage (GS) bucket or AWS S3 bucket.

This builds for both slimmed Debian and Alpine.