https://github.com/guangie88/nomad-spark
Spark Dockerfile setup with native support for Nomad as a scheduler
https://github.com/guangie88/nomad-spark
dockerfile nomad spark
Last synced: 14 days ago
JSON representation
Spark Dockerfile setup with native support for Nomad as a scheduler
- Host: GitHub
- URL: https://github.com/guangie88/nomad-spark
- Owner: guangie88
- License: mit
- Created: 2019-01-22T13:12:54.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2019-01-25T03:24:10.000Z (over 7 years ago)
- Last Synced: 2025-02-28T20:26:33.033Z (over 1 year ago)
- Topics: dockerfile, nomad, spark
- Language: Dockerfile
- Size: 5.86 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# `nomad-spark`
Spark Dockerfile setup with native support for Nomad as a scheduler.
The current version(s) of Spark is/are built:
- 2.4.0
- 2.3.2
- 2.2.2
The current version(s) of Nomad is/are built:
- 0.8.6
The current version(s) of Hadoop is/are built:
- 2.7
The current version(s) of Java is/are built:
- 8
Note that both Spark and Nomad should be fairly compliant (though at your own
risk) across patch versions, i.e. Spark 2.3.2 can be used to replace Spark
2.3.1, so generally one only needs to look at the `{Major}.{Minor}` built
versions for the right selection.
Hadoop generally follows the above logic.
Java, on the other hand, should be fairly compliant across its major versions.