https://github.com/radanalyticsio/scorpion-stare

Spark scheduler backend plug-ins for awareness of kube, openshift, oshinko, etc
https://github.com/radanalyticsio/scorpion-stare

Last synced: about 1 year ago
JSON representation

Spark scheduler backend plug-ins for awareness of kube, openshift, oshinko, etc

• Host: GitHub
• URL: https://github.com/radanalyticsio/scorpion-stare
• Owner: radanalyticsio
• License: apache-2.0
• Created: 2016-07-15T21:30:14.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2016-09-21T21:12:42.000Z (almost 10 years ago)
• Last Synced: 2025-03-22T04:02:10.635Z (over 1 year ago)
• Language: Scala
• Size: 21.5 KB
• Stars: 8
• Watchers: 6
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# scorpion-stare

Spark scheduler backend plug-ins for awareness of kube, openshift, oshinko, etc

build a plug-in into local (uber-)jar files:

    $ cd /path/to/scorpion-stare

    $ sbt oshinko/assembly

using custom scorpion-stare build of spark:

    $ cd /path/to/spark

    $ ./bin/spark-shell --master "local-cluster[2,1,1024]" --jars /path/to/scorpion-stare/oshinko/target/scala-2.11/scorpion_stare.jar

The spark-shell should recognize the `OshinkoService` plug-in for `WorkerScaleoutService`