Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kirbs-/svm
Apache Spark Version Manager
https://github.com/kirbs-/svm
apache-spark spark
Last synced: 15 days ago
JSON representation
Apache Spark Version Manager
- Host: GitHub
- URL: https://github.com/kirbs-/svm
- Owner: kirbs-
- License: mit
- Created: 2017-12-21T00:51:29.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2018-01-03T13:21:52.000Z (about 7 years ago)
- Last Synced: 2024-12-29T05:08:39.497Z (about 1 month ago)
- Topics: apache-spark, spark
- Language: Python
- Size: 10.7 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# svm: Spark Version Manager
Manage Apache Spark installations with a simplified CLI.
# Installation
1. `pip install svm`
2. Set SPARK_HOME environmental variable to ~/.svm/active_spark
# Usage
List official Spark versions
`svm --list`
Install specific version
`svm --install 2.2.1`
Activate specified version (must be installed first)
`svm --activate 2.2.1`
Disable
`svm --deactivate`
# How this works
svm installs Spark versions into the local user's home directory in .svm folder. Then symlinks .svm/active_spark to the version directory you want active.