https://github.com/phact/spark-migration
cluster migration with spark
https://github.com/phact/spark-migration
Last synced: 7 months ago
JSON representation
cluster migration with spark
- Host: GitHub
- URL: https://github.com/phact/spark-migration
- Owner: phact
- Created: 2016-02-18T18:35:25.000Z (over 10 years ago)
- Default Branch: master
- Last Pushed: 2016-02-27T02:30:56.000Z (over 10 years ago)
- Last Synced: 2025-01-03T10:23:52.939Z (over 1 year ago)
- Language: Java
- Size: 8.79 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# spark-migration
cluster migration with spark
Make sure to change the path to your dse.jar:
https://github.com/phact/spark-migration/blob/master/pom.xml#L43
You will need to tweak your case class to match the table you want to migrate. I'm working on a way to make this dynamic.
https://github.com/phact/spark-migration/blob/master/src/main/java/com/phact/Migrate.java#L32-L131
You can build with `mvn package` and run with `dse spark-submit target`
dse spark-submit --class com.phact.App target/sparkjJavaApi-1.0-SNAPSHOT.jar sourceNodeIP destinationNodeIP Keyspace.Table