https://github.com/scylladb/scylla-migrator

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.
https://github.com/scylladb/scylla-migrator

alternator dynamodb migration scylladb spark

Last synced: about 2 months ago
JSON representation

Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator.

• Host: GitHub
• URL: https://github.com/scylladb/scylla-migrator
• Owner: scylladb
• License: apache-2.0
• Created: 2019-01-25T00:01:47.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2024-07-31T09:05:13.000Z (about 2 months ago)
• Last Synced: 2024-07-31T09:55:45.880Z (about 2 months ago)
• Topics: alternator, dynamodb, migration, scylladb, spark
• Language: Scala
• Homepage: https://migrator.docs.scylladb.com/stable/
• Size: 444 KB
• Stars: 54
• Watchers: 10
• Forks: 34
• Open Issues: 56
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-repositories - scylladb/scylla-migrator - Migrate data extract using Spark to Scylla, normally from Cassandra/parquet files. Alt. from DynamoDB to Scylla Alternator. (Scala)

README

        
# ScyllaDB Migrator

The ScyllaDB Migrator is a Spark application that migrates data to ScyllaDB from CQL-compatible or DynamoDB-compatible databases.

## Documentation

See https://migrator.docs.scylladb.com.

## Building

To test a custom version of the migrator that has not been [released](https://github.com/scylladb/scylla-migrator/releases), you can build it yourself by cloning this Git repository and following the steps below:

1. Make sure the Java 8+ JDK and `sbt` are installed on your machine.

2. Export the `JAVA_HOME` environment variable with the path to the

   JDK installation.

3. Run `build.sh`.

4. This will produce the .jar file to use in the `spark-submit` command at path `migrator/target/scala-2.13/scylla-migrator-assembly.jar`.

## Contributing

Please refer to the file [CONTRIBUTING.md](/CONTRIBUTING.md).