https://github.com/hellomaxime/sparkstreaming-cassandra

spark streaming to cassandra
https://github.com/hellomaxime/sparkstreaming-cassandra

apache-spark cassandra nosql spark-streaming

Last synced: about 2 months ago
JSON representation

spark streaming to cassandra

• Host: GitHub
• URL: https://github.com/hellomaxime/sparkstreaming-cassandra
• Owner: hellomaxime
• Created: 2022-07-24T12:29:11.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-07-24T12:38:55.000Z (over 2 years ago)
• Last Synced: 2023-07-20T15:02:45.673Z (over 1 year ago)
• Topics: apache-spark, cassandra, nosql, spark-streaming
• Language: Scala
• Homepage:
• Size: 12.1 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# sparkstreaming-cassandra

Scala version __2.12.15__

An external library is needed : __spark-cassandra-connector-assembly-3.0.0-18-gcb4065b5.jar__  

File -> Project Structure -> Libraries -> `+`

Start Cassandra server

`cassandra -f`

Keyspace and Table creation + Insertion  

`CREATE KEYSPACE spark WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 1};`  

`CREATE TABLE spark.user(id text PRIMARY KEY, name text, city text, age text);`  

`INSERT INTO spark.user(id, name, city, age) VALUES ('a1', 'Alice', 'New York', '27');`