https://github.com/47degrees/twitter-sentiment
Twitter Stream to Google PubSub and Google PubSub to Cassandra
https://github.com/47degrees/twitter-sentiment
Last synced: over 1 year ago
JSON representation
Twitter Stream to Google PubSub and Google PubSub to Cassandra
- Host: GitHub
- URL: https://github.com/47degrees/twitter-sentiment
- Owner: 47degrees
- License: apache-2.0
- Created: 2018-03-06T20:59:44.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2018-03-28T02:13:19.000Z (over 8 years ago)
- Last Synced: 2025-02-03T14:42:45.951Z (over 1 year ago)
- Language: Scala
- Size: 21.5 KB
- Stars: 1
- Watchers: 51
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# twitter-sentiment
Twitter Stream to Google PubSub and Google PubSub to Cassandra
This project showcases some usages of the services in the Google Cloud Platform and their integration with other components.
This is an SBT project developed in Scala featuring two modules:
- Module `reader`: It reads from a Twitter stream and submits into a Google PubSub topic.
- Module `storer`: It reads messages from a Google PubSub topic and persist them in Casssandra.
## Usage
* To run the reader module
`sbt "project reader" "run"`
* To run the storer module
`sbt "project storer" "run"`
## Integration tests
`sbt it:test`
We use the [docker-it-scala](https://github.com/whisklabs/docker-it-scala) library to pull a cassandra image running in docker with the same version that we use in runtime.
[cassandra-unit](https://github.com/jsevellec/cassandra-unit) is used to create the keyspaces in this cassandra instance.