https://github.com/atothey/twitterwithspark
https://github.com/atothey/twitterwithspark
Last synced: 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/atothey/twitterwithspark
- Owner: AtotheY
- Created: 2015-11-26T07:09:24.000Z (over 10 years ago)
- Default Branch: master
- Last Pushed: 2016-02-05T04:55:52.000Z (over 10 years ago)
- Last Synced: 2025-01-01T19:44:04.815Z (over 1 year ago)
- Language: Scala
- Size: 36.1 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
#Twitter With Spark
Working on implementing from this source
https://databricks.gitbooks.io/databricks-spark-reference-applications/content/twitter_classifier/collect.html
To run this, you either need a twitter.txt file with your oauth info in it placed in /src/, or use Intellij to set program arguments.
If using Intellij, make sure your program arguments are clean (i.e not consumerKey=********, just ********). Also, this project uses some outdated
Spark streaming libraries due to compatibility issues with Spark, Spark Streaming, and Scala. Using Scala sdk v2.10.5, Spark-core 2.10.1, Spark streaming 2.10.1