{"id":23532965,"url":"https://github.com/vspiewak/twitter-sentiment-analysis","last_synced_at":"2025-04-22T22:41:30.182Z","repository":{"id":27970641,"uuid":"31463840","full_name":"vspiewak/twitter-sentiment-analysis","owner":"vspiewak","description":"Streaming tweets with spark, language detection \u0026 sentiment analysis, dashboard with Kibana","archived":false,"fork":false,"pushed_at":"2015-12-21T04:44:19.000Z","size":1334,"stargazers_count":103,"open_issues_count":5,"forks_count":71,"subscribers_count":14,"default_branch":"master","last_synced_at":"2025-03-29T19:34:32.025Z","etag":null,"topics":["dashboard","kibana","nlp","scala","sentiment-analysis","spark","tiwtter"],"latest_commit_sha":null,"homepage":"","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/vspiewak.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-02-28T13:46:35.000Z","updated_at":"2024-12-26T16:45:52.000Z","dependencies_parsed_at":"2022-08-21T05:10:28.094Z","dependency_job_id":null,"html_url":"https://github.com/vspiewak/twitter-sentiment-analysis","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vspiewak%2Ftwitter-sentiment-analysis","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vspiewak%2Ftwitter-sentiment-analysis/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vspiewak%2Ftwitter-sentiment-analysis/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/vspiewak%2Ftwitter-sentiment-analysis/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/vspiewak","download_url":"https://codeload.github.com/vspiewak/twitter-sentiment-analysis/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250337277,"owners_count":21414092,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dashboard","kibana","nlp","scala","sentiment-analysis","spark","tiwtter"],"created_at":"2024-12-25T23:13:23.876Z","updated_at":"2025-04-22T22:41:30.167Z","avatar_url":"https://github.com/vspiewak.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"Twitter Sentiment Analysis\n==========================\n\n* retrieve tweets using Spark Streaming\n* language detection\n* sentiment analysis (StanfordNLP)   \n* index tweets in Elasticsearch \n* live dashboard using Kibana\n\n\nDocker setup\n------------\n\nConfigure Twitter OAuth in [`docker-compose.yml`](./docker-compose.yml) file.\n\nAfter installing docker \u0026 docker-compose, you can launch the stack with the following commands:\n\n    docker-compose build\n    docker-compose up\n\n\nAfter a while, Elasticsearch, Kibana, and Spark should be up:\n\n * http://0.0.0.0:4040/streaming\n * http://0.0.0.0:9200/_plugin/head\n * http://0.0.0.0:5601 \n\n\nManual setup\n------------\n\n    curl -O http://d3kbcqa49mib13.cloudfront.net/spark-1.5.2.tgz\n    tar xvzf spark-1.5.2.tgz\n    cd spark-1.5.2\n    ./sbt/sbt assembly\n    \n    cd ..\n\n    curl -O https://download.elasticsearch.org/elasticsearch/release/org/elasticsearch/distribution/tar/elasticsearch/2.1.1/elasticsearch-2.1.1.tar.gz\n    tar xvzf elasticsearch-2.1.1.tar.gz\n    cd elasticsearch-2.1.1\n    bin/plugin -install mobz/elasticsearch-head\n    bin/elasticsearch -d\n\n    cd ..\n    chmod a+x insert.dashboard.sh\n    ./insert.dashboard.sh\n\n    curl -O https://download.elastic.co/kibana/kibana/kibana-4.3.1-linux-x64.tar.gz\n    tar xvzf kibana-4.3.1-linux-x64.tar.gz \n    cd kibana-4.3.1-linux-x64\n    bin/kibana\n\n    cd ..\n\n    curl -L -O https://dl.bintray.com/sbt/native-packages/sbt/0.13.9/sbt-0.13.9.tgz\n    tar xvzf sbt-0.13.9.tgz\n\n    JAVA_OPTS=-Xmx2G sbt/bin/sbt assembly\n\n    ../spark-1.5.2/bin/spark-submit \\\n    --class com.github.vspiewak.TwitterSentimentAnalysis \\\n    --master local[2] \\\n    target/scala-2.10/twitter-sentiment-analysis-assembly-0.1-SNAPSHOT.jar \\\n    \u003cconsumer_key\u003e \\\n    \u003cconsumer_secret\u003e \\\n    \u003caccess_token\u003e \\\n    \u003caccess_token_secret\u003e \\\n    [\u003cfilters\u003e]\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvspiewak%2Ftwitter-sentiment-analysis","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvspiewak%2Ftwitter-sentiment-analysis","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvspiewak%2Ftwitter-sentiment-analysis/lists"}