{"id":34978961,"url":"https://github.com/cfitzsimons/twitch-chat-running-sentiment","last_synced_at":"2026-04-27T14:03:27.592Z","repository":{"id":326454372,"uuid":"1102646157","full_name":"CFitzsimons/twitch-chat-running-sentiment","owner":"CFitzsimons","description":"An Apache Storm pipeline to do live sentiment analysis on Twitch streams","archived":false,"fork":false,"pushed_at":"2025-11-27T22:59:58.000Z","size":2972,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-11-30T12:38:55.362Z","etag":null,"topics":["apache-storm","data-science","docker","visualisation"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CFitzsimons.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-11-23T20:36:20.000Z","updated_at":"2025-11-27T23:02:50.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/CFitzsimons/twitch-chat-running-sentiment","commit_stats":null,"previous_names":["cfitzsimons/twitch-chat-running-sentiment"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/CFitzsimons/twitch-chat-running-sentiment","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CFitzsimons%2Ftwitch-chat-running-sentiment","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CFitzsimons%2Ftwitch-chat-running-sentiment/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CFitzsimons%2Ftwitch-chat-running-sentiment/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CFitzsimons%2Ftwitch-chat-running-sentiment/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CFitzsimons","download_url":"https://codeload.github.com/CFitzsimons/twitch-chat-running-sentiment/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CFitzsimons%2Ftwitch-chat-running-sentiment/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32339290,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-26T23:26:28.701Z","status":"online","status_checked_at":"2026-04-27T02:00:06.769Z","response_time":128,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache-storm","data-science","docker","visualisation"],"created_at":"2025-12-27T00:39:27.415Z","updated_at":"2026-04-27T14:03:27.587Z","avatar_url":"https://github.com/CFitzsimons.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Twitch Sentiment Storm\n\nThis project consists of the following:\n\n- A java project that can build a Storm topology\n- A python rest server to handle data analytics\n- A docker-compose to manage running locally\n- A superset instance for visualisations\n\nThere's a full writeup that will be included _after_ the grades have been released to ensure the work is not copied.  It will contain a full explanation of the motivations behind this project.\n\nI've also included an example CSV which shows the kind of data that the pipeline will produce, that is visible here:\n\n- [example_of_processed_data.csv](example_of_processed_data.csv)\n\nThis just contains 7,000~ records gathered during a brief run of the pipeline.\n\n## Architecture\n\n![Architecture Diagram](images/storm-architecture.png)\n\n## How to use it?\n\nRight now you need to perform the following actions:\n\n1. Build the maven project, this produces the Topology jar\n2. Modify the twitch streams you want to connect to in `TwitchMessageSpout` and populate your oauth token\n3. Run `docker-compose up --build -d`.  This should raise the various services required.\n4. Run the `deploy-topology.sh` script after the topology has been built, this will ensure it is added to the deployed Storm cluster\n5. If you are going to use superset, run `superset-startup.sh`.  This will create the right credentials.  You can log in with `admin`/`admin`.\n\n## FAQ\n\n\u003e Q: How can I change the sentiment analysis model being used?\n\u003e \n\u003e A: Look at `app.py`, you can change the model in there.  Provided the interface is the same, you can swap this to any model you wish without having to modify the topology.\n\n\u003e Q: The scripts aren't working\n\u003e \n\u003e A: Ensure they have execute permission.  Try `chmod +x deploy-topology.sh` for example.\n\n\u003e Q: How do I compile the topology?\n\u003e \n\u003e A: The easiest way is to import the project in to Intellij and get Maven to handle it for you.  The `pom.xml` should have all the dependencies setup.\n\n\u003e Q: How do I run it in local mode?\n\u003e \n\u003e A: You need to change the Postgres and Sentiment Bolt URLs to point to localhost (since you'll be running it outside the container).  Then look in the `pom.xml` and remove `\u003cscope\u003eprovided\u003c/scope\u003e` in the `storm` library, since it's not going to be available when running in local mode.  \n\n## What's left to do?\n\n- [ ] Resolve python server bottleneck.  Possibly deploy to k8s.\n- [ ] Resolve DB write bottleneck, possibly replace with Apache Cassandra\n- [ ] Anywhere there's a hardcoded variable (localhost vs. docker network names), replace them with config variables.\n- [ ] Build a better interface for subscribing to streamer channels and deploying more spouts.\n\n## Acknowledgements\n\nThe author acknowledges the use of AI-based coding support tools, specifically ChatGPT, during the implementation of sections of this project, including the Twitch spout and database connectivity.\nAll AI-assisted content was critically reviewed, tested, and incorporated under the author’s responsibility.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcfitzsimons%2Ftwitch-chat-running-sentiment","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcfitzsimons%2Ftwitch-chat-running-sentiment","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcfitzsimons%2Ftwitch-chat-running-sentiment/lists"}