{"id":21141556,"url":"https://github.com/jgolafshan/wallstreetsocial","last_synced_at":"2025-07-22T19:04:35.652Z","repository":{"id":45460328,"uuid":"392168170","full_name":"JGolafshan/WallStreetSocial","owner":"JGolafshan","description":"Analyze Reddit posts/comments, uses an NLP model to recognize stock symbols and options positions","archived":false,"fork":false,"pushed_at":"2024-09-16T00:35:56.000Z","size":201919,"stargazers_count":7,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-06-28T08:56:03.551Z","etag":null,"topics":["data-analysis","flexible","machine-learning","mentioned-stocks","named-entity-recognition","natural-language-processing","nlp","reddit","social-media-analysis","sql","wallstreetbets"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"unlicense","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/JGolafshan.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-08-03T02:58:29.000Z","updated_at":"2024-09-16T00:35:59.000Z","dependencies_parsed_at":"2024-09-16T01:59:05.046Z","dependency_job_id":"58a998ff-7d3e-45d2-821b-6bc9c4152b22","html_url":"https://github.com/JGolafshan/WallStreetSocial","commit_stats":{"total_commits":211,"total_committers":2,"mean_commits":105.5,"dds":"0.22274881516587675","last_synced_commit":"201bcf87e3d1901aa332016275b7384655402d1a"},"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/JGolafshan/WallStreetSocial","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JGolafshan%2FWallStreetSocial","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JGolafshan%2FWallStreetSocial/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JGolafshan%2FWallStreetSocial/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JGolafshan%2FWallStreetSocial/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/JGolafshan","download_url":"https://codeload.github.com/JGolafshan/WallStreetSocial/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JGolafshan%2FWallStreetSocial/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266554193,"owners_count":23947287,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-22T02:00:09.085Z","response_time":66,"last_error":null,"robots_txt_status":null,"robots_txt_updated_at":null,"robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-analysis","flexible","machine-learning","mentioned-stocks","named-entity-recognition","natural-language-processing","nlp","reddit","social-media-analysis","sql","wallstreetbets"],"created_at":"2024-11-20T07:31:28.471Z","updated_at":"2025-07-22T19:04:35.623Z","avatar_url":"https://github.com/JGolafshan.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Wall Street Social\nIs an open source piece of software that is \ndesigned to allow anyone to quickly get familiar with the basics of textual analysis. It features a preconfigured database schema, preconfigured pipelines to fill the database with reddit comments, and a pretrained named entity recognition model that is used to pull out what stocks are being mentioned in a post.\n\n## Getting Starting\nThis project model doesn't fit the pypi size specifications, to get this project working you will need the these steps.\n\n```\npypi WallStreetBets\n```\n\nDownload Model [here](https://github.com/JGolafshan/WallStreetSocial/blob/master/wsb_ner.zip)\n\nunzip anywhere\n\n```\nfrom WallStreetSocial import helpers\n\n# Uses model to find ticks in the data comment table\nhelpers.validate_model('C:Projects\\\\WallStreetSocial\\\\wsb_ner')\n\n# Fetches Comments and Posts from a subreddit between two dates\nhelpers.run(\"WallStreetBets\", start=\"2019-01-03\", end=\"2019-02-04\")\n\n\nsymbol = helpers.SummariseBase(symbol=\"AAPL\")\nsymbol.display_stats()\n\n```\n\n## About the ML Model\nThe named entity recognition model in use is a compact spaCy model which has been trained on wallstreetbets specific data. The model has been trained in two parts: first, Gensim was used to create the word vectors. Word vectors are basically multidimensional representations of words in algebraic space that help the model determine things like word similarity. It helps give the model some form of contextual awareness of the words it is encountering. The model is then trained specifically on data from reddit. The data consists of thousands of comments that have labeled stocks and their respective positions in the text. For a visual representation of the word vectors, please see https://www.kaggle.com/johnhutton/visualization-of-wallstreetbets-word-vectors\n\n\n## TODO\ncreate a simple html interface for a symbol\nspeed up ticker generation\nfix path locations\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjgolafshan%2Fwallstreetsocial","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjgolafshan%2Fwallstreetsocial","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjgolafshan%2Fwallstreetsocial/lists"}