{"id":16516953,"url":"https://github.com/wazzabeee/scraping_tool","last_synced_at":"2025-03-02T18:19:44.562Z","repository":{"id":68312674,"uuid":"408823185","full_name":"Wazzabeee/scraping_tool","owner":"Wazzabeee","description":"A python application providing a GUI to scrape tweets from Twitter using Tweepy library and scripts allowing cron jobs. ","archived":false,"fork":false,"pushed_at":"2022-11-08T01:32:39.000Z","size":755,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-01-13T05:29:16.724Z","etag":null,"topics":["api","cron","gui","python","scraping-python","tkinter","tweepy","tweets","twitter"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Wazzabeee.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-09-21T13:05:14.000Z","updated_at":"2023-11-10T15:22:56.000Z","dependencies_parsed_at":"2023-05-17T20:15:21.300Z","dependency_job_id":null,"html_url":"https://github.com/Wazzabeee/scraping_tool","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Wazzabeee%2Fscraping_tool","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Wazzabeee%2Fscraping_tool/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Wazzabeee%2Fscraping_tool/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Wazzabeee%2Fscraping_tool/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Wazzabeee","download_url":"https://codeload.github.com/Wazzabeee/scraping_tool/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241549141,"owners_count":19980481,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","cron","gui","python","scraping-python","tkinter","tweepy","tweets","twitter"],"created_at":"2024-10-11T16:27:49.052Z","updated_at":"2025-03-02T18:19:44.552Z","avatar_url":"https://github.com/Wazzabeee.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp float=\"left\"\u003e\n  \u003cimg src=\"https://github.com/Wazzabeee/scraping_tool/blob/main/src/images/screenshots/search_tab.PNG\" width=\"415\" /\u003e\n  \u003cimg src=\"https://github.com/Wazzabeee/scraping_tool/blob/main/src/images/screenshots/user_tab.PNG\" width=\"415\" /\u003e \n\u003c/p\u003e\n\n# Twitter Scraping Tool\n \n![Python version](https://img.shields.io/badge/Python-3.8-blue)\n\n## About\nThis program allow the user to retrieve tweets from Twitter's API using the library Tweepy via a GUI or a CRON automatization.\n\nThis project was made part of my internship at the \"Human Computer Humans Interacting with Computers at University of Primorska\" lab (HICUP Lab).\n\n## Setup\nTo use this program, you will need your API keys retrieved after [creating a developer account at Twitter](https://developer.twitter.com/en/apply-for-access).\n\nOnce retrieved the keys must be filled as follows.\n\n\u003cimg\n     src=\"https://github.com/Wazzabeee/scraping_tool/blob/main/src/images/credentials.png\"\n     /\u003e\n\n**How to use**\n---\n```bash\n# Clone this repository\n$ git clone https://github.com/scraping_tool\n\n# Go into the repository\n$ cd scraping_tool\n\n# Install requirements\n$ pip3 install -r requirements.txt\n\n# Fill credentials in constants.py\n# See \"Setup\"\n\n# Run the app\n$ python main.py\n```\n\n## Parameter details\nMore details on the parameters available can be seen on [Twitter's offical page](https://developer.twitter.com/en/docs/twitter-api/v1/tweets/search/api-reference/get-search-tweets).\n\n## CRON automatization\nAfter trying out queries and requests with the GUI, you can setup automatizations.\n\nYou can define the parameters of the search via the `cron_search.json` file (or `cron_user.json`). All parameters are the same from the GUI’s tab.\n\nWhen you’re ready you just have to setup the execution of the `cron_search.py` (or `cron_user.py`) script at the desired times and days.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwazzabeee%2Fscraping_tool","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwazzabeee%2Fscraping_tool","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwazzabeee%2Fscraping_tool/lists"}