{"id":25765754,"url":"https://github.com/iamsad5566/py_scraping","last_synced_at":"2026-05-15T02:52:31.481Z","repository":{"id":60126286,"uuid":"540707343","full_name":"iamsad5566/Py_scraping","owner":"iamsad5566","description":"Twitter scraping by Python with Selenium, GUI manipulating built by Go Fyne.io","archived":false,"fork":false,"pushed_at":"2022-10-13T00:23:52.000Z","size":57546,"stargazers_count":2,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-26T22:32:28.802Z","etag":null,"topics":["fyne","golang","python","scraper","scraping-python","selenium-python","twitter","twitter-bot"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/iamsad5566.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-09-24T04:34:44.000Z","updated_at":"2023-12-06T03:24:23.000Z","dependencies_parsed_at":"2023-01-19T23:17:35.618Z","dependency_job_id":null,"html_url":"https://github.com/iamsad5566/Py_scraping","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/iamsad5566/Py_scraping","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iamsad5566%2FPy_scraping","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iamsad5566%2FPy_scraping/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iamsad5566%2FPy_scraping/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iamsad5566%2FPy_scraping/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/iamsad5566","download_url":"https://codeload.github.com/iamsad5566/Py_scraping/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iamsad5566%2FPy_scraping/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33051874,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-13T13:14:54.681Z","status":"online","status_checked_at":"2026-05-15T02:00:06.351Z","response_time":103,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["fyne","golang","python","scraper","scraping-python","selenium-python","twitter","twitter-bot"],"created_at":"2025-02-26T22:27:32.029Z","updated_at":"2026-05-15T02:52:31.463Z","avatar_url":"https://github.com/iamsad5566.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Py_scraping projects\u0026nbsp;\u0026nbsp;\u0026nbsp;\u0026nbsp; Version:2.0.0 (Developing...)\n- v1.0.0: pure python scraping\n- v2.0.0: driven by golang(fyne)\n---\n## Twitter-scraping \n\u003e scraping information from Twitter by using selenium  \n\nVirtual environment: **Python 3.10.1** ( must be Python 3.10 up version because of the syntax issue )\nTo use the library, you will need a `.env` file under the `twitter-scraping` folder, elements within this file are as follows:\n```\noperateSystem=mac_ARM\n#windows, mac_x86, mac_ARM\n\nmail=your Twitter registered email\nname=your Twitter account name\npassword=your Twitter password\noutput=output/\n```\n\nonce you execute the main.go file, you should see a GUI interface as follows:\n![](doc/empty.png)\n\nSelect which mode to execute by your needing:\n![](doc/withIDs.png)\n\nScraping would be started after pressing \"Go!\" button.\n  \n---\n## Facebook-scraping\ndeveloping...\n\n---\n## News-scraping\ndeveloping...\n   \n# To-do list\ntwigui\n - ~~Build an interface for twitterGUI so that the code could be easier maintained.~~\n - ~~Python scraping for Twitter adding a new function to scrape the tweets by ID.~~\n - Keep developing twirobot package and integrating it with the current project.\n\n fbgui\n - Brainstorming\n\n newsgui\n - Brainstorming\n\n ### Note\n - Login information has been encrypted by Facebook and Twitter. Though the API could be found, it is hard to send a set of the right parameters toward it.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiamsad5566%2Fpy_scraping","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fiamsad5566%2Fpy_scraping","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiamsad5566%2Fpy_scraping/lists"}