https://github.com/iamsad5566/py_scraping
Twitter scraping by Python with Selenium, GUI manipulating built by Go Fyne.io
https://github.com/iamsad5566/py_scraping
fyne golang python scraper scraping-python selenium-python twitter twitter-bot
Last synced: 8 months ago
JSON representation
Twitter scraping by Python with Selenium, GUI manipulating built by Go Fyne.io
- Host: GitHub
- URL: https://github.com/iamsad5566/py_scraping
- Owner: iamsad5566
- Created: 2022-09-24T04:34:44.000Z (about 3 years ago)
- Default Branch: master
- Last Pushed: 2022-10-13T00:23:52.000Z (almost 3 years ago)
- Last Synced: 2025-01-08T10:19:25.745Z (9 months ago)
- Topics: fyne, golang, python, scraper, scraping-python, selenium-python, twitter, twitter-bot
- Language: Python
- Homepage:
- Size: 54.9 MB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Py_scraping projects Version:2.0.0 (Developing...)
- v1.0.0: pure python scraping
- v2.0.0: driven by golang(fyne)
---
## Twitter-scraping
> scraping information from Twitter by using selenium
Virtual environment: **Python 3.10.1** ( must be Python 3.10 up version because of the syntax issue )
To use the library, you will need a `.env` file under the `twitter-scraping` folder, elements within this file are as follows:
```
operateSystem=mac_ARM
#windows, mac_x86, mac_ARM
mail=your Twitter registered email
name=your Twitter account name
password=your Twitter password
output=output/
```
once you execute the main.go file, you should see a GUI interface as follows:
Select which mode to execute by your needing:
Scraping would be started after pressing "Go!" button.
---
## Facebook-scraping
developing...
---
## News-scraping
developing...
# To-do list
twigui
- ~~Build an interface for twitterGUI so that the code could be easier maintained.~~
- ~~Python scraping for Twitter adding a new function to scrape the tweets by ID.~~
- Keep developing twirobot package and integrating it with the current project.
fbgui
- Brainstorming
newsgui
- Brainstorming
### Note
- Login information has been encrypted by Facebook and Twitter. Though the API could be found, it is hard to send a set of the right parameters toward it.