https://github.com/tonykipkemboi/scrapetwitter
https://github.com/tonykipkemboi/scrapetwitter
scraping snscrape twitter
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/tonykipkemboi/scrapetwitter
- Owner: tonykipkemboi
- License: other
- Created: 2022-08-16T21:48:29.000Z (about 3 years ago)
- Default Branch: master
- Last Pushed: 2023-01-25T00:20:32.000Z (over 2 years ago)
- Last Synced: 2025-06-20T05:45:06.304Z (4 months ago)
- Topics: scraping, snscrape, twitter
- Language: Python
- Homepage: https://tonykipkemboi-scrapetwitter-appdriver-qevmgf.streamlitapp.com/
- Size: 120 MB
- Stars: 2
- Watchers: 2
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.txt
Awesome Lists containing this project
README
# Scrape Tweets by Searching Keywords using Snspcrape
This is a simple Tweet Search App built with `python` + `snscrape module` + `Streamlit`.
[](https://tonykipkemboi-scrapetwitter-appdriver-qevmgf.streamlitapp.com)
I got tired of searching tweets using `Twitter` search and decided to build out a standalone app that I can query for `keywords/phrases/hashtags/usernames...e.t.c.` and subsequently download the data into a `csv` file for further custom analysis
`FYI: This is roughly put together but does the job for what I needed.`
The DataFrame UI community package by [aggrid](https://github.com/PablocFonseca/streamlit-aggrid)
### Usage
- The app is deployed on Streamlit [here](https://tonykipkemboi-scrapetwitter-appdriver-qevmgf.streamlitapp.com/).
###### If you would like to customize it for your development purposes follow these steps(these are windows commands):
- Clone this repo to your folder of choice:
```
git clone https://github.com/tonykipkemboi/scrapeTwitter.git
```
- Change directory into the folder:
```
cd scrapeTwitter
```
- Create a python virtual environment:
```
python -m venv env
```
- Activate virtual environment:
```
.\env\Script\activate
```
- Install dependecies which are in the `requirements.txt` file:
```
python -m pip install -r requirements.txt
```
- Now you are ready top run the program in your localhost:
```
cd app
```
```
streamlit run driver.py
```
- The app will open in your browser. Feel free to play with the code and as you save changes, the app will update in real-time.
### What Next?
- Maybe make it a bit robust by adding unit tests and refactoring some of the code.
- Add a page for querying tweets by user.
- Create a dashboard after doing some analysis on mined tweets.
You can dm me on [Twitter](https://twitter.com/ynot_kip) for collaboration or just holla!