https://github.com/onome-joseph/twitter-profile-scrapper
Python-based web scraper that extracts Twitter profile details using Selenium.
https://github.com/onome-joseph/twitter-profile-scrapper
python-scraping selenium-webdriver twitter
Last synced: 3 months ago
JSON representation
Python-based web scraper that extracts Twitter profile details using Selenium.
- Host: GitHub
- URL: https://github.com/onome-joseph/twitter-profile-scrapper
- Owner: Onome-Joseph
- License: mit
- Created: 2025-02-03T01:01:15.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2025-02-03T01:17:59.000Z (4 months ago)
- Last Synced: 2025-02-03T02:21:04.367Z (4 months ago)
- Topics: python-scraping, selenium-webdriver, twitter
- Language: Python
- Homepage:
- Size: 10.7 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# **Twitter Profile Scraper using Selenium**
This project is a **Python-based web scraper** that extracts Twitter profile details using **Selenium**. The script automates **Twitter login**, navigates to user profiles, and retrieves:
- **Bio**
- **Following Count**
- **Followers Count**
- **Location**
- **Website (if available)**
## **The extracted data is stored in a **CSV file** for further analysis.**
---
- **Automated Login:** Logs into Twitter using provided credentials.
- **Scrapes Multiple Profiles:** Reads links from a CSV file and extracts profile details.
- **Handles Restricted Profiles:** Ensures authentication before scraping.
- **Error Handling:** Skips missing elements to avoid script failure.
---
## **Installation & Setup**
### **1 Clone the Repository**
```bash
git clone https://github.com/Onome-Joseph/Twitter-Profile-Scraper.git
```
### **2 Install Dependencies**
```bash
pip install -r requirements.txt
```
### **3 Configure Login Credentials**
Open `twitter_scraper.py` and **replace** the placeholders with your **Twitter username and password**:
```python
TWITTER_USERNAME = "your_username"
TWITTER_PASSWORD = "your_password"
```