https://github.com/mhmdrazn/tweets-scraper
This repository contains a script to scrape tweets from Twitter search results based on keywords, date range, and geolocation using Playwright.
https://github.com/mhmdrazn/tweets-scraper
Last synced: 2 months ago
JSON representation
This repository contains a script to scrape tweets from Twitter search results based on keywords, date range, and geolocation using Playwright.
- Host: GitHub
- URL: https://github.com/mhmdrazn/tweets-scraper
- Owner: mhmdrazn
- License: mit
- Created: 2024-06-30T17:49:32.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2025-02-01T00:05:12.000Z (4 months ago)
- Last Synced: 2025-03-30T21:41:43.031Z (2 months ago)
- Language: Jupyter Notebook
- Size: 17.6 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Twitter Scraper using Playwright
This repository contains a script to scrape tweets from Twitter search results based on keywords, date range, and geolocation using Playwright.
## Features
- Scrape tweets based on specific keywords.
- Filter tweets by date range.
- Specify geolocation for more targeted results.
## Prerequisites
Before you begin, ensure you have met the following requirements:
- Node.js installed on your machine.
- Playwright installed. You can install it using the following command:
`npm install playwright`
## Usage
To run the scraper, use the following command:
`!npx -y [email protected] -o "{filename}" -s "{search_keyword}" --tab "LATEST" -l {limit} --token {twitter_auth_token}`
## Arguments
- `filename` - The filename of csv typefile to store the output.
- `search_keywords` - A comma-separated list of keywords to search for.
- `LATEST` - the time filtering to find the latest tweets.
- `limit` - The limit of the tweets will be crawled.
- `twitter_auth_token` - Your personal Twitter auth token.
## Credits
This project was inspired by and based on the work of [Helmi Satria](https://github.com/helmisatria).