https://github.com/pourya90091/twitter-scraper

Fetch (scrape) news from Twitter accounts you have selected. Currently, this repo supports "web app" and "telegram bot" version of this application.
https://github.com/pourya90091/twitter-scraper

django python scraper selenium telegram-bot twitter

Last synced: 21 days ago
JSON representation

Fetch (scrape) news from Twitter accounts you have selected. Currently, this repo supports "web app" and "telegram bot" version of this application.

• Host: GitHub
• URL: https://github.com/pourya90091/twitter-scraper
• Owner: pourya90091
• License: mit
• Created: 2022-12-14T08:24:57.000Z (about 2 years ago)
• Default Branch: master
• Last Pushed: 2023-07-25T13:31:33.000Z (over 1 year ago)
• Last Synced: 2023-07-25T14:53:55.232Z (over 1 year ago)
• Topics: django, python, scraper, selenium, telegram-bot, twitter
• Language: Python
• Homepage:
• Size: 137 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Twitter Scraper

**The Twitter Scraper project has minimal development and is very simple. It's light (to use resource).**

**You can use the Core of this project in your projects as a tool for scraping.**

## Setup and Run

### Clone

```bash

git clone --branch master https://github.com/pourya90091/Twitter-Scraper.git

```

### Install Requirements

```bash

pip install -r requirements.txt

```

### Config

- Set web app settings at `scraper/settings.py`.

- Select accounts to scraping at `core/variables.py`.

### Run

- Scraper (selenium bot) must be run manually and as another process.

```bash

python main.py

```

## Tips

>**Tip** : On some hosts that give limited permission, you need to install `chromedriver` manually and place it at `core/` and change `executable_path` to "chromedriver" (it means don't use relative or absolute path).

>**Tip** : On some hosts you don't need to set `executable_path` (remove `service`).

>**Tip** : You can find `executable_path` at `core/initialize.py`.

---