https://github.com/wazzabeee/scraping_tool

A python application providing a GUI to scrape tweets from Twitter using Tweepy library and scripts allowing cron jobs.
https://github.com/wazzabeee/scraping_tool

api cron gui python scraping-python tkinter tweepy tweets twitter

Last synced: 7 months ago
JSON representation

A python application providing a GUI to scrape tweets from Twitter using Tweepy library and scripts allowing cron jobs.

• Host: GitHub
• URL: https://github.com/wazzabeee/scraping_tool
• Owner: Wazzabeee
• License: mit
• Created: 2021-09-21T13:05:14.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2022-11-08T01:32:39.000Z (almost 3 years ago)
• Last Synced: 2025-01-13T05:29:16.724Z (9 months ago)
• Topics: api, cron, gui, python, scraping-python, tkinter, tweepy, tweets, twitter
• Language: Python
• Homepage:
• Size: 737 KB
• Stars: 3
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          


  

   



# Twitter Scraping Tool

 

![Python version](https://img.shields.io/badge/Python-3.8-blue)

## About

This program allow the user to retrieve tweets from Twitter's API using the library Tweepy via a GUI or a CRON automatization.

This project was made part of my internship at the "Human Computer Humans Interacting with Computers at University of Primorska" lab (HICUP Lab).

## Setup

To use this program, you will need your API keys retrieved after [creating a developer account at Twitter](https://developer.twitter.com/en/apply-for-access).

Once retrieved the keys must be filled as follows.



**How to use**

---

```bash

# Clone this repository

$ git clone https://github.com/scraping_tool

# Go into the repository

$ cd scraping_tool

# Install requirements

$ pip3 install -r requirements.txt

# Fill credentials in constants.py

# See "Setup"

# Run the app

$ python main.py

```

## Parameter details

More details on the parameters available can be seen on [Twitter's offical page](https://developer.twitter.com/en/docs/twitter-api/v1/tweets/search/api-reference/get-search-tweets).

## CRON automatization

After trying out queries and requests with the GUI, you can setup automatizations.

You can define the parameters of the search via the `cron_search.json` file (or `cron_user.json`). All parameters are the same from the GUI’s tab.

When you’re ready you just have to setup the execution of the `cron_search.py` (or `cron_user.py`) script at the desired times and days.