Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/Hesbadami/Footballemrooz
Scrape data on all soccer matches daily, and create a stylized image containing info on today's matches (e.g. kick-off time and broadcasters).
https://github.com/Hesbadami/Footballemrooz
postgresql soccer-matches telegram-bots webscraping
Last synced: 3 months ago
JSON representation
Scrape data on all soccer matches daily, and create a stylized image containing info on today's matches (e.g. kick-off time and broadcasters).
- Host: GitHub
- URL: https://github.com/Hesbadami/Footballemrooz
- Owner: Hesbadami
- License: gpl-3.0
- Created: 2021-03-18T01:43:25.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-01-31T06:58:47.000Z (almost 3 years ago)
- Last Synced: 2024-06-28T14:34:17.100Z (5 months ago)
- Topics: postgresql, soccer-matches, telegram-bots, webscraping
- Language: Python
- Homepage: https://t.me/footballemrooz
- Size: 8.66 MB
- Stars: 4
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# **Footballemrooz**: *Today's Soccer Matches*
A server-side program, which gathers data on all soccer matches daily, and creates a stylized image containing info on today's matches (e.g. kick-off time and broadcasters).
----------
Prerequisites
-------------
- `Python 3.6` or higher
- PostgreSQL: [How to Install PostgreSQL and phpPgAdmin on Ubuntu 20.04](https://www.howtoforge.com/tutorial/ubuntu-postgresql-installation/)
- Install necessary packages using `pipenv install`. Run `pip install pipenv` if you don't have it installed. Full instructions for installing and using pipenv is provided [here](https://realpython.com/pipenv-guide/#pipenv-introduction). Also have a look at [their github](https://github.com/pypa/pipenv) if you are interested.
Gathering matches using the main program (Soccertoday.py)
-------
To activate the project's virtualenv, run `pipenv shell`.
Alternatively, run commands inside the virtualenv with `pipenv run`.
```bash
python Soccertoday.py
```
The result is saved (by default) in `results/.html` (e.g. `2021-03-18.html`). You can specify wether if you also want a `png` image created as an argument, similarly the image is also saved in `results/.png`. The image creation is supported by `Selenium` and Chromium's [ChromeDriver](https://chromedriver.chromium.org). Do not use if you don't or can't have ChromeDriver with Chromium browser (e.g. on windows). (Note that regular Chrome browser does not work! Chromium is essential.)
##### Tips:
- Use `--telegram` argument to also attach a [Telegram Bot](https://core.telegram.org/bots). You need to pass your api token and chat ID into configs.
- If you wish only for html results and don't want `png` image to be created. Use the `--noimage` argument and give another try.
- Use the `--config` argument, to go through configuration wizard again. Alternatively, you can manually edit the `config.json` file.
Preparing the database
----------
Our program uses a PostgreSQL database. See [here](https://www.howtoforge.com/tutorial/ubuntu-postgresql-installation/) for installing PostgreSQL along with phppgadmin administration tool on Ubuntu.
##### Creating database after installation
```bash
sudo -i -u postgres psql
```
```psql
CREATE DATABASE footballemrooz WITH TEMPLATE = template0 ENCODING = 'UTF8' LOCALE = 'en_US.UTF-8';
```
Additional setups like creating tables are done automatically in the program. (Stored in `dbtables.sql`)
##### Database structure
```
PostgreSQL
├── footballemrooz
| ├── Schemas
| │ ├── Public (default)
| │ │ ├── Tables
| │ │ │ ├── links
| │ │ │ ├── teams
| │ │ │ ├── competitions
| │ │ │ ├── posts
| │ │ │ ├── matches
```
Scheduling
----------
To automate a daily scheduled run (at "09:00 AM" for example) use Cron Job. A quick and short guide on setting up Cron Job is provided [here](https://gavinwiener.medium.com/how-to-schedule-a-python-script-cron-job-dea6cbf69f4e).