https://github.com/ghxm/mepdb

Create a Dataset of Members of the European Parliament (MEPs)
https://github.com/ghxm/mepdb

Last synced: about 15 hours ago
JSON representation

Create a Dataset of Members of the European Parliament (MEPs)

• Host: GitHub
• URL: https://github.com/ghxm/mepdb
• Owner: ghxm
• Created: 2020-10-20T12:01:29.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2024-08-13T09:40:35.000Z (4 months ago)
• Last Synced: 2024-11-06T02:42:56.695Z (about 2 months ago)
• Language: Python
• Homepage:
• Size: 11.9 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# mepdb

This project aims to build a dataset of Members of the European Parliament (MEPs) (similar to the seemingly https://journals.sagepub.com/doi/10.1177/1465116508099764). It scrapes data from the official European Parliament MEP register and stores it in a SQLite database as well as in csv format (optional) for easy access and analysis.

The dataset is structured as follows:

- `data/mep.db`: SQLite database containing the MEP data (`meps`, `attributes` and `roles` tables)

- `data/attributes.csv` / `attributes` table: Table containing MEP attributes

- `data/roles.csv` / `roles` table: Table containing MEP roles (e.g. committee memberships)

## Usage

Eventually, the dataset will be updated regularly made available for download. For now you can use a legacy verstion stoed in the `data` folder or you can build it yourself.

To build the dataset, run the following command:

1. Install dependencies

```bash

pip install -r requirements.txt

```

2. Configure config.ini

```bash

cp config.ini.example config.ini

```

3. Run the full project (warning this will take a while and make a lot of requests to the European Parliament website)

```bash

python build_mepdb.py

```