Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/Irio/national-congress-data

Datasets of congresspeople attendance, votes and propositions since past century
https://github.com/Irio/national-congress-data

Last synced: 1 day ago
JSON representation

Datasets of congresspeople attendance, votes and propositions since past century

Awesome Lists containing this project

README

        

# National Congress of Brazil

## Setup

```console
$ pip3 install -r requirements.txt
```

## Data collection

To download the sources from Chamber of Deputies website, use `src/fetch_*.py` scripts and Scrapy's `crawl` commands:

```console
$ python3 src/fetch_propositions.py
$ cd data_collection
$ scrapy crawl chamber_of_deputies_sessions \
--output ../data/sources/sessions.csv
$ cd ..
```

The files will be downloaded to `data/sources`. To extract them to `data/sessions`:

```console
$ python3 src/extract_content_files.py
```