An open API service indexing awesome lists of open source software.

https://github.com/fgiorgia/data-cleaning-for-housing-data

Cleaning the Nashville Housing Data dataset.
https://github.com/fgiorgia/data-cleaning-for-housing-data

cleaning-dataset cleaning-script data-cleaning plpgsql postgres postgresql

Last synced: 5 months ago
JSON representation

Cleaning the Nashville Housing Data dataset.

Awesome Lists containing this project

README

          

# Data cleaning for housing data

Cleaning the *Nashville Housing Data* dataset.

## Initial setup

### Postgres

A postgres instance is expected to be available on your machine. You can download it here: .
You also need to install the Levenshtein Postgres extension.

### Python

You need Poetry to setup this project. You can install it here: .

Then run the following to install the Poe plugin as well as the project dependencies.

```sh
poetry self add 'poethepoet[poetry_plugin]'
poetry install
```

### Environment variables

Create a `.env` in the root of your project and set your Postgres
password as the `DB_PASSWORD`. Alternatively, set it directly as an env variable.

## Running the pipeline

Run the cleaning pipeline

```sh
poetry poe data-cleaning-pipeline
```