https://github.com/grzegorzkossowski/da-sql-py-firstproject
Data Analytics project including Postgres Docker server, Northwind DB, Python and matplotlib library
https://github.com/grzegorzkossowski/da-sql-py-firstproject
analisis data docker matplotlib pandas postgres python3
Last synced: 3 months ago
JSON representation
Data Analytics project including Postgres Docker server, Northwind DB, Python and matplotlib library
- Host: GitHub
- URL: https://github.com/grzegorzkossowski/da-sql-py-firstproject
- Owner: GrzegorzKossowski
- Created: 2024-03-19T14:38:55.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-03-19T18:02:24.000Z (over 1 year ago)
- Last Synced: 2025-02-01T23:29:32.799Z (5 months ago)
- Topics: analisis, data, docker, matplotlib, pandas, postgres, python3
- Language: Python
- Homepage:
- Size: 126 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# da-sql-py-firstProject
Test project including.
- launching a docker container containing a postgres database
- population of the database with well-known data from the northwind DB
- running the container on port localhost:5432
- code for retrieving data from the DB based on a simple sql query
- table analysis using the pandas library
- creation of a graph using the matplotlib library
- image export to jpg
## How to?
- install docker
- install python v3.6+
- create docker image with postgres database (you may need sudo privileges). You do in once.
```bash
# get (pull) postgres image
docker pull postgres
cd docker_files
```
### Docker file
```dockerfile
FROM postgres
ENV POSTGRES_DB=northwind
ENV POSTGRES_USER=northwind
ENV POSTGRES_PASSWORD=northwind
COPY ./northwind.sql /docker-entrypoint-initdb.d/
EXPOSE 5432
```
### build image
```bash
# Build new image with db
# -t - container tag, name
# . (dot) - don't forget the dot at the end!
docker buildx build -t nwdb .
```
### Run container
From now on, you can run the container from the built image, which includes the Northwind database
```bash
# run container
# -d - detached (run in background)
# -rm - remove container after quit
# -p - expose port
# -e - setting password for db
docker run -d --rm -p 5432:5432 --name nwdbc -e POSTGRES_PASSWORD=northwind -d nwdb
```
### Run python script
```bash
cd ~/{project_directory}
python3 main.py
# run script with csv export
python3 main.py -csv
```
- check the generated graphs in the plots catalogue (jpg)
```bash
# stop container
docker stop nwdbc
```