https://github.com/asmrcodez-yt/data-engineer-pipline-docker-

Pipline have ( Kafka, Postgres, )
https://github.com/asmrcodez-yt/data-engineer-pipline-docker-

Last synced: 4 months ago
JSON representation

Pipline have ( Kafka, Postgres, )

• Host: GitHub
• URL: https://github.com/asmrcodez-yt/data-engineer-pipline-docker-
• Owner: AsmrCodeZ-YT
• License: apache-2.0
• Created: 2024-11-04T15:14:47.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-11-06T02:40:07.000Z (8 months ago)
• Last Synced: 2025-01-29T14:50:27.153Z (6 months ago)
• Language: Python
• Homepage:
• Size: 10.7 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# create network dataline

    docker create network dataline

# run producer

generate data and insert into redis

# Run redis

    docker run -d --rm  --name redis -p 6379:6379 --hostname redis --network dataline redis

# run consumer

feed from redis 

# run postgres

    docker run -d --rm --name postgres --hostname postgres --network dataline -p 54321:5432 -e POSTGRES_PASSWORD=postgres -e POSTGRES_DB=ecommerce_docker postgres -c wal_level=logical