Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/airscholar/japan-visa-data-engineering
This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark clusters are set up within a Docker container on Azure.
https://github.com/airscholar/japan-visa-data-engineering
azure docker japan master-worker-architecture pyspark python spark-clusters
Last synced: 3 months ago
JSON representation
This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark clusters are set up within a Docker container on Azure.
- Host: GitHub
- URL: https://github.com/airscholar/japan-visa-data-engineering
- Owner: airscholar
- Created: 2023-10-11T08:28:53.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-10-11T08:34:06.000Z (over 1 year ago)
- Last Synced: 2024-04-18T02:57:13.823Z (10 months ago)
- Topics: azure, docker, japan, master-worker-architecture, pyspark, python, spark-clusters
- Language: HTML
- Homepage: https://www.youtube.com/watch?v=f-IcM8mFmDc
- Size: 1.46 MB
- Stars: 6
- Watchers: 2
- Forks: 5
- Open Issues: 0