https://github.com/tuancamtbtx/reusable-bigdata-stack-on-k8s

Bigdata stack include spark, airflow run on k8s
https://github.com/tuancamtbtx/reusable-bigdata-stack-on-k8s

airflow bigdata docker k8s spark

Last synced: about 1 month ago
JSON representation

Bigdata stack include spark, airflow run on k8s

• Host: GitHub
• URL: https://github.com/tuancamtbtx/reusable-bigdata-stack-on-k8s
• Owner: tuancamtbtx
• License: mit
• Created: 2023-11-24T08:27:19.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2023-12-22T01:30:08.000Z (about 1 year ago)
• Last Synced: 2024-11-09T02:38:07.059Z (3 months ago)
• Topics: airflow, bigdata, docker, k8s, spark
• Language: Dockerfile
• Homepage:
• Size: 1.87 MB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Kubernetes Deep Dive

![Kubernetes](https://img.shields.io/badge/kubernetes-%23326ce5.svg?style=for-the-badge&logo=kubernetes&logoColor=white)

## Bigdata Stack Build on K8S

![Apache Spark](https://img.shields.io/badge/Apache%20Spark-FDEE21?style=for-the-badge&logo=apachespark&logoColor=white)

![Apache Flink](https://img.shields.io/badge/Apache%20Flink-E6526F?style=for-the-badge&logo=Apache%20Flink&logoColor=white)

![Apache Airflow](https://img.shields.io/badge/Apache%20Airflow-017CEE?style=for-the-badge&logo=Apache%20Airflow&logoColor=white)

![Jupyter Notebook](https://img.shields.io/badge/jupyter-%23FA0F00.svg?style=for-the-badge&logo=jupyter&logoColor=white)

![Nginx](https://img.shields.io/badge/nginx-%23009639.svg?style=for-the-badge&logo=nginx&logoColor=white)

## Table of contents

- [Requirements](#requirements)

- [Usage](#usage)

- [Contributing](#contributing)

- [Contact](#Contact)

- [License](#license)

## Overview k8s



### Docker Publish

1. Jupyterhub

```

docker pull ghcr.io/tuancamtbtx/jupyterhub:main

```

2. Airflow

```

docker pull ghcr.io/tuancamtbtx/airflow:main

```

3. Spark

```

docker pull ghcr.io/tuancamtbtx/spark:main

```

4. Flink

```

docker pull ghcr.io/tuancamtbtx/flink:main

```

5. Superset

```

docker pull ghcr.io/tuancamtbtx/superset:main

```

## Contributing

The project has a separate contribution file. Please adhere to the steps listed in the separate contributions [file](./CONTRIBUTING.md)

## Contact

You can reach me on 



  

  

  



## License

[![Licence](https://img.shields.io/github/license/Ileriayo/markdown-badges?style=for-the-badge)](./LICENSE)

## Reference:

Overview of Kubernetes [alexxubyte](https://www.linkedin.com/in/alexxubyte)