Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

https://github.com/huseyindeniz/gitops-lab

GitOps Playground (K8S, Terraform, Argo CD, Helm, Github Workflows etc.)
https://github.com/huseyindeniz/gitops-lab

arc-runners-demo argo-rollouts-demo argo-workflows-demo argocd-demo flux-demo gitops gitops-demo harbor-registry-demo helm-demo istio-demo kubernetes-demo minikube-demo terraform-demo triton-inference-server-demo

Last synced: 12 months ago
JSON representation

GitOps Playground (K8S, Terraform, Argo CD, Helm, Github Workflows etc.)

Awesome Lists containing this project

README 

          
# gitops-lab



GitOps Playground (K8S, Terraform, Argo CD, Helm, Github Workflows etc.)



- [![MySampleApp1 - UnitTests](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-UnitTests.yml/badge.svg)](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-UnitTests.yml)

- [![MySampleApp1 - IntegrationTests](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-IntegrationTests.yml/badge.svg)](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-IntegrationTests.yml)

- [![MySampleApp1 - FitnessTests](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-FitnessTests.yml/badge.svg)](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-FitnessTests.yml)

- [![MySampleApp1 - BA Tests](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-BATests.yml/badge.svg)](https://github.com/huseyindeniz/gitops-lab/actions/workflows/mySampleApp1-BATests.yml)



## Repository Structure



| **dir name**  |                                           |

| ------------- | ----------------------------------------- |

| apps          | Holds sample applications code            |

| flux          | holds argocd application manifests        |

| helm-charts   | holds various helm charts                 |

| host          | holds applications run on my host machine |

| raw-manifests | holds various k8s resources               |

| scripts       | holds various scripts                     |

| terraform     | holds terraform files                     |



TODO: add more explanation here.



## Local Clusters



| **TODO**          | local-management | local-staging  | local-production            | host           |

| ----------------- | ---------------- | -------------- | --------------------------- | -------------- |

| runs on           | wsl 2 ubuntu     | wsl 2 ubuntu   | wsl 2 ubuntu                | windows docker |

| Minikube          | ✅               | ✅             | ✅                          | -              |

| Terraform         | ✅               | ✅             | ✅                          | -              |

| Helm              | ✅               | ✅             | ✅                          | -              |

| reverse-proxy     | -                | -              | -                           | ✅             |

| grafana           | -                | -              | -                           | ✅             |

| environments      | -                | stag-1, stag-2 | prod-bluegreen, prod-canary | -              |

| Cert Manager      | ✅               | ✅             | ✅                          | -              |

| Istio             | ✅               | ✅             | ✅                          | -              |

| MetalLB           | ✅               | ✅             | ✅                          | -              |

| K8SDashboard      | ✅               | ✅             | ✅                          | -              |

| ArgoCD            | ✅               | -              | -                           | -              |

| Argo Rollouts     | -                | -              | ✅                          | -              |

| Argo Workflows    | -                | 🔲             | 🔲                          | -              |

| Flux              | ✅               | -              | -                           | -              |

| ARC Runners       | -                | ✅             | ✅                          | -              |

| Harbor            | -                | ✅             | 🔲                          | -              |

| minIO             | -                | 🔲             | 🔲                          | -              |

| Prometheus        | 🔲               | 🔲             | 🔲                          | -              |

| Loki              | 🔲               | 🔲             | 🔲                          | -              |

| Open Telemetry    | 🔲               | 🔲             | 🔲                          | -              |

| Tempo/Zipkin      | 🔲               | 🔲             | 🔲                          | -              |

| Vault(hashicorp)  | 🔲               | 🔲             | 🔲                          | -              |

| Velero            | 🔲               | 🔲             | 🔲                          | -              |

| NVidia Triton     | -                | 🔲             | 🔲                          | -              |

| Sample Dotnet App | -                | ✅             | ✅                          | -              |

| Sample Game App   | -                | ✅             | -                           | -              |

| Sample AI App     | -                | ✅             | -                           | -              |



## Cloud Clusters



| **TODO**             | EKS      | AKS     | GKE         | DOKS     |

| -------------------- | -------- | ------- | ----------- | -------- |

| CLI                  | ✅ (aws) | ✅ (az) | ✅ (gcloud) | 🔲 doctl |

| VPC                  | ✅       | ✅      | ✅          | 🔲       |

| Cluster              | ✅       | ✅      | ✅          | 🔲       |

| Istio                | 🔲       | 🔲      | 🔲          | 🔲       |

| K8SDashboard         | 🔲       | 🔲      | 🔲          | 🔲       |

| ArgoCD               | -        | -       | -           | 🔲       |

| Multiplayer Game App | -        | -       | -           | 🔲       |

| AI App               | -        | -       | -           | 🔲       |



## Helm Charts



| **TODO**                       |     |

| ------------------------------ | --- |

| Generic dotnet core webapi app | ✅  |

| Generic static website (nginx) | ✅  |

| Generic nodejs app             | ✅  |

| Generic python/flask app       | ✅  |

| GPU test app                   | ✅  |

| sample-game                    | ✅  |

| sample-ai                      | ✅  |



## Terraform Modules



| **TODO**       |     |

| -------------- | --- |

| arc-runners    | ✅  |

| argocd         | ✅  |

| argo-rollouts  | ✅  |

| argo-workflows | ✅  |

| cert-manager   | ✅  |

| flux           | ✅  |

| istio          | ✅  |

| k8s-dashboard  | ✅  |

| metalLB        | ✅  |

| monitoring     | ✅  |

| postgresql     | ✅  |

| redis          | ✅  |



## Goals



### Automate and Manage Infrastructure



- ✅ Install Argo CD (on local-cluster)

- ❌ Argo CD Image Updater ([awaiting namespace support](https://github.com/argoproj-labs/argocd-image-updater/issues/601))

  - ✅ Install Flux for automated image updates (on local-cluster)

- ✅ Install Argo Rollouts (on local-cluster)

- ✅ Install Argo Workflows (on local-cluster)

- ✅ Create/Configure **app of apps/root app** for applications in Argo CD

- ✅ Create/Configure **app of apps/root app** for workflow templates in Argo CD

- ✅ Create/Configure **app of apps/root app** for wsl applications in Argo CD

- ✅ Create/Configure application set manifest for a sample app

- ✅ Create/Configure a generic .NET app Helm chart and use it for a service in the sample app

- ✅ Configure multi-staging environments usable by all apps

- ✅ Create/Configure Github Arc Runners



### Build a Comprehensive CI/CD Pipeline



- ✅ Manage application deployments via Argo CD and Helm

- ✅ Automate database migrations with Argo hooks

- 🔲 Define and implement rollback mechanisms

- 🔲 Address and test conflicting database migration scenarios

- ❌ Configure Argo Workflows for orchestrating CI/CD pipeline (it seems arc runners will be enough)

- **Use GitHub Workflows for CI tasks**



  - ✅ Unit Tests (on github runners)

  - ✅ Integration Tests (on github runners)

  - ✅ Fitness Tests (on github runners)

  - ✅ BA Tests (on arc runners)



- ✅ Create a Staging CI/CD Pipeline

- 🔲 Create a Production CI/CD Pipeline



### Enhanced Observability



- ✅ Monitoring with Prometheus and Grafana



### Advanced Deployment Strategies



- ✅ Canary production deployment setup

- ✅ Blue/Green production deployment setup



### Load Testing



- ✅ Perform load testing for performance validation



### Gaming



- ✅ Install Colyseus Server on the Kubernetes cluster to manage and deploy multiplayer game servers.

- ✅ Deploy a Phaser 3 game that uses the Colyseus client to interact with the Colyseus server for proper testing and demonstration of multiplayer functionality.



### AI/ML Support



- ✅ GPU support for AI/ML training and inference pipelines

- 🔲 Create a sample AI/ML application that demonstrates both training and inference pipelines using GPU support. (use/integrate https://github.com/xuebinqin/DIS )

  - ✅ inference

  - 🔲 Install and configure a local Docker image registry (Harbor) to manage and store large Docker images efficiently.

  - 🔲 training



### Blockchain



- 🔲 Deploy a stateful Avalanche Node on the cloud using Kubernetes StatefulSets.

- 🔲 Deploy a stable Avalanche CLI environment on the cloud, accessible via SSH for managing Avalanche Subnets and network operations.



## Demonstrations and Scenarios



### ArgoCD Overview



![ArgoCD Overview](./docs/images/screenshots/argo-001.png)



### ArgoCD App View



![ArgoCD App View](./docs/images/screenshots/argo-002.png)



### Database Migration Demo



![Migration Demo](./docs/images/screenshots/migration-example.gif)



### Long Running DB Migration Job



![Long Running DB Migration Job 1](./docs/images/screenshots/long-mig-001.png)



![Long Running DB Migration Job 2](./docs/images/screenshots/long-mig-002.png)



### Blue-Green Deployment



![Blue-Green Deployment 1](./docs/images/screenshots/blue-green-001.png)



![Blue-Green Deployment 2](./docs/images/screenshots/blue-green-002.png)



### Canary Deployment



![Canary Deployment 1](./docs/images/screenshots/canary-001.png)



![Canary Deployment 2](./docs/images/screenshots/canary-002.png)



![Canary Deployment 3](./docs/images/screenshots/canary-003.png)



### Arc Runners



![arc runners](./docs/images/screenshots/arc-runners.png)



### Hello Argo Workflows



![Hello Argo Workflows](./docs/images/screenshots/hello-workflows.gif)



### GPU Support



![GPU Support](./docs/images/screenshots/gpu-001.png)



### Monitoring with Prometheus and Grafana



![Sample Prometheus+Grafana Dashboard](./docs/images/screenshots/grafana-dashboard-001.png)



### Multiplayer (pVp) Game (Colysues + Phaser)



![pVp Game](./docs/images/screenshots/pvp-game.png)



### Sample AI/ML App (pytorch - on GPU)



![sample ai/ml app](./docs/images/screenshots/ai-ml-demo.gif)



## Developer Workflow



Follow these steps to update your application and database with minimal effort.



### Adding new migration



```bash

dotnet ef migrations add  --project ./mySampleApp1.weatherForecast.Infra --startup-project ./mySampleApp1.weatherForecast.API

```



### Automated DB Migration Pipeline Flow



![Automated DB Migration Pipeline](./docs/diagrams/docs/db-migration-flow.svg)



### Note on Database Migrations in Kubernetes



Handling database migrations in Kubernetes was initially challenging due to the lack of built-in mechanisms to enforce dependency order between deployments. To address this, I now use **Argo CD hooks** to run migrations before application pods are updated, ensuring the database schema is always in sync with the application.



While the solution works effectively, some limitations remain. For example, migrations are triggered with every resource update in the application, which can be time-consuming due to the need to rebuild the solution for each run. Despite this, the process is idempotent, ensuring database integrity without causing conflicts.



A potential improvement would be for EF Core migration bundles to support targeting specific migrations without requiring a full build. This would streamline the process and reduce delays, making it a valuable feature for future updates.



## More Info



- [Intro](https://github.com/huseyindeniz/gitops-lab/wiki)

- [Kubernetes notes](https://github.com/huseyindeniz/gitops-lab/wiki/Kubernetes)

- [Minikube notes](https://github.com/huseyindeniz/gitops-lab/wiki/Minikube)

- [Terraform notes](https://github.com/huseyindeniz/gitops-lab/wiki/Terraform)

- [Helm notes](https://github.com/huseyindeniz/gitops-lab/wiki/Helm)

- [Argo CD notes](https://github.com/huseyindeniz/gitops-lab/wiki/Argo-CD)

- [Argo Rollouts notes](https://github.com/huseyindeniz/gitops-lab/wiki/Argo-Rollouts)

- [Argo Workflows notes](https://github.com/huseyindeniz/gitops-lab/wiki/Argo-Workflows)

- [Github Actions notes](https://github.com/huseyindeniz/gitops-lab/wiki/Github-Actions)

- [Flux notes](https://github.com/huseyindeniz/gitops-lab/wiki/Flux)

- [Local env setup notes](https://github.com/huseyindeniz/gitops-lab/wiki/Local-Env)

- [AKS setup notes](https://github.com/huseyindeniz/gitops-lab/wiki/AKS)

- [EKS setup notes](https://github.com/huseyindeniz/gitops-lab/wiki/EKS)

- [GKE setup notes](https://github.com/huseyindeniz/gitops-lab/wiki/GKE)

- [DOKS setup notes](https://github.com/huseyindeniz/gitops-lab/wiki/DOKS)

- [Monitoring notes](https://github.com/huseyindeniz/gitops-lab/wiki/Monitoring)

- [Infra testing notes](https://github.com/huseyindeniz/gitops-lab/wiki/Infra-Testing)

- [DAPR notes](https://github.com/huseyindeniz/gitops-lab/wiki/DAPR)

- [DDD + EF Core Code First notes](https://github.com/huseyindeniz/gitops-lab/wiki/DDD-with-ef-core)

- [BDD notes](https://github.com/huseyindeniz/gitops-lab/wiki/BDD)

- [AI/ML Workloads notes](https://github.com/huseyindeniz/gitops-lab/wiki/AI-ML-Workloads)

- [Blockchain notes](https://github.com/huseyindeniz/gitops-lab/wiki/Blockchain)

- [Colyseus notes](https://github.com/huseyindeniz/gitops-lab/wiki/Colyseus)