https://github.com/mikeroyal/kubernetes-guide
Kubernetes Guide. Learn all about Kubernetes monitoring, networking, and containers. Whether you're running Kubernetes Locally or in the Cloud ( Azure, AWS, and GCP).
https://github.com/mikeroyal/kubernetes-guide
awesome-lists cloud-computing gke istio k3s k8s kubeadm kubectl kubeflow kubernetes kubernetes-cluster kubernetes-controller kubernetes-deployment kubernetes-monitoring kubernetes-operator kubernetes-setup minikube rancher thanos wsl2
Last synced: about 1 year ago
JSON representation
Kubernetes Guide. Learn all about Kubernetes monitoring, networking, and containers. Whether you're running Kubernetes Locally or in the Cloud ( Azure, AWS, and GCP).
- Host: GitHub
- URL: https://github.com/mikeroyal/kubernetes-guide
- Owner: mikeroyal
- Created: 2020-10-07T20:23:39.000Z (over 5 years ago)
- Default Branch: main
- Last Pushed: 2024-01-04T22:48:10.000Z (over 2 years ago)
- Last Synced: 2025-04-06T10:42:53.062Z (about 1 year ago)
- Topics: awesome-lists, cloud-computing, gke, istio, k3s, k8s, kubeadm, kubectl, kubeflow, kubernetes, kubernetes-cluster, kubernetes-controller, kubernetes-deployment, kubernetes-monitoring, kubernetes-operator, kubernetes-setup, minikube, rancher, thanos, wsl2
- Language: Go
- Homepage:
- Size: 446 KB
- Stars: 209
- Watchers: 10
- Forks: 42
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: Contributing.md
- Security: Security Glossary.md
Awesome Lists containing this project
README
Kubernetes Guide
#### A guide covering Kubernetes including the applications and tools that will make you a better and more efficient Kubernetes developer.
**Note: You can easily convert this markdown file to a PDF in [VSCode](https://code.visualstudio.com/) using this handy extension [Markdown PDF](https://marketplace.visualstudio.com/items?itemName=yzane.markdown-pdf).**
# Table of Contents
1. [Getting Started with Kubernetes](#getting-started-with-kubernetes)
- [Developer Resources](#developer-resources)
- [Kubernetes Courses & Certifications](#kubernetes-courses--certifications)
- [Books](#kubernetes-books)
- [YouTube Tutorials](#youtube-tutorials)
- [Red Hat CodeReady Containers (CRC) OpenShift on WSL](#red-Hat-CodeReady-Containers-CRC-on-wsl)
- [Setting up Podman on WSL](#setting-up-podman-on-wsl)
- [Setting up Buildah on WSL](#setting-up-buildah-on-wsl)
- [Installing Kubernetes on WSL with Rancher Desktop](#installing-kubernetes-on-wsl-with-rancher-desktop)
- [Installing Kubernetes on WSL with Docker Desktop](#installing-kubernetes-on-wsl-with-docker-desktop)
- [Installing Kubernetes on WSL with Microk8s](#installing-kubernetes-on-wsl-with-microk8s)
2. [Kubernetes Tools and Projects](#kubernetes-tools-and-projects)
* [Getting Started with OpenShift](#getting-started-with-openshift)
* [What is OpenShift?](#what-is-openshift)
* [OpenShift Developer Resources](#openshift-developer-resources)
* [Source-to-Image(S2I) images for buildng your Apps](#source-to-image-s2i-images-for-programmingbuildng-your-apps)
* [Java](#Java)
* [Python](#Python)
* [Golang](#Golang)
* [Ruby](#Ruby)
* [.NET Core](#net-core)
* [Node.js](#Nodejs)
* [Perl](#Perl)
* [PHP](#PHP)
* [Builder Images for setting up Databases](#builder-images-for-setting-up-Databases)
* [MySQL](#mysql)
* [PostgreSQL](#postgresql)
* [MongoDB](#mongodb)
* [MariaDB](#mariadb)
* [Redis](#redis)
* [Setting up Openshift on Microsoft Azure](#setting-up-on-Microsoft-Azure)
* [Setting up Openshift on Google Cloud Platform (GCP)](#setting-up-on-Google-Cloud-GCP)
* [Setting up Red Hat OpenShift Data Science](#setting-up-Red-Hat-OpenShift-Data-Science)
* [Setting up Red Hat CodeReady Containers (CRC) OpenShift](#red-Hat-CodeReady-Containers-CRC)
* [Setting up Podman](#setting-up-podman)
* [Setting up Buildah](#setting-up-buildah)
* [Setting up Skopeo](#setting-up-skopeo)
* [File systems](#file-systems)
* [OpenShift Tools](#openshift-tools)
3. [Go Development](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#go-development)
4. [Python Development](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#python-development)
5. [Bash/PowerShell Development](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#bashpowershell-development)
6. [Machine Learning](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#machine-learning)
7. [Networking](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#networking)
8. [Databases](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#databases)
9. [Telco 5G](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#telco-5g)
10. [Open Source Security](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#open-source-security)
- [Security Tutorials & Resources](#Security-Tutorials--Resources)
- [Security Cerifications](#Security-Cerifications)
# Getting Started with Kubernetes
[Back to the Top](#table-of-contents)
[Kubernetes (K8s)](https://kubernetes.io/) is an open-source system for automating deployment, scaling, and management of containerized applications.
**Building Highly-Availability(HA) Clusters with kubeadm. Source: [Kubernetes.io](https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/high-availability/)**
### Developer Resources
[Back to the Top](#table-of-contents)
- [Kubernetes Certifications](https://kubernetes.io/training/)
- [Getting started with Kubernetes on AWS](https://aws.amazon.com/kubernetes/)
- [Kubernetes on Microsoft Azure](https://azure.microsoft.com/en-us/topic/what-is-kubernetes/)
- [Intro to Azure Kubernetes Service](https://docs.microsoft.com/en-us/azure/aks/kubernetes-dashboard)
- [Getting started with Google Cloud](https://cloud.google.com/learn/what-is-kubernetes)
- [Azure Red Hat OpenShift ](https://azure.microsoft.com/en-us/services/openshift/)
- [Getting started with Kubernetes on Red Hat](https://www.redhat.com/en/topics/containers/what-is-kubernetes)
- [Getting started with Kubernetes on IBM](https://www.ibm.com/cloud/learn/kubernetes)
- [Red Hat OpenShift on IBM Cloud](https://www.ibm.com/cloud/openshift)
- [Kubernetes Contributors](https://www.kubernetes.dev/)
- [Kubernetes Tutorials from Pulumi](https://www.pulumi.com/docs/tutorials/kubernetes/)
- [Enable OpenShift Virtualization on Red Hat OpenShift](https://developers.redhat.com/blog/2020/08/28/enable-openshift-virtualization-on-red-hat-openshift/)
- [YAML basics in Kubernetes](https://developer.ibm.com/technologies/containers/tutorials/yaml-basics-and-usage-in-kubernetes/)
- [Elastic Cloud on Kubernetes](https://www.elastic.co/elastic-cloud-kubernetes)
- [Docker and Kubernetes](https://www.docker.com/products/kubernetes)
- [Running Apache Spark on Kubernetes](http://spark.apache.org/docs/latest/running-on-kubernetes.html)
- [Kubernetes Across VMware vRealize Automation](https://blogs.vmware.com/management/2019/06/kubernetes-across-vmware-cloud-automation-services.html)
- [VMware Tanzu Kubernetes Grid](https://tanzu.vmware.com/kubernetes-grid)
- [All the Ways VMware Tanzu Works with AWS](https://tanzu.vmware.com/content/blog/all-the-ways-vmware-tanzutm-works-with-aws)
- [Using Ansible in a Cloud-Native Kubernetes Environment](https://www.ansible.com/blog/how-useful-is-ansible-in-a-cloud-native-kubernetes-environment)
- [Managing Kubernetes (K8s) objects with Ansible](https://docs.ansible.com/ansible/latest/collections/community/kubernetes/k8s_module.html)
- [Setting up a Kubernetes cluster using Vagrant and Ansible](https://kubernetes.io/blog/2019/03/15/kubernetes-setup-using-ansible-and-vagrant/)
- [Running MongoDB with Kubernetes](https://www.mongodb.com/kubernetes)
- [Kubernetes Fluentd](https://docs.fluentd.org/v/0.12/articles/kubernetes-fluentd)
- [Understanding the new GitLab Kubernetes Agent](https://about.gitlab.com/blog/2020/09/22/introducing-the-gitlab-kubernetes-agent/)
- [Intro Local Process with Kubernetes for Visual Studio 2019](https://devblogs.microsoft.com/visualstudio/introducing-local-process-with-kubernetes-for-visual-studio%E2%80%AF2019/)
- [Kubernetes Playground by Katacoda](https://www.katacoda.com/courses/kubernetes/playground)
### Kubernetes Courses & Certifications
[Back to the Top](#table-of-contents)
- [Kubernetes Training & Certifications](https://kubernetes.io/training/)
- [Top Kubernetes Courses Online | Coursera](https://www.coursera.org/courses?query=kubernetes)
- [Top Kubernetes Courses Online | Udemy](https://www.udemy.com/topic/kubernetes/)
- [Kubernetes Courses - IBM Developer](https://developer.ibm.com/components/kubernetes/courses/)
- [Introduction to Kubernetes Courses | edX](https://www.edx.org/course/introduction-to-kubernetes)
- [VMware Tanzu Education](https://tanzu.vmware.com/education)
- [KubeAcademy from VMware](https://kube.academy/)
- [Online Kubernetes Course: Beginners Guide to Kubernetes | Pluralsight](https://www.pluralsight.com/courses/getting-started-kubernetes)
- [Getting Started with Google Kubernetes Engine | Pluralsight](https://www.pluralsight.com/courses/getting-started-google-kubernetes-engine-8)
- [Scalable Microservices with Kubernetes course from Udacity](https://www.udacity.com/course/scalable-microservices-with-kubernetes--ud615)
### Kubernetes Books
[Back to the Top](#table-of-contents)
- [Kubernetes for Full-Stack Developers by Digital Ocean](https://assets.digitalocean.com/books/kubernetes-for-full-stack-developers.pdf)
- [Kubernetes Patterns - Red Hat](https://www.redhat.com/cms/managed-files/cm-oreilly-kubernetes-patterns-ebook-f19824-201910-en.pdf)
- [The Ultimate Guide to Kubernetes Deployments with Octopus](https://i.octopus.com/books/kubernetes-book.pdf)
- [Learng Kubernetes (PDF)](https://riptutorial.com/Download/kubernetes.pdf)
- [Certified Kubernetes Administrator (CKA) Study Guide: In-Depth Guidance and Practice](https://www.amazon.com/Certified-Kubernetes-Administrator-Study-Depth/dp/1098107225/ref=sr_1_29?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-29)
- [Quick Start Kubernetes by Nigel Poulton (2022)](https://www.amazon.com/Quick-Start-Kubernetes-Nigel-Poulton-ebook/dp/B08T21NW4Z/ref=sr_1_18?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-18)
- [The Kubernetes Book by Nigel Poulton (2022)](https://www.amazon.com/Kubernetes-Book-Version-November-2018-ebook/dp/B072TS9ZQZ/ref=sr_1_4?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-4)
- [Kubernetes: Up and Running: Dive into the Future of Infrastructure](https://www.amazon.com/Kubernetes-Running-Dive-Future-Infrastructure/dp/1492046531/ref=sr_1_5?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-5)
- [Kubernetes and Docker - An Enterprise Guide: Effectively containerize applications, integrate enterprise systems, and scale applications in your enterprise](https://www.amazon.com/Kubernetes-Docker-Effectively-containerize-applications/dp/183921340X/ref=sr_1_24?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-24)
- [Kubernetes in Action](https://www.amazon.com/Kubernetes-Action-Marko-Luksa/dp/1617293725/ref=sr_1_7?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-7)
- [Kubernetes – An Enterprise Guide: Effectively containerize applications, integrate enterprise systems, and scale](https://www.amazon.com/Kubernetes-Enterprise-Effectively-containerize-applications/dp/1803230037/ref=sr_1_6?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-6)
- [Production Kubernetes: Building Successful Application Platforms](https://www.amazon.com/Production-Kubernetes-Successful-Application-Platforms/dp/1492092304/ref=sr_1_8?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-8)
- [The Kubernetes Bible: The definitive guide to deploying and managing Kubernetes across major cloud platforms](https://www.amazon.com/Kubernetes-Bible-definitive-deploying-platforms/dp/1838827692/ref=sr_1_16?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-16)
- [Networking and Kubernetes: A Layered Approach](https://www.amazon.com/Networking-Kubernetes-Approach-James-Strong/dp/1492081655/ref=sr_1_12?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-12)
- [Kubernetes Best Practices: Blueprints for Building Successful Applications on Kubernetes](https://www.amazon.com/Kubernetes-Best-Practices-Blueprints-Applications/dp/1492056472/ref=sr_1_19?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-19)
- [Kubernetes Security and Observability: A Holistic Approach to Securing Containers and Cloud Native Apps](https://www.amazon.com/Kubernetes-Security-Observability-Containers-Applications/dp/1098107101/ref=sr_1_26?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-26)
- [Hands-on Kubernetes on Azure: Use Azure Kubernetes Service to automate management, scaling, and deployment of containerized apps](https://www.amazon.com/Hands-Kubernetes-Azure-containerized-applications-ebook/dp/B095H26VFY/ref=sr_1_11?crid=15963283P4C0V&keywords=kubernetes&qid=1653935057&s=books&sprefix=kubernetes%2Cstripbooks%2C174&sr=1-11)
### YouTube Tutorials
[Back to the Top](#table-of-contents)
[](https://www.youtube.com/watch?v=kGrpLKNi4ZI)
[](https://www.youtube.com/watch?v=Oe_mhDtb22M)
[](https://www.youtube.com/watch?v=vxtq_pJp7_A)
[](https://www.youtube.com/watch?v=S8eX0MxfnB4)
[](https://www.youtube.com/watch?v=d6WC5n9G_sM)
[](https://www.youtube.com/watch?v=VnvRFRk_51k)
[](https://www.youtube.com/watch?v=wXuSqFJVNQA)
[](https://www.youtube.com/watch?v=kTp5xUtcalw)
[](https://www.youtube.com/watch?v=PziYflu8cB8)
[](https://www.youtube.com/watch?v=n-fAf2mte6M)
### Red Hat CodeReady Containers (CRC) on WSL
[Back to the Top](#table-of-contents)
[Red Hat CodeReady Containers (CRC)](https://developers.redhat.com/content-gateway/rest/mirror/pub/openshift-v4/clients/crc/2.9.0) is a tool that provides a minimal, preconfigured OpenShift 4 cluster on a laptop or desktop machine for development and testing purposes. CRC is delivered as a platform inside of the VM.
* **odo (OpenShift Do)**, a CLI tool for developers, to manage application components on the OpenShift Container Platform.
**System Requirements:**
* **OS:** CentOS Stream 8/RHEL 8/Fedora or later (the latest 2 releases).
* **Download:** [pull-secret](https://cloud.redhat.com/openshift/install/crc/installer-provisioned?intcmp=701f20000012ngPAAQ)
* **Login:** [Red Hat account](https://access.redhat.com/login)
**Other physical requirements include:**
* Four virtual CPUs (**4 vCPUs**)
* 10GB of memory (**RAM**)
* 40GB of storage space
**To set up CodeReady Containers, start by creating the ```crc``` directory, and then download and extract the ```crc``` package:**
```mkdir /home//crc```
```wget https://mirror.openshift.com/pub/openshift-v4/clients/crc/latest/crc-linux-amd64.tar.xz```
```tar -xvf crc-linux-amd64.tar.xz```
**Next, move the files to the crc directory and remove the downloaded package(s):**
```mv /home//crc-linux--amd64/* /home//crc```
```rm /home//crc-linux-amd64.tar.xz```
```rm -r /home//crc-linux--amd64```
**Change to the ```crc``` directory, make ```crc``` executable, and export your ```PATH``` like this:**
```cd /home//crc```
```chmod +x crc```
```export PATH=$PATH:/home//crc```
**Set up and start the cluster:**
```crc setup```
```crc start -p //pull-secret.txt```
**Set up the OC environment:**
```crc oc-env```
```eval $(crc oc-env)```
**Log in as the developer user:**
```oc login -u developer -p developer https://api.crc.testing:6443```
```oc logout```
**And then, log in as the platform’s admin:**
```oc login -u kubeadmin -p password https://api.crc.testing:6443```
```oc logout```
#### Interacting with the cluster. The most common ways include:
**Starting the graphical web console:**
```crc console```
**Display the cluster’s status:**
```crc status```
**Shut down the OpenShift cluster:**
```crc stop```
**Delete or kill the OpenShift cluster:**
```crc delete```
### Setting up Podman on WSL
[Back to the Top](#table-of-contents)
[Podman (the POD manager)](https://podman.io/) is an open source tool for developing, managing, and running containers on your Linux® systems. It also manages the entire container ecosystem using the libpod library. Podman’s daemonless and inclusive architecture makes it a more secure and accessible option for container management, and its accompanying tools and features, such as [Buildah](https://www.redhat.com/en/topics/containers/what-is-buildah) and [Skopeo](https://www.redhat.com/en/topics/containers/what-is-skopeo), allow developers to customize their container environments to best suit their needs.
* Fedora: ```sudo dnf install podman```
* CentOS: ```sudo yum --enablerepo=extras install podman```
* Ubuntu 20.04 or later: ```sudo apt install podman```
* Debian 11 (bullseye) or later, or sid/unstable: ```sudo apt install podman```
* ArchLinux: ```sudo pacman -S podman``` and then tweaks for rootless
Podman
### Setting up Buildah on WSL
[Back to the Top](#table-of-contents)
[Buildah](https://buildah.io/) is an open source, Linux-based tool that can build Docker- and Kubernetes-compatible images, and is easy to incorporate into scripts and build pipelines. In addition, Buildah has overlap functionality with [Podman](https://podman.io/), [Skopeo](https://github.com/containers/skopeo), and [CRI-O](https://cri-o.io/).
* Fedora: ```sudo dnf -y install buildah```
* CentOS: ```sudo yum --enablerepo=extras install buildah```
* Ubuntu 20.04 or later: ```sudo apt install buildah```
* Debian 11 (bullseye) or later, or sid/unstable: ```sudo apt install -y buildah```
* ArchLinux: ```sudo pacman -S buildah``` and then tweaks for rootless
Buildah
### Installing Kubernetes on WSL with Rancher Desktop
[Back to the Top](#table-of-contents)
[Rancher Desktop](https://www.rancher.com/products/rancher-desktop) is an open-source desktop application for Mac, Windows and Linux. Rancher Desktop runs Kubernetes and container management on your desktop letting you choose the version of Kubernetes you want to run. It can also build, push, pull, and run container images using either the Docker CLI (with Moby/dockerd) or nerdctl (with containerd).
**Features:**
* Installs a new Linux VM in WSL2 that has a Kubernetes cluster based on [k3s](https://k3s.io/) as well as installs various components in it such as KIM (for building docker images on the cluster) and the [Traefik Ingress Controller](https://traefik.io/solutions/kubernetes-ingress/).
* It installs the kubectl and Helm CLIs on the Windows side linked to them.
* A nice Windows app to manage its settings and help facilitate its upgrades.
Rancher Desktop
Rancher Desktop Kubernetes Settings
#### .deb Dev Repository
```curl -s https://download.opensuse.org/repositories/isv:/Rancher:/dev/deb/Release.key | gpg --dearmor | sudo dd status=none of=/usr/share/keyrings/isv-rancher-dev-archive-keyring.gpg```
```echo 'deb [signed-by=/usr/share/keyrings/isv-rancher-dev-archive-keyring.gpg] https://download.opensuse.org/repositories/isv:/Rancher:/dev/deb/ ./' | sudo dd status=none of=/etc/apt/sources.list.d/isv-rancher-dev.list```
```sudo apt update```
**See available versions**
```apt list -a rancher-desktop```
```sudo apt install rancher-desktop=```
#### .rpm Dev Repository
```sudo zypper addrepo https://download.opensuse.org/repositories/isv:/Rancher:/dev/rpm/isv:Rancher:dev.repo```
```sudo zypper refresh```
**See available versions**
```zypper search -s rancher-desktop```
```zypper install --oldpackage rancher-desktop=```
Rancher Desktop Architecture Overview
### Installing Kubernetes on WSL with Docker Desktop
[Back to the Top](#table-of-contents)
Enable the WSL 2 base engine in Docker Desktop
We also need to set in Resources which WSL2 distribution we want to access Docker from, as shown below using Ubuntu 20.04. Then remember to restart Docker for Windows, and once the restart is complete we can use the docker command from within WSL:
Make sure to use kind as a simple way to run Kubernetes in a container. Here we will install the instructions from the official [Kind website](https://kind.sigs.k8s.io/docs/user/quick-start/).
```curl -Lo ./kind https://github.com/kubernetes-sigs/kind/releases/download/v0.16.0/kind-$(uname)-amd64```
```chmod +x ./kind```
```mv ./kind /usr/local/bin/```
Now that kind is installed, we can create the Kubernetes cluster
```echo $KUBECONFIG```
```ls $HOME/.kube```
```kind create cluster --name wslkube```
```ls $HOME/.kube```
We have successfully created a single-node Kubernetes cluster.
```kubectl get nodes```
```kubectl get all --all-namespaces```
### Installing Kubernetes on WSL with Microk8s
[Back to the Top](#table-of-contents)
* **Note:** This install option requires systemd to be running on WSL
* **WSL Systemd requirements:** Windows 11 and a version of WSL 0.67.6 or above.
[MicroK8s](https://microk8s.io/) is the simplest production-grade upstream Kubernets setup to get up and running.
Installing Microk8s
```sudo snap install microk8s --classic```
Checking the status while Kubernetes starts
```microk8s status --wait-ready```
Turning on the services you want
```microk8s enable dashboard dns registry istio```
Try **microk8s enable --help** for a list of available services and optional features. **microk8s disable ** turns off a service.
Start using Kubernetes
```microk8s kubectl get all --all-namespaces```
If you mainly use MicroK8s you can make our kubectl the default one on your command-line with **alias mkctl="microk8s kubectl"**.
Access the Kubernetes dashboard
```microk8s dashboard-proxy```
# Kubernetes Tools, Frameworks, and Projects
[Back to the Top](#table-of-contents)
[Open Container Initiative](https://opencontainers.org/about/overview/) is an open governance structure for the express purpose of creating open industry standards around container formats and runtimes.
[Buildah](https://buildah.io/) is a command line tool to build Open Container Initiative (OCI) images. It can be used with Docker, Podman, Kubernetes.
[Podman](https://podman.io/) is a daemonless, open source, Linux native tool designed to make it easy to find, run, build, share and deploy applications using Open Containers Initiative (OCI) Containers and Container Images. Podman provides a command line interface (CLI) familiar to anyone who has used the Docker Container Engine.
[Containerd](https://containerd.io) is a daemon that manages the complete container lifecycle of its host system, from image transfer and storage to container execution and supervision to low-level storage to network attachments and beyond. It is available for Linux and Windows.
[Google Kubernetes Engine (GKE)](https://cloud.google.com/kubernetes-engine/) is a managed, production-ready environment for running containerized applications.
[Azure Kubernetes Service (AKS)](https://azure.microsoft.com/en-us/services/kubernetes-service/) is serverless Kubernetes, with a integrated continuous integration and continuous delivery (CI/CD) experience, and enterprise-grade security and governance. Unite your development and operations teams on a single platform to rapidly build, deliver, and scale applications with confidence.
[Amazon EKS](https://docs.aws.amazon.com/eks/latest/userguide/what-is-eks.html) is a tool that runs Kubernetes control plane instances across multiple Availability Zones to ensure high availability.
[AWS Controllers for Kubernetes (ACK)](https://aws.amazon.com/blogs/containers/aws-controllers-for-kubernetes-ack/) is a new tool that lets you directly manage AWS services from Kubernetes. ACK makes it simple to build scalable and highly-available Kubernetes applications that utilize AWS services.
[Container Engine for Kubernetes (OKE)](https://www.oracle.com/cloud-native/container-engine-kubernetes/) is an Oracle-managed container orchestration service that can reduce the time and cost to build modern cloud native applications. Unlike most other vendors, Oracle Cloud Infrastructure provides Container Engine for Kubernetes as a free service that runs on higher-performance, lower-cost compute.
[Anthos](https://cloud.google.com/anthos/docs/concepts/overview) is a modern application management platform that provides a consistent development and operations experience for cloud and on-premises environments.
[Red Hat Openshift](https://www.openshift.com/) is a fully managed Kubernetes platform that provides a foundation for on-premises, hybrid, and multicloud deployments.
[OKD](https://okd.io/) is a community distribution of Kubernetes optimized for continuous application development and multi-tenant deployment. OKD adds developer and operations-centric tools on top of Kubernetes to enable rapid application development, easy deployment and scaling, and long-term lifecycle maintenance for small and large teams.
[Odo](https://odo.dev/) is a fast, iterative, and straightforward CLI tool for developers who write, build, and deploy applications on Kubernetes and OpenShift.
[Kata Operator](https://github.com/openshift/kata-operator) is an operator to perform lifecycle management (install/upgrade/uninstall) of [Kata Runtime](https://katacontainers.io/) on Openshift as well as Kubernetes cluster.
[Thanos](https://thanos.io/) is a set of components that can be composed into a highly available metric system with unlimited storage capacity, which can be added seamlessly on top of existing Prometheus deployments.
[OpenShift Hive](https://github.com/openshift/hive) is an operator which runs as a service on top of Kubernetes/OpenShift. The Hive service can be used to provision and perform initial configuration of OpenShift 4 clusters.
[Rook](https://rook.io/) is a tool that turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management.
[VMware Tanzu](https://tanzu.vmware.com/tanzu) is a centralized management platform for consistently operating and securing your Kubernetes infrastructure and modern applications across multiple teams and private/public clouds.
[Kubespray](https://kubespray.io/) is a tool that combines Kubernetes and Ansible to easily install Kubernetes clusters that can be deployed on [AWS](https://github.com/kubernetes-sigs/kubespray/blob/master/docs/aws.md), GCE, [Azure](https://github.com/kubernetes-sigs/kubespray/blob/master/docs/azure.md), [OpenStack](https://github.com/kubernetes-sigs/kubespray/blob/master/docs/openstack.md), [vSphere](https://github.com/kubernetes-sigs/kubespray/blob/master/docs/vsphere.md), [Packet](https://github.com/kubernetes-sigs/kubespray/blob/master/docs/packet.md) (bare metal), Oracle Cloud Infrastructure (Experimental), or Baremetal.
[KubeInit](https://github.com/kubeinit/kubeinit) provides Ansible playbooks and roles for the deployment and configuration of multiple Kubernetes distributions.
[Rancher](https://rancher.com/) is a complete software stack for teams adopting containers. It addresses the operational and security challenges of managing multiple Kubernetes clusters, while providing DevOps teams with integrated tools for running containerized workloads.
[K3s](https://github.com/rancher/k3s) is a highly available, certified Kubernetes distribution designed for production workloads in unattended, resource-constrained, remote locations or inside IoT appliances.
[Helm](https://helm.sh/) is a Kubernetes Package Manager tool that makes it easier to install and manage Kubernetes applications.
[Knative](https://knative.dev/) is a Kubernetes-based platform to build, deploy, and manage modern serverless workloads. Knative takes care of the operational overhead details of networking, autoscaling (even to zero), and revision tracking.
[KubeFlow](https://www.kubeflow.org/) is a tool dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable and scalable.
[Kubebox](https://github.com/astefanutti/kubebox) is a Terminal and Web console for Kubernetes.
[Kubsec](https://github.com/controlplaneio/kubesec) is a Security risk analysis for Kubernetes resources.
[Replex](https://www.replex.io/) is a Kubernetes Governance and Cost Management for the Cloud-Native Enterprise.
[Virtual Kubelet](https://virtual-kubelet.io/) is an open-source [Kubernetes kubelet](https://kubernetes.io/docs/reference/generated/kubelet/) implementation that masquerades as a kubelet.
[Telepresence](https://www.telepresence.io/) is a fast, local development for Kubernetes and OpenShift microservices.
[Weave Scope](https://www.weave.works/oss/scope/) is a tool that automatically detects processes, containers, hosts. No kernel modules, no agents, no special libraries, no coding. It seamless integration with Docker, Kubernetes, DCOS and AWS ECS.
[Nuclio](https://nuclio.io/) is a high-performance "serverless" framework focused on data, I/O, and compute intensive workloads. It is well integrated with popular data science tools, such as [Jupyter](https://jupyter.org/) and [Kubeflow](https://www.kubeflow.org/); supports a variety of data and streaming sources; and supports execution over CPUs and GPUs.
[Supergiant Control](https://github.com/supergiant/control) is a tool that manages the lifecycle of clusters on your infrastructure and allows deployment of applications via HELM. Its deployment and configuration workflows will help you to get up and running with Kubernetes faster.
[Supergiant Capacity - Beta](https://github.com/supergiant/capacity) is a tool that ensures that the right hardware is available for the required resource load of your Kubernetes cluster at any given time. This helps prevent over-provisioning of your container environment and overspending on your hardware budget.
[Test suite for Kubernetes](https://github.com/mrahbar/k8s-testsuite) is a test suite consists of two Helm charts for network bandwith testing and load testing a Kuberntes cluster.
[Keel](https://github.com/keel-hq/keel) is a Kubernetes Operator to automate Helm, DaemonSet, StatefulSet & Deployment updates.
[Kube Monkey](https://github.com/asobti/kube-monkey) is an implementation of Netflix's Chaos Monkey for Kubernetes clusters. It randomly deletes Kubernetes (k8s) pods in the cluster encouraging and validating the development of failure-resilient services.
[Kube State Metrics (KSM)](https://github.com/kubernetes/kube-state-metrics) is a simple service that listens to the Kubernetes API server and generates metrics about the state of the objects. It's not focused on the health of the individual Kubernetes components, but rather on the health of the various objects inside, such as deployments, nodes and pods.
[Sonobuoy](https://sonobuoy.io/) is a diagnostic tool that makes it easier to understand the state of a Kubernetes cluster by running a choice of configuration tests in an accessible and non-destructive manner.
[PowerfulSeal](https://github.com/powerfulseal/powerfulseal) is a powerful testing tool for your Kubernetes clusters, so that you can detect problems as early as possible.
[Test Infra](https://github.com/kubernetes/test-infra) is a repository contains tools and configuration files for the testing and automation needs of the Kubernetes project.
[cAdvisor (Container Advisor)](https://github.com/google/cadvisor) is a tool that provides container users an understanding of the resource usage and performance characteristics of their running containers. It's a running daemon that collects, aggregates, processes, and exports information about running containers. Specifically, for each container it keeps resource isolation parameters, historical resource usage, histograms of complete historical resource usage and network statistics.
[Etcd](https://etcd.io/) is a distributed key-value store that provides a reliable way to store data that needs to be accessed by a distributed system or cluster of machines. Etcd is used as the backend for service discovery and stores cluster state and configuration for Kubernetes.
[nacos](https://github.com/alibaba/nacos) is an easy-to-use dynamic service discovery, configuration and service management platform for building cloud native applications.
[Kuma](https://kuma.io/install) is a modern Envoy-based service mesh that can run on every cloud, in a single or multi-zone capacity, across both Kubernetes and VMs. Thanks to its broad universal workload support, combined with native support for Envoy as its data plane proxy technology (but with no Envoy expertise required), Kuma provides modern L4-L7 service connectivity, discovery, security, observability, routing and more across any service on any platform, databases included.
[Open Service Mesh (OSM)](https://openservicemesh.io/) is a lightweight, extensible, cloud native service mesh that allows users to uniformly manage, secure, and get out-of-the-box observability features for highly dynamic microservice environments.
[kserve](https://github.com/kserve/kserve) is a Standardized Serverless ML Inference Platform on Kubernetes.
[naftis](https://github.com/XiaoMi/naftis) is an awesome dashboard for Istio built with love.
[Traefik Mesh](https://traefik.io/traefik-mesh) is a simple, yet full-featured service mesh. It is container-native and fits as your de-facto service mesh in your Kubernetes cluster. It supports the latest Service Mesh Interface specification [SMI](https://smi-spec.io/) that facilitates integration with pre-existing solution.
[Meshery](https://meshery.io/) is the cloud native management plane offering lifecycle, configuration, and performance management of Kubernetes, service meshes, and your workloads.
[kubectx](https://kubectx.dev/) is a tool to switch between contexts (clusters) on kubectl faster.
[Dapr](https://dapr.io/) is a portable, event-driven, runtime for building distributed applications across cloud and edge.
[OpenEBS](https://openebs.io/) is a Kubernetes-based tool to create stateful applications using Container Attached Storage.
[Container Storage Interface (CSI)](https://www.architecting.it/blog/container-storage-interface/) is an API that lets container orchestration platforms like Kubernetes seamlessly communicate with stored data via a plug-in.
[MicroK8s](https://microk8s.io/) is a tool that delivers the full Kubernetes experience. In a Fully containerized deployment with compressed over-the-air updates for ultra-reliable operations. It is supported on Linux, Windows, and MacOS.
[Charmed Kubernetes](https://ubuntu.com/kubernetes/features) is a well integrated, turn-key, conformant Kubernetes platform, optimized for your multi-cloud environments developed by Canonical.
[Grafana Kubernetes App](https://grafana.com/grafana/plugins/grafana-kubernetes-app) is a toll that allows you to monitor your Kubernetes cluster's performance. It includes 4 dashboards, Cluster, Node, Pod/Container and Deployment. It allows for the automatic deployment of the required Prometheus exporters and a default scrape config to use with your in cluster Prometheus deployment.
[KubeEdge](https://kubeedge.io/en/) is an open source system for extending native containerized application orchestration capabilities to hosts at Edge.It is built upon kubernetes and provides fundamental infrastructure support for network, app. deployment and metadata synchronization between cloud and edge.
[Lens](https://k8slens.dev/) is the most powerful IDE for people who need to deal with Kubernetes clusters on a daily basis. It has support for MacOS, Windows and Linux operating systems.
[kind](https://kind.sigs.k8s.io/) is a tool for running local Kubernetes clusters using Docker container “nodes”. It was primarily designed for testing Kubernetes itself, but may be used for local development or CI.
[Flux CD](https://fluxcd.io/) is a tool that automatically ensures that the state of your Kubernetes cluster matches the configuration you've supplied in Git. It uses an operator in the cluster to trigger deployments inside Kubernetes, which means that you don't need a separate continuous delivery tool.
[Platform9 Managed Kubernetes (PMK)](https://platform9.com/managed-kubernetes/) is a Kubernetes as a service that ensures fully automated Day-2 operations with 99.9% SLA on any environment, whether in data-centers, public clouds, or at the edge.
## Getting Started with OpenShift
[Back to the Top](#table-of-contents)
### What is OpenShift?
[Red Hat OpenShift](https://www.openshift.com/) is an open source container application platform based on the Kubernetes container orchestrator for enterprise app development and deployment in the hybrid cloud Red Hat OpenShift, the open hybrid cloud platform built on Kubernetes. OpenShift can manage applications written in different languages and frameworks, such as Ruby, Node.js, Java, Perl, and Python.
**Red Hat OpenShift Development Architecture. Source: [Red Hat](https://www.redhat.com/en/resources/openshift-container-storage-datasheet)**
### OpenShift Developer Resources
[Back to the Top](#table-of-contents)
* [Get Started with the CLI on OpenShift](https://docs.openshift.com/container-platform/3.9/cli_reference/get_started_cli.html)
* [CI/CD with OpenShift](https://www.openshift.com/blog/cicd-with-openshift)
* [AI/ML on OpenShift](https://www.openshift.com/learn/topics/ai-ml)
* [Red Hat OpenShift on VMware](https://www.openshift.com/learn/topics/openshift-on-vmware)
* [Understanding service mesh with OpenShift](https://docs.openshift.com/container-platform/4.1/service_mesh/service_mesh_arch/understanding-ossm.html)
* [IBM Redbooks | Red Hat](https://www.redbooks.ibm.com/domains/redhat)
* [DevOps Training & Tutorials | Red Hat Developer](https://developers.redhat.com/topics/devops)
* [All Topics for Software Developers | Red Hat Developer](https://developers.redhat.com/topics)
* [Develop Applications on OpenShift](https://developers.redhat.com/openshift)
* [Automate application security with OpenShift Pipelines](https://developers.redhat.com/topics/devsecops)
* [What is the difference between OpenShift and Kubernetes?](https://developers.redhat.com/openshift/difference-openshift-kubernetes/)
* [What books are available about OpenShift?](https://developers.redhat.com/openshift/openshift-books/)
* [Where can I try out OpenShift to see what it is like?](https://developers.redhat.com/openshift/try-openshift/)
* [How can I run OpenShift on my own computer for development?](https://developers.redhat.com/openshift/local-openshift/)
* [What hosting services are there that use OpenShift?](https://developers.redhat.com/openshift/hosting-openshift/)
### Certifications & Courses
[Back to the Top](#table-of-contents)
* [OpenShift Training from Red Hat](https://www.redhat.com/en/openshift-training)
* [OpenShift: Interactive Learning Portal](https://learn.openshift.com/)
* [Red Hat Certified Specialist in OpenShift Administration](https://www.redhat.com/en/services/certification/rhcs-paas)
* [Red Hat OpenShift Operator Certification](https://www.openshift.com/blog/red-hat-openshift-operator-certification)
* [Kubernetes and OpenShift: Community, Standards and Certifications](https://www.openshift.com/blog/kubernetes-and-openshift-community-standards-and-certifications)
* [OpenShift Courses | Udemy](https://www.udemy.com/topic/openshift/)
* [OpenShift - Deploying Applications course | Coursera](https://www.coursera.org/lecture/ibm-cloud-essentials/openshift-499y0)
* [Introduction to Containers w/ Docker, Kubernetes & OpenShift course | Coursera](https://www.coursera.org/learn/ibm-containers-docker-kubernetes-openshift)
* [Fundamentals of Containers, Kubernetes, and Red Hat OpenShift | edX](https://www.edx.org/course/fundamentals-of-containers-kubernetes-and-red-hat)
### Books
[Back to the Top](#table-of-contents)
* [OpenShift for Developers, Second Edition by Joshua Wood & Brian Tannous ](https://developers.redhat.com/e-books/openshift-for-developers)
* [Introducing Istio Service Mesh for Microservices by Burr Sutter and Christian Posta](https://developers.redhat.com/e-books/introducing-istio-service-mesh-microservices-old)
* [DevOps with OpenShift by Stefano Picozzi, Mike Hepburn & Noel O'Connor](https://developers.redhat.com/topics/devops)
* [Microservices for Java Developers: A Hands-on Introduction to Frameworks and Containers by Rafael Benevides](https://developers.redhat.com/e-books/microservices-java-developers-hands-introduction-frameworks-and-containers-old)
* [Migrating to Microservice Databases: From Relational Monolith to Distributed Data by Edson Yanaga](https://developers.redhat.com/e-books/migrating-microservice-databases-relational-monolith-distributed-data-old)
* [OpenShift 3 for Developers: A Guide for Impatient Beginners by Grant Shipley, Graham Dumpleton](https://developers.redhat.com/e-books/openshift-developers-guide-impatient-beginners-old)
* [Using the IBM Block Storage CSI Driver in a Red Hat OpenShift Environment](https://www.redbooks.ibm.com/abstracts/redp5613.html)
* [Storage Multi-tenancy for Red Hat OpenShift Container Platform with IBM Storage](https://www.redbooks.ibm.com/abstracts/redp5638.html)
* [An Implementation of Red Hat OpenShift Network Isolation Using Multiple Ingress Controllers](https://www.redbooks.ibm.com/abstracts/redp5641.html)
* [IBM Spectrum Scale as a Persistent Storage for Red Hat OpenShift on IBM Z Quick Installation Guide](https://www.redbooks.ibm.com/abstracts/redp5645.html)
* [Innovate at Scale and Deploy with Confidence in a Hybrid Cloud Environment](https://www.redbooks.ibm.com/abstracts/redp5621.html)
### Source-to-Image (S2I) images for programming/buildng your Apps
[Back to the Top](#table-of-contents)
#### Java
* [Java - Source-to-Image (S2I) Builder Images for OpenShift](https://docs.openshift.com/online/pro/using_images/s2i_images/java.html).
#### Python
* [Python - Source-to-Image (S2I) Builder Images for OpenShift](https://docs.openshift.com/online/pro/using_images/s2i_images/python.html).
#### Golang
* [Golang- Source-to-Image (S2I) Builder Images for OpenShift](https://github.com/sclorg/golang-container).
#### Ruby
* [Ruby - Source-to-Image (S2I) Builder Images for OpenShift](https://docs.openshift.com/online/pro/using_images/s2i_images/ruby.html).
#### .NET Core
* [.NET Core - Source-to-Image (S2I) Builder Images for OpenShift(https://docs.openshift.com/online/pro/using_images/s2i_images/dot_net_core.html).
#### Node.js
* [Node.js - Source-to-Image (S2I) Builder Images for OpenShift](https://docs.openshift.com/online/pro/using_images/s2i_images/nodejs.html).
#### Perl
* [Perl - Source-to-Image (S2I) Builder Images for OpenShift](https://docs.openshift.com/online/pro/using_images/s2i_images/perl.html).
#### PHP
* [PHP - Source-to-Image (S2I) Builder Images for OpenShift](https://docs.openshift.com/online/pro/using_images/s2i_images/php.html).
### Builder Images for setting up Databases
[Back to the Top](#table-of-contents)
#### MySQL
* [MySQL - Database Images for OpenShift](https://docs.openshift.com/online/pro/using_images/db_images/mysql.html)
#### PostgreSQL
* [PostgreSQL - Database Images for OpenShift](https://docs.openshift.com/online/pro/using_images/db_images/postgresql.html)
#### MongoDB
* [MongoDB - Database Images for OpenShift](https://docs.openshift.com/online/pro/using_images/db_images/mongodb.html)
#### MariaDB
* [MariaDB - Database Images for OpenShift](https://docs.openshift.com/online/pro/using_images/db_images/mariadb.html)
#### Redis
* [Redis - Database Images for OpenShift](https://github.com/sclorg/redis-container)
### Setting up on Microsoft Azure
[Back to the Top](#table-of-contents)
[Microsoft Azure Red Hat OpenShift](https://learn.microsoft.com/en-us/azure/openshift/) is a fully managed offering of OpenShift running in Azure. This service is jointly managed and supported by [Microsoft](https://www.microsoft.com) and [Red Hat](https://redhat.com/).
**Requirements:**
* [Azure CLI](https://learn.microsoft.com/en-us/cli/azure/) version 2.6.0 or later.
* **56 vCPUs**, so you must increase the account limit.
By default, each cluster creates the following instances:
* One bootstrap machine, which is removed after installation
* Three control plane machines
* Three compute machines
Because the bootstrap, control plane, and worker machines use ```Standard_DS4_v2``` virtual machines, which use **8 vCPUs**, a default cluster requires **56 vCPUs**. The bootstrap node VM is used only during installation. To deploy more worker nodes, enable autoscaling, deploy large workloads, or use a different instance type, you must further increase the vCPU limit for your account to ensure that your cluster can deploy the machines that you require.
* **1 VNet.** Each default cluster requires one Virtual Network (VNet), which contains two subnets.
* **7 Network interfaces.** Each default cluster requires seven network interfaces. If you create more machines or your deployed workloads create load balancers, your cluster uses more network interfaces.
* **2 Network security groups.** Each cluster creates network security groups for each subnet in the VNet. The default cluster creates network security groups for the control plane and for the compute node subnets:
controlplane
* Allows the control plane machines to be reached on port 6443 from anywhere.
node
* Allows worker nodes to be reached from the internet on ports 80 and 443.
* **3 Network load balancers.** Each cluster creates the following load balancers:
default
* Public IP address that load balances requests to ports 80 and 443 across worker machines
internal
* Private IP address that load balances requests to ports 6443 and 22623 across control plane machines
external
* Public IP address that load balances requests to port 6443 across control plane machines
* **Note:** If your applications create more Kubernetes LoadBalancer service objects, your cluster uses more load balancers.
* **2 Public IP addresses.** The public load balancer uses a public IP address. The bootstrap machine also uses a public IP address so that you can SSH into the machine to troubleshoot issues during installation. The IP address for the bootstrap node is used only during installation.
* **7 Private IP addresses.** The internal load balancer, each of the three control plane machines, and each of the three worker machines each use a private IP address.
Ingress traffic to an Azure Red Hat OpenShift cluster. Image Credit: [Red Hat](https://www.redhat.com/en/blog/how-deploy-azure-red-hat-openshift)
Egress traffic from an Azure Red Hat OpenShift cluster and connection to the cluster. Image Credit: [Red Hat](https://www.redhat.com/en/blog/how-deploy-azure-red-hat-openshift)
#### Register the Resource Providers
* [Member and guest users.](https://learn.microsoft.com/en-us/azure/active-directory/fundamentals/users-default-permissions#member-and-guest-users)
* [Assign administrator and non-administrator roles to users with Azure Active Director.](https://learn.microsoft.com/en-us/azure/active-directory/fundamentals/active-directory-users-assign-role-azure-portal)
**If you have multiple Azure subscriptions, specify the relevant subscription ID:**
```az account set --subscription ```
**Register the Microsoft.RedHatOpenShift resource provider:**
```az provider register -n Microsoft.RedHatOpenShift --wait```
**Register the Microsoft.Compute resource provider:**
```az provider register -n Microsoft.Compute --wait```
**Register the Microsoft.Storage resource provider:**
```az provider register -n Microsoft.Storage --wait```
**Register the Microsoft.Authorization resource provider:**
```az provider register -n Microsoft.Authorization --wait```
**Create a Resource Group:**
```
az group create \
--name $RESOURCEGROUP \
--location $LOCATION
```
**Creating a Virtual Network:**
```
az network vnet create \
--resource-group $RESOURCEGROUP \
--name aro-vnet \
--address-prefixes 10.0.0.0/22
```
**Adding empty subnet for the master nodes.**
```
az network vnet subnet create \
--resource-group $RESOURCEGROUP \
--vnet-name aro-vnet \
--name master-subnet \
--address-prefixes 10.0.0.0/23 \
--service-endpoints Microsoft.ContainerRegistry
```
**Adding empty subnet for the worker nodes.**
```
az network vnet subnet create \
--resource-group $RESOURCEGROUP \
--vnet-name aro-vnet \
--name worker-subnet \
--address-prefixes 10.0.2.0/23 \
--service-endpoints Microsoft.ContainerRegistry
```
**[Disable subnet private endpoint policies](https://learn.microsoft.com/en-us/azure/private-link/disable-private-link-service-network-policy) on the master subnet.**
```
az network vnet subnet update \
--name master-subnet \
--resource-group $RESOURCEGROUP \
--vnet-name aro-vnet \
--disable-private-link-service-network-policies true
```
**Creating a Cluster**
```
az aro create \
--resource-group $RESOURCEGROUP \
--name $CLUSTER \
--vnet aro-vnet \
--master-subnet master-subnet \
--worker-subnet worker-subnet
```
### Setting up on Google Cloud (GCP)
[Back to the Top](#table-of-contents)
#### Minimum Requirements:
* [gcloud CLI](https://cloud.google.com/sdk/gcloud/) or [OpenShift CLI (oc)](https://access.redhat.com/downloads/content/290).
**Master Nodes:**
* Minimum 4 vCPU (additional are strongly recommended).
* Minimum 16 GB RAM (additional memory is strongly recommended, especially if etcd is co-located on masters).
* Minimum 40 GB hard disk space for the file system .
**Worker Nodes:**
* 1 vCPU.
* Minimum 8 GB RAM.
* Minimum 15 GB hard disk space for the file system.
* If you don’t have a GCP account already, [sign-up for Cloud Platform](https://cloud.google.com/free-trial/), setup billing and activate APIs.
* Setup a service account. A service account is a way to interact with your GCP resources by using a different identity than your primary login and is generally intended for server-to-server interaction. From the GCP Navigation Menu, click on **"Permissions."**
* Click on **"Service accounts."**
Click on **"Create service account,"** which will prompt you to enter a [service account](https://developers.google.com/identity/protocols/OAuth2ServiceAccount#overview) name. Provide a name for your project and click on **"Furnish a new private key."** The default **"JSON"** Key type should be left selected.
Once you click **"Create,"** a service account **“.json”** will be downloaded to your browser’s downloads location.
* **Important:** Like any credential, this represents an access mechanism to authenticate and use resources in your GCP account. Never place this file in a publicly accessible source repo (Public GitHub or GitLab).
using the JSON credential via a Kubernetes secret deployed to your OpenShift cluster. To do so, first perform a base64 encoding of your JSON credential file:
``` base64 -i ~/path/to/downloads/credentials.json```
Keep the output (a very long string) ready for use in the next step, where you’ll replace ```‘BASE64_CREDENTIAL_STRING’``` in the pod example (below) with the output just captured from base64 encoding.
* **Note:** base64 is encoded (not encrypted) and can be readily reversed, so this file (with the base64 string) is just as confidential as the credential file above.
Create the [Kubernetes secret](http://kubernetes.io/docs/user-guide/secrets/) inside your OpenShift Cluster. A secret is the proper place to make sensitive information available to pods running in your cluster (like passwords or the credentials downloaded in the previous step).
```
apiVersion: v1
kind: Secret
metadata:
name: google-services-secret
type: Opaque
data:
google-services.json: BASE64_CREDENTIAL_STRING
```
**Note:** Replace ```‘BASE64_CREDENTIAL_STRING’``` with the base64 output from the prior step.
**Deploy the secret to the cluster:**
```oc create -f google-secret.yaml```
### Setting up Red Hat OpenShift Data Science
[Back to the Top](#table-of-contents)
[Red Hat® OpenShift® Data Science](https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-data-science) is a fully managed cloud service for data scientists and developers of intelligent applications on [Red Hat OpenShift Dedicated](https://cloud.redhat.com/products/dedicated/) or [Red Hat OpenShift Service on AWS](https://cloud.redhat.com/products/amazon-openshift). It provides a fully supported sandbox in which to rapidly develop, train, and test machine learning (ML) models in the public cloud before deploying in production.
* [Red Hat OpenShift Data Science learning tutorials](https://developers.redhat.com/learn/openshift-data-science)
Installing Red Hat OpenShift Data Science
Opening Red Hat OpenShift Data Science
JuypterHub on Red Hat OpenShift Data Science
Exploring Tools on Red Hat OpenShift Data Science
Setting up JupyterHub Notebook Server
Creating a new Python 3 Notebook
Python 3 JupyterHub Notebook
JupyterHub Notebook Sample Demo
OpenShift Project Models
How OpenShift integrates with JupyterHub using Python - Source-to-Image (S2I)
### Red Hat CodeReady Containers (CRC)
[Back to the Top](#table-of-contents)
[Red Hat CodeReady Containers (CRC)](https://developers.redhat.com/content-gateway/rest/mirror/pub/openshift-v4/clients/crc/2.9.0) is a tool that provides a minimal, preconfigured OpenShift 4 cluster on a laptop or desktop machine for development and testing purposes. CRC is delivered as a platform inside of the VM.
* **odo (OpenShift Do)**, a CLI tool for developers, to manage application components on the OpenShift Container Platform.
**System Requirements:**
* **OS:** CentOS Stream 8/RHEL 8/Fedora or later (the latest 2 releases).
* **Download:** [pull-secret](https://cloud.redhat.com/openshift/install/crc/installer-provisioned?intcmp=701f20000012ngPAAQ)
* **Login:** [Red Hat account](https://access.redhat.com/login)
**Other physical requirements include:**
* Four virtual CPUs (**4 vCPUs**)
* 10GB of memory (**RAM**)
* 40GB of storage space
**To set up CodeReady Containers, start by creating the ```crc``` directory, and then download and extract the ```crc``` package:**
```mkdir /home//crc```
```wget https://mirror.openshift.com/pub/openshift-v4/clients/crc/latest/crc-linux-amd64.tar.xz```
```tar -xvf crc-linux-amd64.tar.xz```
**Next, move the files to the crc directory and remove the downloaded package(s):**
```mv /home//crc-linux--amd64/* /home//crc```
```rm /home//crc-linux-amd64.tar.xz```
```rm -r /home//crc-linux--amd64```
**Change to the ```crc``` directory, make ```crc``` executable, and export your ```PATH``` like this:**
```cd /home//crc```
```chmod +x crc```
```export PATH=$PATH:/home//crc```
**Set up and start the cluster:**
```crc setup```
```crc start -p //pull-secret.txt```
**Set up the OC environment:**
```crc oc-env```
```eval $(crc oc-env)```
**Log in as the developer user:**
```oc login -u developer -p developer https://api.crc.testing:6443```
```oc logout```
**And then, log in as the platform’s admin:**
```oc login -u kubeadmin -p password https://api.crc.testing:6443```
```oc logout```
#### Interacting with the cluster. The most common ways include:
**Starting the graphical web console:**
```crc console```
**Display the cluster’s status:**
```crc status```
**Shut down the OpenShift cluster:**
```crc stop```
**Delete or kill the OpenShift cluster:**
```crc delete```
### Setting up Podman
[Back to the Top](#table-of-contents)
[Podman (the POD manager)](https://podman.io/) is an open source tool for developing, managing, and running containers on your Linux systems. It also manages the entire container ecosystem using the libpod library. Podman’s daemonless and inclusive architecture makes it a more secure and accessible option for container management, and its accompanying tools and features, such as [Buildah](https://www.redhat.com/en/topics/containers/what-is-buildah) and [Skopeo](https://www.redhat.com/en/topics/containers/what-is-skopeo), allow developers to customize their container environments to best suit their needs.
* [Libpod](https://pkg.go.dev/github.com/containers/podman/libpod) provides a library for applications looking to use the Container Pod concept made popular by Kubernetes.
**Installing Podman:**
* Fedora: ```sudo dnf install podman```
* CentOS Stream: ```sudo dnf install buildah```
* Ubuntu 20.04 or later: ```sudo apt install podman```
* Debian 11 (bullseye) or later, or sid/unstable: ```sudo apt install podman```
* openSUSE: ```sudo zypper install podman```
* ArchLinux: ```sudo pacman -S podman``` and then tweaks for rootless
[Podman Desktop](https://github.com/containers/podman-desktop) is a tool to manage Podman and other container engines from a single UI and tray local environment.
Podman Desktop
Podman
### Setting up Buildah
[Back to the Top](#table-of-contents)
[Buildah](https://buildah.io/) is an open source, Linux-based tool that can build Docker- and Kubernetes-compatible images, and is easy to incorporate into scripts and build pipelines. In addition, Buildah has overlap functionality with [Podman](https://podman.io/), [Skopeo](https://github.com/containers/skopeo), and [CRI-O](https://cri-o.io/).
* Fedora: ```sudo dnf -y install buildah```
* CentOS Stream: ```sudo dnf -y install buildah```
* Ubuntu 20.04 or later: ```sudo apt install buildah```
* Debian 11 (bullseye) or later, or sid/unstable: ```sudo apt install -y buildah```
* openSUSE: ```sudo zypper install buildah```
* ArchLinux: ```sudo pacman -S buildah``` and then tweaks for rootless
Buildah
### Setting up Skopeo
[Back to the Top](#table-of-contents)
[Skopeo](https://github.com/containers/skopeo) is a tool for manipulating, inspecting, signing, and transferring container images and image repositories on Linux systems, Windows and MacOS. In addition, Skopeo has overlap functionality with [Podman](https://podman.io/), [Buildah](https://buildah.io/), and [CRI-O](https://cri-o.io/).
**Installing Skopeo:**
* Fedora: ```sudo dnf install skopeo```
* CentOS Stream: ```sudo dnf -y install skopeo```
* Ubuntu 20.04 or later: ```sudo apt install skopeo```
* Debian 11 (bullseye) or later, or sid/unstable: ```sudo apt install skopeo```
* openSUSE: ```sudo zypper install skopeo```
* Alpine Linux: ```sudo apk add skopeo```
* ArchLinux: ```sudo pacman -S skopeo``` and then tweaks for rootless
* Nix/NixOS: ```$ nix-env -i skopeo```
* MacOS: ```brew install skopeo```
**Skopeo Usage:**
```
$ skopeo --help
Various operations with container images and container image registries
Usage:
skopeo [command]
Available Commands:
copy Copy an IMAGE-NAME from one location to another
delete Delete image IMAGE-NAME
help Help about any command
inspect Inspect image IMAGE-NAME
list-tags List tags in the transport/repository specified by the REPOSITORY-NAME
login Login to a container registry
logout Logout of a container registry
manifest-digest Compute a manifest digest of a file
standalone-sign Create a signature using local files
standalone-verify Verify a signature using local files
sync Synchronize one or more images from one location to another
```
### File systems
[Back to the Top](#table-of-contents)
[CIFS (Common Internet File System)](https://cifs.com/) is a network filesystem protocol used for providing shared access to files and printers between machines on the network. The client application can read, write, edit and even remove files on the remote server.
[Network File System (NFS)](https://learn.microsoft.com/en-us/windows-server/storage/nfs/nfs-overview) is a protocol that provides a file sharing solution for enterprises that have heterogeneous environments that include both Windows and non-Windows computers. It's most notable for its host authentication, it’s simple to setup, and makes it possible to connect to another service using an IP address only.
**Additional benefits of NFS file share include:**
* NFS provides a central management.
* NFS allows for a user to log into any server and have access to their files transparently.
* It’s been around for a long time, so it comes with familiarity in terms of applications.
* No manual refresh needed for new files.
* It Can be secured with firewalls and Kerberos.
[GlusterFS](https://www.gluster.org/) is a free and open source scalable network filesystem. Gluster is a scalable network filesystem. Using common off-the-shelf hardware, you can create large, distributed storage solutions for media streaming, data analysis, and other data- and bandwidth-intensive tasks.
[Ceph](https://ceph.io/) is a software-defined storage solution designed to address the object, block, and file storage needs of data centers adopting open source as the new norm for high-growth block storage, object stores and data lakes. Ceph provides enterprise scalable storage while keeping [CAPEX](https://corporatefinanceinstitute.com/resources/knowledge/modeling/how-to-calculate-capex-formula/) and [OPEX](https://www.investopedia.com/terms/o/operating_expense.asp) costs in line with underlying bulk commodity disk prices.
[Hadoop Distributed File System (HDFS)](https://www.ibm.com/analytics/hadoop/hdfs) is a distributed file system that handles large data sets running on commodity hardware. It is used to scale a single Apache Hadoop cluster to hundreds (and even thousands) of nodes. HDFS is one of the major components of Apache Hadoop, the others being [MapReduce](https://www.ibm.com/analytics/hadoop/mapreduce) and [YARN](https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html).
[ZFS](https://docs.oracle.com/cd/E19253-01/819-5461/zfsover-2/) is an enterprise-ready open source file system and volume manager with unprecedented flexibility and an uncompromising commitment to data integrity.
[OpenZFS](https://openzfs.org/wiki/Main_Page ) is an open-source storage platform. It includes the functionality of both traditional file systems and volume manager. It has many advanced features including:
- Protection against data corruption.
- Integrity checking for both data and metadata.
- Continuous integrity verification and automatic "self-healing" repair.
[Btrfs](https://btrfs.wiki.kernel.org/index.php/Main_Page) is a modern copy on write (CoW) filesystem for Linux aimed at implementing advanced features while also focusing on fault tolerance, repair and easy administration. Its main features and benefits are:
* Snapshots which do not make the full copy of files
* RAID - support for software-based RAID 0, RAID 1, RAID 10
* Self-healing - checksums for data and metadata, automatic detection of silent data corruptions
[Bcachefs](https://bcachefs.org/) is an advanced new filesystem for Linux, with an emphasis on reliability and robustness and the complete set of features one would expect from a modern filesystem. Scalability has been tested to 50+ TB, will eventually scale far higher.
[Ext4](https://ext4.wiki.kernel.org/index.php/Ext4_Howto) is a journaling file system for Linux, developed as the successor to ext3
[Squashfs](https://www.kernel.org/doc/html/latest/filesystems/squashfs.html) is a compressed read-only filesystem for Linux. It uses zlib, lz4, lzo, or xz compression to compress files, inodes and directories. Inodes in the system are very small and all blocks are packed to minimize data overhead.
[NTFS(New Technology File System)](https://docs.microsoft.com/en-us/windows-server/storage/file-server/ntfs-overview) is the primary file system for recent versions of Windows and Windows Server—provides a full set of features including security descriptors, encryption, disk quotas, and rich metadata, and can be used with Cluster Shared Volumes (CSV) to provide continuously available volumes that can be accessed simultaneously from multiple nodes of a failover cluster.
## OpenShift Tools
[Back to the Top](#table-of-contents)
[OpenShift CLI (oc)](https://docs.openshift.com/container-platform/4.4/cli_reference/openshift_cli/getting-started-cli.html) is a command line interface tool that extends the capabilities of kubectl with [many convenience functions](https://docs.openshift.com/container-platform/4.4/cli_reference/openshift_cli/usage-oc-kubectl.html) that make interacting with both Kubernetes and OpenShift clusters easier.
[OpenShift Serverless CLI (kn)](https://docs.openshift.com/container-platform/4.4/serverless/serverless-getting-started.html) is a command line interface tool to deploy serverless applications, then you’ll want access and control via the kn command.
[OpenShift Pipelines CLI (tkn)](https://docs.openshift.com/container-platform/4.4/pipelines/understanding-openshift-pipelines.html) is a command line interface tool for using Tekton to provide cloud-native CI/CD functionality within the cluster. The tkn command is used to manage the functionality from the CLI.
[Red Hat CodeReady Containers](https://developers.redhat.com/products/codeready-containers) is an option to host a local, all-in-one OpenShift 4 cluster on your workstation. CodeReady Containers replaces [minishift](https://www.okd.io/minishift/), used to run OpenShift 3 clusters on your workstation, as a quick and easy method of creating test and development clusters.
[Helm CLI](https://docs.openshift.com/container-platform/4.4/cli_reference/helm_cli/getting-started-with-helm-on-openshift-container-platform.html) is a command line interface tool for deploying and managing Kubernetes applications to your clusters.
[OpenShift Hive](https://github.com/openshift/hive) is an operator which runs as a service on top of Kubernetes/OpenShift. The Hive service can be used to provision and perform initial configuration of OpenShift 4 clusters.
[OpenShift Service Mesh](https://www.openshift.com/blog/introducing-openshift-service-mesh-2.0) is a tool that provides a layer on top of OpenShift for securely connecting services in a consistent manner. This provides centralized control, security and observability across your services without having to modify your applications.
[Azure Red Hat OpenShift](https://azure.microsoft.com/en-us/services/openshift/) is a flexible, self-service deployment of fully managed OpenShift clusters. Maintain regulatory compliance and focus on your application development, while your master, infrastructure, and application nodes are patched, updated, and monitored by both Microsoft and Red Hat.
[Red Hat OpenShift Service on AWS (ROSA)](https://www.openshift.com/products/amazon-openshift) is a fully-managed and jointly supported Red Hat OpenShift offering that combines the power of Red Hat OpenShift, the industry's most comprehensive enterprise Kubernetes platform, and the AWS public cloud.
[Red Hat OpenShift on Google Cloud](https://cloud.google.com/solutions/partners/openshift-on-gcp) is a fully-managed and jointly supported Red Hat OpenShift offering that enables you to deploy stateful and stateless apps with nearly any language, framework, database, or service. It gives you a hosted environment entirely on Google Cloud. A hybrid environment where you maintain part of your workload on-premises or in a private hosting environment and migrate the rest to Google Cloud.
[Red Hat® Quay](https://www.openshift.com/products/quay) is a secure, private container registry that builds, analyzes and distributes container images. It provides a high level of automation and customization.
[Kata Operator](https://github.com/openshift/kata-operator) is an operator to perform lifecycle management (install/upgrade/uninstall) of [Kata Runtime](https://katacontainers.io/) on Openshift as well as Kubernetes cluster.
[Open Container Initiative](https://opencontainers.org/about/overview/) is an open governance structure for the express purpose of creating open industry standards around container formats and runtimes.
[Buildah](https://buildah.io/) is a command line tool to build Open Container Initiative (OCI) images. It can be used with Docker, Podman, Kubernetes.
[Podman](https://podman.io/) is a daemonless, open source, Linux native tool designed to make it easy to find, run, build, share and deploy applications using Open Containers Initiative (OCI) Containers and Container Images. Podman provides a command line interface (CLI) familiar to anyone who has used the Docker Container Engine.
[Containerd](https://containerd.io)is a daemon that manages the complete container lifecycle of its host system, from image transfer and storage to container execution and supervision to low-level storage to network attachments and beyond. It is available for Linux and Windows.
[OKD](https://okd.io/) is a community distribution of Kubernetes optimized for continuous application development and multi-tenant deployment. OKD adds developer and operations-centric tools on top of Kubernetes to enable rapid application development, easy deployment and scaling, and long-term lifecycle maintenance for small and large teams.
# Go Development
[Back to the Top](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#table-of-contents)
## Go Learning Resources
[Go](https://golang.org/) is an open source programming language that makes it easy to build simple, reliable, and efficient software.
[Golang Contribution Guide](https://golang.org/doc/contribute.html)
[Google Developers Training](https://developers.google.com/training/)
[Google Developers Certification](https://developers.google.com/certification/)
[Uber's Go Style Guide](https://github.com/uber-go/guide/blob/master/style.md)
[GitLab's Go standards and style guidelines](https://docs.gitlab.com/ee/development/go_guide/)
[Effective Go](https://golang.org/doc/effective_go.html)
[Go: The Complete Developer's Guide (Golang) on Udemy](https://www.udemy.com/course/go-the-complete-developers-guide/)
[Getting Started with Go on Coursera](https://www.coursera.org/learn/golang-getting-started)
[Programming with Google Go on Coursera](https://www.coursera.org/specializations/google-golang)
[Learning Go Fundamentals on Pluralsight](https://www.pluralsight.com/courses/go-fundamentals)
[Learning Go on Codecademy](https://www.codecademy.com/learn/learn-go)
## Go Tools
[golang tools](https://pkg.go.dev/golang.org/x/tools) holds the source for various packages and tools that support the Go programming language.
[Go in Visual Studio Code](https://code.visualstudio.com/docs/languages/go) is an extension that gives you language features like IntelliSense, code navigation, symbol search, bracket matching, snippets, and many more that will help you in Golang development.
[Traefik](https://github.com/traefik/traefik) is a modern HTTP reverse proxy and load balancer that makes deploying microservices easy. Traefik integrates with your existing infrastructure components (Docker, Swarm mode, Kubernetes, Marathon, Consul, Etcd, Rancher, Amazon ECS, etc.) and configures itself automatically and dynamically. Pointing Traefik at your orchestrator should be the only configuration step you need.
[Gitea](https://github.com/go-gitea/gitea) is Git with a cup of tea, painless self-hosted git service. Using Go, this can be done with an independent binary distribution across all platforms which Go supports, including Linux, macOS, and Windows on x86, amd64, ARM and PowerPC architectures.
[OpenFaaS](https://github.com/openfaas/faas) is Serverless Functions Made Simple. It makes it easy for developers to deploy event-driven functions and microservices to Kubernetes without repetitive, boiler-plate coding. Package your code or an existing binary in a Docker image to get a highly scalable endpoint with auto-scaling and metrics.
[micro](https://github.com/zyedidia/micro) is a terminal-based text editor that aims to be easy to use and intuitive, while also taking advantage of the capabilities of modern terminals. As its name indicates, micro aims to be somewhat of a successor to the nano editor by being easy to install and use. It strives to be enjoyable as a full-time editor for people who prefer to work in a terminal, or those who regularly edit files over SSH.
[Gravitational Teleport](https://github.com/gravitational/teleport) is a modern security gateway for remotely accessing into Clusters of Linux servers via SSH or SSH-over-HTTPS in a browser or Kubernetes clusters.
[NATS](https://nats.io/) is a simple, secure and performant communications system for digital systems, services and devices. NATS is part of the Cloud Native Computing Foundation (CNCF). NATS has over 30 client language implementations, and its server can run on-premise, in the cloud, at the edge, and even on a Raspberry Pi. NATS can secure and simplify design and operation of modern distributed systems.
[Act](https://github.com/nektos/act) is a GO program that allows you to run our GitHub Actions locally.
[Fiber](https://gofiber.io/) is an [Express](https://github.com/expressjs/express) inspired web framework built on top of [Fasthttp](https://github.com/valyala/fasthttp), the fastest HTTP engine for Go. Designed to ease things up for fast development with zero memory allocation and performance in mind.
[Glide](https://github.com/Masterminds/glide) is a vendor Package Management for Golang.
[BadgerDB](https://github.com/dgraph-io/badger) is an embeddable, persistent and fast key-value (KV) database written in pure Go. It is the underlying database for [Dgraph](https://dgraph.io/), a fast, distributed graph database. It's meant to be a performant alternative to non-Go-based key-value stores like RocksDB.
[Go kit](https://github.com/go-kit/kit) is a programming toolkit for building microservices (or elegant monoliths) in Go. We solve common problems in distributed systems and application architecture so you can focus on delivering business value.
[Codis](https://github.com/CodisLabs/codis) is a proxy based high performance Redis cluster solution written in Go.
[zap](https://github.com/uber-go/zap) is a blazing fast, structured, leveled logging in Go.
[HttpRouter](https://github.com/julienschmidt/httprouter) is a lightweight high performance HTTP request router (also called multiplexer or just mux for short) for Go.
[Gorilla WebSocket](https://github.com/gorilla/websocket) is a Go implementation of the WebSocket protocol.
[Delve](https://github.com/go-delve/delve) is a debugger for the Go programming language.
[GORM](https://github.com/go-gorm/gorm) is a fantastic ORM library for Golang, aims to be developer friendly.
[Go Patterns](https://github.com/tmrts/go-patterns) is a curated collection of idiomatic design & application patterns for Go language.
# Python Development
[Back to the Top](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#table-of-contents)
## Python Learning Resources
[Python](https://www.python.org) is an interpreted, high-level programming language. Python is used heavily in the fields of Data Science and Machine Learning.
[Python Developer’s Guide](https://devguide.python.org) is a comprehensive resource for contributing to Python – for both new and experienced contributors. It is maintained by the same community that maintains Python.
[Get started with Kubernetes using Python](https://kubernetes.io/blog/2019/07/23/get-started-with-kubernetes-using-python/)
[Data Science with Python & JupyterHub on Kubernetes](https://tanzu.vmware.com/developer/blog/data-science-with-python-jupyterhub-on-kubernetes-part-1/)
[Azure Functions Python developer guide](https://docs.microsoft.com/en-us/azure/azure-functions/functions-reference-python) is an introduction to developing Azure Functions using Python. The content below assumes that you've already read the [Azure Functions developers guide](https://docs.microsoft.com/en-us/azure/azure-functions/functions-reference).
[CheckiO](https://checkio.org/) is a programming learning platform and a gamified website that teaches Python through solving code challenges and competing for the most elegant and creative solutions.
[Python Institute](https://pythoninstitute.org)
[PCEP – Certified Entry-Level Python Programmer certification](https://pythoninstitute.org/pcep-certification-entry-level/)
[PCAP – Certified Associate in Python Programming certification](https://pythoninstitute.org/pcap-certification-associate/)
[PCPP – Certified Professional in Python Programming 1 certification](https://pythoninstitute.org/pcpp-certification-professional/)
[PCPP – Certified Professional in Python Programming 2](https://pythoninstitute.org/pcpp-certification-professional/)
[MTA: Introduction to Programming Using Python Certification](https://docs.microsoft.com/en-us/learn/certifications/mta-introduction-to-programming-using-python)
[Getting Started with Python in Visual Studio Code](https://code.visualstudio.com/docs/python/python-tutorial)
[Google's Python Style Guide](https://google.github.io/styleguide/pyguide.html)
[Google's Python Education Class](https://developers.google.com/edu/python/)
[Real Python](https://realpython.com)
[The Python Open Source Computer Science Degree by Forrest Knight](https://github.com/ForrestKnight/open-source-cs-python)
[Intro to Python for Data Science](https://www.datacamp.com/courses/intro-to-python-for-data-science)
[Intro to Python by W3schools](https://www.w3schools.com/python/python_intro.asp)
[Codecademy's Python 3 course](https://www.codecademy.com/learn/learn-python-3)
[Learn Python with Online Courses and Classes from edX](https://www.edx.org/learn/python)
[Python Courses Online from Coursera](https://www.coursera.org/courses?query=python)
## Python Frameworks and Tools
[Python Package Index (PyPI)](https://pypi.org/) is a repository of software for the Python programming language. PyPI helps you find and install software developed and shared by the Python community.
[PyCharm](https://www.jetbrains.com/pycharm/) is the best IDE I've ever used. With PyCharm, you can access the command line, connect to a database, create a virtual environment, and manage your version control system all in one place, saving time by avoiding constantly switching between windows.
[Python Tools for Visual Studio(PTVS)](https://microsoft.github.io/PTVS/) is a free, open source plugin that turns Visual Studio into a Python IDE. It supports editing, browsing, IntelliSense, mixed Python/C++ debugging, remote Linux/MacOS debugging, profiling, IPython, and web development with Django and other frameworks.
[Pylance](https://github.com/microsoft/pylance-release) is an extension that works alongside Python in Visual Studio Code to provide performant language support. Under the hood, Pylance is powered by Pyright, Microsoft's static type checking tool.
[Pyright](https://github.com/Microsoft/pyright) is a fast type checker meant for large Python source bases. It can run in a “watch” mode and performs fast incremental updates when files are modified.
[Django](https://www.djangoproject.com/) is a high-level Python Web framework that encourages rapid development and clean, pragmatic design.
[Flask](https://flask.palletsprojects.com/) is a micro web framework written in Python. It is classified as a microframework because it does not require particular tools or libraries.
[Web2py](http://web2py.com/) is an open-source web application framework written in Python allowing allows web developers to program dynamic web content. One web2py instance can run multiple web sites using different databases.
[AWS Chalice](https://github.com/aws/chalice) is a framework for writing serverless apps in python. It allows you to quickly create and deploy applications that use AWS Lambda.
[Tornado](https://www.tornadoweb.org/) is a Python web framework and asynchronous networking library. Tornado uses a non-blocking network I/O, which can scale to tens of thousands of open connections.
[HTTPie](https://github.com/httpie/httpie) is a command line HTTP client that makes CLI interaction with web services as easy as possible. HTTPie is designed for testing, debugging, and generally interacting with APIs & HTTP servers.
[Scrapy](https://scrapy.org/) is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
[Sentry](https://sentry.io/) is a service that helps you monitor and fix crashes in realtime. The server is in Python, but it contains a full API for sending events from any language, in any application.
[Pipenv](https://github.com/pypa/pipenv) is a tool that aims to bring the best of all packaging worlds (bundler, composer, npm, cargo, yarn, etc.) to the Python world.
[Python Fire](https://github.com/google/python-fire) is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
[Bottle](https://github.com/bottlepy/bottle) is a fast, simple and lightweight [WSGI](https://www.wsgi.org/) micro web-framework for Python. It is distributed as a single file module and has no dependencies other than the [Python Standard Library](https://docs.python.org/library/).
[CherryPy](https://cherrypy.org) is a minimalist Python object-oriented HTTP web framework.
[Sanic](https://github.com/huge-success/sanic) is a Python 3.6+ web server and web framework that's written to go fast.
[Pyramid](https://trypyramid.com) is a small and fast open source Python web framework. It makes real-world web application development and deployment more fun and more productive.
[TurboGears](https://turbogears.org) is a hybrid web framework able to act both as a Full Stack framework or as a Microframework.
[Falcon](https://falconframework.org/) is a reliable, high-performance Python web framework for building large-scale app backends and microservices with support for MongoDB, Pluggable Applications and autogenerated Admin.
[Neural Network Intelligence(NNI)](https://github.com/microsoft/nni) is an open source AutoML toolkit for automate machine learning lifecycle, including [Feature Engineering](https://github.com/microsoft/nni/blob/master/docs/en_US/FeatureEngineering/Overview.md), [Neural Architecture Search](https://github.com/microsoft/nni/blob/master/docs/en_US/NAS/Overview.md), [Model Compression](https://github.com/microsoft/nni/blob/master/docs/en_US/Compressor/Overview.md) and [Hyperparameter Tuning](https://github.com/microsoft/nni/blob/master/docs/en_US/Tuner/BuiltinTuner.md).
[Dash](https://plotly.com/dash) is a popular Python framework for building ML & data science web apps for Python, R, Julia, and Jupyter.
[Luigi](https://github.com/spotify/luigi) is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built-in.
[Locust](https://github.com/locustio/locust) is an easy to use, scriptable and scalable performance testing tool.
[spaCy](https://github.com/explosion/spaCy) is a library for advanced Natural Language Processing in Python and Cython.
[NumPy](https://www.numpy.org/) is the fundamental package needed for scientific computing with Python.
[Pillow](https://python-pillow.org/) is a friendly PIL(Python Imaging Library) fork.
[IPython](https://ipython.org/) is a command shell for interactive computing in multiple programming languages, originally developed for the Python programming language, that offers enhanced introspection, rich media, additional shell syntax, tab completion, and rich history.
[GraphLab Create](https://turi.com/) is a Python library, backed by a C++ engine, for quickly building large-scale, high-performance machine learning models.
[Pandas](https://pandas.pydata.org/) is a fast, powerful, and easy to use open source data structrures, data analysis and manipulation tool, built on top of the Python programming language.
[PuLP](https://coin-or.github.io/pulp/) is an Linear Programming modeler written in python. PuLP can generate LP files and call on use highly optimized solvers, GLPK, COIN CLP/CBC, CPLEX, and GUROBI, to solve these linear problems.
[Matplotlib](https://matplotlib.org/) is a 2D plotting library for creating static, animated, and interactive visualizations in Python. Matplotlib produces publication-quality figures in a variety of hardcopy formats and interactive environments across platforms.
[Scikit-Learn](https://scikit-learn.org/stable/index.html) is a simple and efficient tool for data mining and data analysis. It is built on NumPy,SciPy, and mathplotlib.
# Bash/PowerShell Development
[Back to the Top](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#table-of-contents)
## Bash/PowerShell Learning Resources
[Introduction to Bash Shell Scripting by Coursera](https://www.coursera.org/projects/introduction-to-bash-shell-scripting)
[Bash: Shell Script Basics by Pluralsight](https://www.pluralsight.com/courses/bash-shell-scripting)
[Bash/Shell by Codecademy](https://www.codecademy.com/catalog/language/bash)
[Getting Started with PowerShell](https://docs.microsoft.com/en-us/powershell/)
[Deploy an Azure Kubernetes Service cluster using PowerShell](https://docs.microsoft.com/en-us/azure/aks/kubernetes-walkthrough-powershell)
[PowerShell in Azure Cloud Shell](https://aka.ms/cloudshell/powershell-docs)
[Azure Functions using PowerShell](https://docs.microsoft.com/en-us/azure/azure-functions/functions-create-first-function-vs-code?pivots=programming-language-powershell)
[Azure Automation runbooks](https://docs.microsoft.com/en-us/azure/automation/automation-runbook-types)
[Using Visual Studio Code for PowerShell Development](https://docs.microsoft.com/en-us/powershell/scripting/dev-cross-plat/vscode/using-vscode?view=powershell-7)
[Integrated Terminal in Visual Studio Code](https://code.visualstudio.com/docs/editor/integrated-terminal)
[AWS Tools for Windows PowerShell](https://aws.amazon.com/powershell/)
[PowerShell Best Practices and Style Guide](https://poshcode.gitbooks.io/powershell-practice-and-style)
[AWS Command Line Interface and aws-shell Sample for AWS Cloud9](https://docs.aws.amazon.com/cloud9/latest/user-guide/sample-aws-cli.html)
[Configuring Cloud Shell on Google Cloud](https://cloud.google.com/shell/docs/configuring-cloud-shell)
[Google's Shell Style Guide](https://google.github.io/styleguide/shellguide.html)
## Bash/ PowerShell Tools
[Bash](https://www.gnu.org/software/bash/) is the GNU Project's shell(Bourne Again SHell), which is an sh-compatible shell that integrates together useful features from the Korn shell (ksh) and the C shell (csh).
[PowerShell Core](https://microsoft.com/PowerShell) is a cross-platform (Windows, Linux, and macOS) automation and configuration tool/framework that works well with your existing tools and is optimized for dealing with structured data (JSON, CSV, XML, etc.), REST APIs, and object models. It also includes a command-line shell, an associated scripting language and a framework for processing cmdlets.
[Azure PowerShell](https://docs.microsoft.com/en-us/powershell/azure/overview) is a set of cmdlets for managing Microsoft Azure resources directly from the PowerShell command line.
[AWS Shell](https://aws.amazon.com/cli/) is a command-line shell program that provides convenience and productivity features to help both new and advanced users of the AWS Command Line Interface.
[Google Cloud Shell](https://cloud.google.com/shell/) is a free admin machine with browser-based command-line access for managing your infrastructure and applications on Google Cloud Platform.
[VS Code Bash Debug](https://marketplace.visualstudio.com/items?itemName=rogalmic.bash-debug) is a bash debugger GUI frontend based on awesome bashdb scripts (bashdb now included in package).
[VS Code Bash IDE](https://marketplace.visualstudio.com/items?itemName=mads-hartmann.bash-ide-vscode) is a Visual Studio Code extension utilizing the [bash language server](https://github.com/bash-lsp/bash-language-server/blob/master/bash-lsp), that is based on [Tree Sitter](https://github.com/tree-sitter/tree-sitter) and its [grammar for Bash](https://github.com/tree-sitter/tree-sitter-bash) and supports [explainshell](https://explainshell.com/) integration.
# Machine Learning
[Back to the Top](https://github.com/mikeroyal/Kubernetes-Guide/blob/main/README.md#table-of-contents)
## ML Learning Resources
[Kubernetes for Machine Learning on Platform9](https://platform9.com/blog/kubernetes-for-machine-learning/)
[Introducing Amazon SageMaker Operators for Kubernetes](https://aws.amazon.com/blogs/machine-learning/introducing-amazon-sagemaker-operators-for-kubernetes/)
[Deploying machine learning models on Kubernetes with Google Cloud](https://cloud.google.com/community/tutorials/kubernetes-ml-ops)
[Create and attach Azure Kuberne