https://github.com/harisekhon/knowledge-base

Large Tech Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, AWS, GCP etc - gradually porting my large private knowledge base to public
https://github.com/harisekhon/knowledge-base
aws azure bash bigdata cicd cloud devops elasticsearch gcp git groovy hadoop java jvm performance-tuning python scripting solr solrcloud spark
Last synced: about 1 month ago
JSON representation
Large Tech Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, AWS, GCP etc - gradually porting my large private knowledge base to public
Host: GitHub
URL: https://github.com/harisekhon/knowledge-base
Owner: HariSekhon
License: mit
Created: 2023-11-22T18:24:24.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2024-10-13T13:51:54.000Z (7 months ago)
Last Synced: 2025-04-05T06:02:49.859Z (about 1 month ago)
Topics: aws, azure, bash, bigdata, cicd, cloud, devops, elasticsearch, gcp, git, groovy, hadoop, java, jvm, performance-tuning, python, scripting, solr, solrcloud, spark
Language: Shell
Homepage:
Size: 95.9 MB
Stars: 161
Watchers: 12
Forks: 24
Open Issues: 1
Metadata Files:
- Readme: README.md
- License: LICENSE
- Security: security-operations-center.md
Awesome Lists containing this project

README

        # Hari Sekhon - Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, Security, AWS, GCP etc

[![GitHub stars](https://img.shields.io/github/stars/HariSekhon/Knowledge-Base?logo=github)](https://github.com/HariSekhon/Knowledge-Base/stargazers)

[![GitHub forks](https://img.shields.io/github/forks/HariSekhon/Knowledge-Base?logo=github)](https://github.com/HariSekhon/Knowledge-Base/network)

[![License](https://img.shields.io/badge/license-MIT-green)](https://github.com/HariSekhon/Knowledge-Base/blob/master/LICENSE)

[![My LinkedIn](https://img.shields.io/badge/LinkedIn%20Profile-HariSekhon-blue?logo=data:image/svg%2bxml;base64,PHN2ZyByb2xlPSJpbWciIGZpbGw9IiNmZmZmZmYiIHZpZXdCb3g9IjAgMCAyNCAyNCIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj48dGl0bGU+TGlua2VkSW48L3RpdGxlPjxwYXRoIGQ9Ik0yMC40NDcgMjAuNDUyaC0zLjU1NHYtNS41NjljMC0xLjMyOC0uMDI3LTMuMDM3LTEuODUyLTMuMDM3LTEuODUzIDAtMi4xMzYgMS40NDUtMi4xMzYgMi45Mzl2NS42NjdIOS4zNTFWOWgzLjQxNHYxLjU2MWguMDQ2Yy40NzctLjkgMS42MzctMS44NSAzLjM3LTEuODUgMy42MDEgMCA0LjI2NyAyLjM3IDQuMjY3IDUuNDU1djYuMjg2ek01LjMzNyA3LjQzM2MtMS4xNDQgMC0yLjA2My0uOTI2LTIuMDYzLTIuMDY1IDAtMS4xMzguOTItMi4wNjMgMi4wNjMtMi4wNjMgMS4xNCAwIDIuMDY0LjkyNSAyLjA2NCAyLjA2MyAwIDEuMTM5LS45MjUgMi4wNjUtMi4wNjQgMi4wNjV6bTEuNzgyIDEzLjAxOUgzLjU1NVY5aDMuNTY0djExLjQ1MnpNMjIuMjI1IDBIMS43NzFDLjc5MiAwIDAgLjc3NCAwIDEuNzI5djIwLjU0MkMwIDIzLjIyNy43OTIgMjQgMS43NzEgMjRoMjAuNDUxQzIzLjIgMjQgMjQgMjMuMjI3IDI0IDIyLjI3MVYxLjcyOUMyNCAuNzc0IDIzLjIgMCAyMi4yMjIgMGguMDAzeiIvPjwvc3ZnPgo=)](https://www.linkedin.com/in/HariSekhon/)

[![GitHub Last Commit](https://img.shields.io/github/last-commit/HariSekhon/Knowledge-Base?logo=github)](https://github.com/HariSekhon/Knowledge-Base/commits/master)

[![CI Builds Overview](https://img.shields.io/badge/CI%20Builds-Overview%20Page-blue?logo=circleci)](https://harisekhon.github.io/CI-CD/)

[![Repo on GitHub](https://img.shields.io/badge/repo-GitHub-2088FF?logo=github)](https://github.com/HariSekhon/Knowledge-Base)

[![Repo on GitLab](https://img.shields.io/badge/repo-GitLab-FCA121?logo=gitlab)](https://gitlab.com/HariSekhon/Knowledge-Base)

[![Repo on Azure DevOps](https://img.shields.io/badge/repo-Azure%20DevOps-0078D7?logo=azure%20devops)](https://dev.azure.com/HariSekhon/GitHub/_git/Knowledge-Base)

[![Repo on BitBucket](https://img.shields.io/badge/repo-BitBucket-0052CC?logo=bitbucket)](https://bitbucket.org/HariSekhon/Knowledge-Base)

[![Index](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/index.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/index.yaml)

[![Markdown](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/markdown.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/markdown.yaml)

[![Markdown References](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/markdown_references.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/markdown_references.yaml)

[![Gist Sync](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/gist-sync.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/gist-sync.yaml)

[![Validation](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/validate.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/validate.yaml)

[![Kics](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/kics.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/kics.yaml)

[![Grype](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/grype.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/grype.yaml)

[![Semgrep](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/semgrep.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/semgrep.yaml)

[![Semgrep Cloud](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/semgrep-cloud.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/semgrep-cloud.yaml)

[![Trivy](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/trivy.yaml/badge.svg)](https://github.com/HariSekhon/Knowledge-Base/actions/workflows/trivy.yaml)

Repo focused on advanced knowledge, tips & tricks, debugging & fixes.

I'm gradually migrating my huge private personal knowledge base into this public repo.

Hit the watch button on the top right for updates.

Some of these pages are still in progress pending porting and populated yet from my private knowledge base pages,

some are stubs pending migration.

Much more advanced knowledge is captured in code and code comments. References to my major

[GitHub Repos](https://github.com/HariSekhon?tab=repositories&q=&type=&language=&sort=stargazers) are provided

throughout where relevant.

References to official docs and some classic books are provided for those who want to thoroughly cover the basics.

## Index

- [GitHub Repos](#github-repos)

- [Systems](#systems)

  - [Operating Systems](#operating-systems)

  - [Core Services - DNS, DHCP, SSH, FTP](#core-services---dns-dhcp-ssh-ftp)

  - [Editors](#editors)

  - [Terminal Multiplexers](#terminal-multiplexers)

- [Architecture & Documentation](#architecture--documentation)

- [Git](#git)

- [Cloud](#cloud)

- [Containerization](#containerization)

  - [Docker](#docker)

  - [Kubernetes](#kubernetes)

    - [Kubernetes Core](#kubernetes-core)

    - [Cloud Hosted Kubernetes](#cloud-hosted-kubernetes)

    - [On-premise Kubernetes](#on-premise-kubernetes)

    - [Local Kubernetes Dev](#local-kubernetes-dev)

    - [Kubernetes Applications & Lifecycle Management](#kubernetes-applications--lifecycle-management)

  - [Container Registries](#container-registries)

  - [Container Security](#container-security)

- [Programming](#programming)

  - [Languages](#languages)

  - [Build Systems](#build-systems)

  - [Artifact Registries](#artifact-registries)

  - [Code Scanning](#code-scanning)

- [Infrastructure-as-Code](#infrastructure-as-code)

- [Configuration Management](#configuration-management)

- [CI/CD](#cicd)

- [Internet Services](#internet-services)

- [Databases / RDBMS](#databases--rdbms)

  - [MPP Databases](#mpp-databases)

  - [Hosted MPP Databases](#hosted-mpp-databases)

  - [Database Management](#database-management)

- [NoSQL](#nosql)

  - [Caching](#caching)

  - [Search](#search)

- [Coordination & Discovery Services](#coordination--discovery-services)

- [Pub / Sub & Message Queues](#pub--sub--message-queues)

- [Data](#data)

  - [Data Formats](#data-formats)

  - [Hadoop Ecosystem](#hadoop-ecosystem)

  - [Data Science & Machine Learning](#data-science--machine-learning)

  - [Time Series Databases](#time-series-databases)

  - [Visualization](#visualization)

- [Security](#security)

- [Virtualization](#virtualization)

- [Hardware](#hardware)

- [Networking](#networking)

  - [Load Balancing](#load-balancing)

- [Monitoring](#monitoring)

  - [Performance Engineering](#performance-engineering)

- [AI & Automation](#ai--automation)

- [Work](#work)

  - [Training & Interview Materials](#training--interview-materials)

  - [Banking Industry](#banking-industry)

  - [Travel](#travel)

- [Miscellaneous](#miscellaneous)

  - [Dev / DevOps / Open Source](#dev--devops--open-source)

  - [Vendors](#vendors)

  - [Multimedia](#multimedia)

  - [Marketing](#marketing)

  - [Crypto](#crypto)

  - [Old Docs](#old-docs)

- [Star History](#star-history)

- [Memes](#memes)

- [More Core Repos](#more-core-repos)

  - [Knowledge](#knowledge)

  - [DevOps Code](#devops-code)

  - [Containerization](#containerization)

  - [CI/CD](#cicd)

  - [DBA - SQL](#dba---sql)

  - [DevOps Reloaded](#devops-reloaded)

  - [Templates](#templates)

  - [Misc](#misc)

**This is the lost documentation.**

![Finally Found The Documentation](images/finally_found_documentation.jpeg)

## GitHub Repos

Full of open source tools and scripts used throughout the rest of these docs to make it easier to install and operate these technologies:

- [DevOps-Bash-tools](devops-bash-tools.md) - 1000+ Bash scripts, advanced shell environment customizations, quick installation scripts and dot configs

- [DevOps-Python-tools](devops-python-tools.md) - 80+ Python programs for DevOps & Data

- [DevOps-Perl-tools](devops-perl-tools.md) - 25+ Perl programs for DevOps

- [DevOps-Golang-tools](devops-golang-tools.md) - a handful of Golang programs

- [Kubernetes-configs](https://github.com/HariSekhon/Kubernetes-configs) -

  many Kubernetes applications and advanced templates with Tips & Tricks from production environments

- [SQL-scripts](https://github.com/HariSekhon/SQL-scripts) - 100+ database scripts

- [Templates](https://github.com/HariSekhon/Templates) - templates for many common file formats for programming languages, build systems and DevOps configs

- [Diagrams-as-Code](https://github.com/HariSekhon/Diagrams-as-Code.md) - Cloud & Open Source architecture diagrams

This one is used widely throughout these pages:

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=DevOps-Bash-tools&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/DevOps-Bash-tools)

## Systems

### Operating Systems

- [Linux](linux.md)

  - [Debian](debian.md)

  - [Ubuntu](ubuntu.md)

  - [Redhat](redhat.md)

  - [Alpine](alpine.md)

  - [Gentoo](gentoo.md)

- [Windows](windows.md)

- [Mac](mac.md)

  - [Homebrew](brew.md)

- [Shell](shell.md)

  - [Bash](bash.md)

  - [direnv / `.envrc`](direnv.md)

  - [Advanced & Third Party Commands](commands.md)

- [Disk Management](disk.md)

- [Logging](logging.md)

  - [Syslog-ng](syslog-ng.md)

### Core Services - DNS, DHCP, SSH, FTP

- [SSH](ssh.md)

  - [SSH Tunnelling](ssh-tunnelling.md)

- [FTP](ftp.md)

- [DNS](dns.md)

- [DHCP](dhcp.md)

### Editors

- [Editors & IDEs](editors.md)

  - [Vim](vim.md)

  - [IntelliJ](intellij.md)

  - [VS Code](vs-code.md)

- [Coder](coder.md)

### Terminal Multiplexers

- [Screen](screen.md)

- [Tmux](tmux.md)

## Architecture & Documentation

- [Architecture](architecture.md) TODO

- [Product Selection](product-selection.md) TODO

- [Diagrams-as-Code](diagrams.md)

  - [D2 lang](d2.md)

  - [MermaidJS](mermaidjs.md)

- [Documentation](documentation.md)

  - [Markdown](markdown.md)

  - [MkDocs](mkdocs.md)

- [Microservices](microservices.md) TODO

- [Medium.com](medium.md) (blog)

- [Systems Design](systems-design.md)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Diagrams-as-Code&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Diagrams-as-Code)

## Git

- [Git](git.md)

  - [Git Workflow Branching Strategies](git-workflow-branching-strategies.md)

- Git Repo Hosting Providers:

  - [GitHub](github.md) TODO

  - [GitLab](gitlab.md)

  - [Azure DevOps](azure-devops.md) TODO

  - [Bitbucket](bitbucket.md) TODO

- [Pre-Commit](pre-commit.md)

## Cloud

- [Cloud](cloud.md)

- Cloud Platforms:

  - [AWS](aws.md)

  - [GCP](gcp.md)

  - [Azure](azure.md)

  - [Digital Ocean](digital-ocean.md)

- Third Party Tools:

  - [MinIO](minio.md)

  - [HashiCorp Vault](vault.md)

- [PaaS](paas.md)

## Containerization

### Docker

- [Docker](docker.md)

  - [Dockerfile](dockerfile.md) TODO

  - [Docker Compose](docker-compose.md)

  - [Docker Swarm](docker-swarm.md)

- [Podman](podman.md)

- [Dockerfiles](https://github.com/HariSekhon/Dockerfiles) for many technologies:

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Dockerfiles&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Dockerfiles)

### Kubernetes

#### Kubernetes Core

- [Kubernetes](kubernetes.md)

- [Kubernetes Upgrades](kubernetes-upgrades.md)

- [Kubernetes Configs](https://github.com/HariSekhon/Kubernetes-configs)

- [Kubernetes Production Ready Checklist](kubernetes-production-ready-checklist.md)

- [Traefik](traefik.md)

- [Kong API Gateway](kong.md)

- [Istio](istio.md) TODO

  - [Kiali](kiali.md)

- [Kubeflow](kubeflow.md) TODO

#### Cloud Hosted Kubernetes

- [AWS EKS](eks.md) TODO

- [GKE](gke.md) TODO

- [AKS](aks.md) TODO

- [Karpenter](karpenter.md)

#### On-premise Kubernetes

- [K3s](k3s.md)

- [Rancher](rancher.md)

- [RKE2](rke2.md)

- [Portworx](portworx.md)

#### Local Kubernetes Dev

- [Docker Desktop](https://www.docker.com/products/docker-desktop/) embedded Kubernetes (easiest to use)

- [MiniKube](https://minikube.sigs.k8s.io/docs/start/)

- [MiniShift](https://github.com/minishift/minishift) - for OpenShift upstream [okd](https://www.okd.io/)

- [K3d](k3d.md)

- [Kind](kind.md)

#### Kubernetes Applications & Lifecycle Management

- [Helm](helm.md)

- [Kustomize](kustomize.md)

  - [Helm vs Kustomize](helm-vs-kustomize.md)

- [ArgoCD](argocd.md)

- [Cert Manager](cert-manager.md)

- [Kubernetes Configs](https://github.com/HariSekhon/Kubernetes-configs):

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Kubernetes-configs&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Kubernetes-configs)

### Container Registries

- [DockerHub](https://hub.docker.com/)

- AWS [ECR](https://aws.amazon.com/ecr/)

- GCP [GAR](https://cloud.google.com/artifact-registry)

  - GCP [GCR](https://cloud.google.com/container-registry/pricing) (deprecated / shut down)

- Azure [ACR](https://azure.microsoft.com/en-us/products/container-registry)

- GitHub [GHCR](https://docs.github.com/en/packages/working-with-a-github-packages-registry/working-with-the-container-registry)

- Redhat [Quay.io](https://quay.io/) (there is an on-prem installable too)

- JFrog [Container Registry](https://jfrog.com/container-registry/)

- [Nexus](https://www.sonatype.com/nexus/repository-manager)

- [Harbor](https://goharbor.io/)

- [Chart Museum](https://chartmuseum.com/docs/#)

### Container Security

- [Container Scanning](container-scanning.md)

- [Trivy](trivy.md)

- [Grype](grype.md)

- [Clair](clair.md)

## Programming

- [Programming](programming.md)

- [Binaries Debugging](binaries-debugging.md)

### Languages

- [Perl](perl.md)

- [Python](python.md)

  - [Anaconda](anaconda.md)

- [Golang](golang.md) TODO

- [Ruby](ruby.md)

- [R](r.md) TODO

- [TCL / Expect](programming.md#expect)

- JVM:

  - [Java](java.md) TODO

  - [JDBC](jdbc.md)

  - [JVM Performance Tuning](java-jvm-performance-tuning.md)

  - [Groovy](groovy.md)

  - [Scala](scala.md) TODO

  - [Jython](python.md#jython)

  - [JRuby](ruby.md#jruby)

  - [SDKman](sdkman.md)

  - [log4j](log4j.md)

- [APIs](api.md)

- [Regular Expressions](regex.md)

- [Testing](testing.md)

### Build Systems

- [Build Systems](build-systems.md)

- [Make](make.md)

- [Maven](maven.md)

- [Gradle](gradle.md)

- [SBT](sbt.md)

### Artifact Registries

- [Artifact Registries](artifact-registries.md)

- [Artifactory](artifactory.md)

- [Nexus](nexus.md) TODO

### Code Scanning

- [Code Scanning](code-scanning.md)

  - [Trivy](trivy.md)

  - [Grype](grype.md)

- [Code Quality](code-quality.md)

- [SonarQube](sonarqube.md)

- [CodeClimate](codeclimate.md)

- [Codefresh](codefresh.md)

## Infrastructure-as-Code

- [Terraform](terraform.md)

  - [tfenv](tfenv.md)

  - [Terragrunt](terragrunt.md)

    - [tgswitch](tgswitch.md)

  - [Atlantis](atlantis.md)

- [Pulumi](pulumi.md)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Terraform&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Terraform)

## Configuration Management

- [Ansible](ansible.md)

- [Puppet](puppet.md) TODO

- [YAML](yaml.md)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Ansible&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Ansible)

## CI/CD

- [CI/CD](ci-cd.md)

- Self-Hosted CI/CD:

  - [Jenkins](jenkins.md)

    - [Jenkins-on-Kubernetes](jenkins-on-kubernetes.md)

    - [HariSekhon/Jenkins](https://github.
com/HariSekhon/Jenkins) - master `Jenkinsfile` template and Groovy Shared Library functions

  - [TeamCity](teamcity.md) TODO

    - [HariSekhon/TeamCity-CI](https://github.com/HariSekhon/Teamcity-CI)

  - [Concourse](concourse.md)

  - [GoCD](gocd.md) TODO

- Git Repo Providers hosted CI/CD:

  - [GitHub Actions](github-actions.md)

  - [GitLab CI](gitlab-ci.md) TODO

  - [Azure DevOps](azure-devops.md) TODO

  - [Bitbucket Pipelines](bitbucket.md) TODO

- 3rd Party hosted CI/CD:

  - [CircleCI](circleci.md)

  - [TravisCI](travis.md)

  - [Drone.io](drone.io.md)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=GitHub-Actions&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/GitHub-Actions)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Jenkins&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Jenkins)

## Internet Services

- [Web](web.md)

- [CDNs](cdn.md)

  - [Cloudflare](cloudflare.md)

- [HTTP Proxying](http-proxying.md)

- [APIs](api.md)

## Databases / RDBMS

- [SQL](sql.md) TODO

- [SQL scripts](https://github.com/HariSekhon/SQL-scripts)

- [Databases](databases.md)

- [Data Warehousing](data-warehousing.md) TODO

- [MySQL](mysql.md) TODO

- [PostgreSQL](postgres.md) TODO

- [Oracle](oracle.md)

- [CloudBeaver](cloudbeaver.md)

### MPP Databases

Massively Parallel Processing databases - horizontally scaling databases:

- [Vertica](vertica.md)

- [Greenplum](greenplum.md)

- [Impala](impala.md) TODO

- [Presto](presto.md)

- [Apache Drill](drill.md)

### Hosted MPP Databases

- [Distributed SQL](distributed-sql.md)

- [Snowflake](snowflake.md)

- [Google BigQuery](bigquery.md) TODO

- [AWS Redshift](redshift.md) TODO

See also the [Hadoop Ecosystem](#hadoop-ecosystem) section further down for more distributed SQL databases.

### Database Management

- [LiquiBase](liquibase.md) TODO

- [AtlasGo](atlasgo.md)

- [ByteBase](bytebase.md) TODO

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=SQL-scripts&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/SQL-scripts)

## NoSQL

- [Cassandra](cassandra.md) TODO

- [Couchbase](couchbase.md)

- [HBase](hbase.md) TODO

- [MongoDB](mongo.md) TODO

- [Neo4j](neo4j.md)

### Caching

- [Redis](redis.md) TODO

- [Memcached](memcached.md)

- [Couchbase](couchbase.md)

- [Oracle Coherence](coherence.md)

### Search

- [Search](search.md)

- [Elasticsearch](elasticsearch.md)

  - [Kibana](kibana.md)

- [Solr](solr.md)

- [Logstash](logstash.md) TODO

## Coordination & Discovery Services

- [Consul](consul.md)

- [Etcd](etcd.md)

- [ZooKeeper](zookeeper.md)

## Pub / Sub & Message Queues

- [Pub / Sub & Message Queues](pubsub.md)

- [Kafka](kafka.md)

- [RabbitMQ](rabbitmq.md)

- [Celery](celery.md)

- [AWS](aws.md) Kinesis

## Data

- [Data](data.md)

- [Big Data](big-data.md)

- [Data Warehousing](data-warehousing.md) TODO

- [Spark](spark.md) TODO

- [Airflow](airflow.md) TODO

- [Apache Camel](camel.md)

- [JSON](json.md)

- [Informatica](informatica.md)

### Data Formats

- [Data Formats](data-formats.md)

- [Avro](avro.md)

- [Parquet](parquet.md)

- [JSON](json.md)

### Hadoop Ecosystem

- [Spark](spark.md) TODO

- [Kafka](kafka.md)

- [Hadoop](hadoop.md) TODO

  - [Kerberos Hadoop](hadoop-kerberos.md) TODO

  - [YARN](yarn.md) TODO

  - [HDFS](hdfs.md) TODO

- [Pig](pig.md) TODO

- [Hive](hive.md) TODO

  - [Sqoop](sqoop.md)

- [Impala](impala.md) TODO

- [Presto](presto.md)

- [Apache Drill](drill.md)

- [Kudu](kudu.md)

- [Kylin](kylin.md)

- [Storm](storm.md) TODO

- [Mahout](mahout.md)

- [ZooKeeper](zookeeper.md)

### Data Science & Machine Learning

- [Data Science](data-science.md) TODO

- [Machine Learning](machine-learning.md) TODO

- [Python](python.md)

  - [Anaconda](anaconda.md) TODO

- [R](r.md) TODO

- [Octave](octave.md) TODO

### Time Series Databases

- [OpenTSDB](opentsdb.md)

  - [TCollector](tcollector.md)

- [T.I.C.K. platform](tick.md):

  - [Telegraf](telegraf.md) TODO

  - [InfluxDB](influxdb.md)

  - [Chronograf](chronograf.md) TODO

  - [Kapacitor](kapacitor.md)

### Visualization

- [Visualization](visualization.md)

- [Tableau](tableau.md)

## Security

- [Security](security.md) TODO

- [SSL](ssl.md) TODO

- [Kerberos](kerberos.md) TODO

- [FreeIPA](freeipa.md) TODO

- [Keycloak](keycloak.md)

- [Penetration Testing](pentesting.md) TODO

- [Secrets Managers](secrets-managers.md)

- [SOC - Security Operations Center](security-operations-center.md)

## Virtualization

- [Virtualization](virtualization.md)

- [VirtualBox](virtualbox.md)

- [Vagrant](vagrant.md)

- [Packer](packer.md)

- [OpenStack](openstack.md) TODO

- [KVM](kvm.md)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Packer-templates&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Packer-templates)

## Hardware

- [Hardware](hardware.md)

- [Storage](storage.md)

## Networking

- [Networking](networking.md) TODO

- [Firewalls](firewalls.md)

- [VPNs](vpn.md)

- [Cisco](cisco.md) TODO

- [Juniper](juniper.md) TODO

- [Foundry](foundry.md) TODO

- [Keepalived](keepalived.md)

### Load Balancing

- [Load Balancing](load-balancing.md) TODO

- [HAProxy](haproxy.md)

- [F5](f5.md)

## Monitoring

- [Monitoring](monitoring.md)

- [Nagios](nagios.md)

- [Prometheus](prometheus.md) TODO

- [Thanos](thanos.md) TODO

- [Grafana](grafana.md) TODO

- [Notifications](notifications.md)

  - [OpsGenie](opsgenie.md)

  - [PagerDuty](pagerduty.md) TODO

- [Fluentd](fluentd.md)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Nagios-Plugins&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Nagios-Plugins)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Nagios-Plugin-Kafka&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Nagios-Plugin-Kafka)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Prometheus&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Prometheus)

### Performance Engineering

- [Performance Engineering](performance.md)

- [Stress Testing](stress-testing.md)

## AI & Automation

- [AI](ai.md)

- [Automation](automation.md)

## Work

### Training & Interview Materials

- [Training](training.md)

- [Interview Materials](interview.md)

### Banking Industry

- [Banking Industry](banking-industry.md)

### Travel

- [Travel](travel.md)

## Miscellaneous

### Dev / DevOps / Open Source

- [DevOps Misc](devops.md)

- [Dev Misc](dev.md)

- [Open Source](open-source.md)

- [IRC](irc.md)

### Vendors

- [Hashicorp](hashicorp.md)

- [Confluent](confluent.md)

- [Atlassian](atlassian.md)

### Multimedia

- [Multimedia](multimedia.md)

### Marketing

- [Marketing](marketing.md)

### Crypto

This section is probably the most financially important thing you'll ever learn.

- [Bitcoin](bitcoin.md)

  - more financially beneficial than your Tech knowledge

  - the most important knowledge along with avoiding

  [feminist divorce law](https://www.amazon.co.uk/Men-Strike-Boycotting-Marriage-Fatherhood/dp/1594037620/)

- [Crypto](crypto.md)

  - every day you're not in crypto you're losing money due to constant inflationary money printing by central banks and

  governments to fund budgetary deficits caused by universal suffrage spending liabilities

  - even many investments, which are also taxed and often confiscated by governments or ex-wives, are losing ground to

  inflation in real terms

### Old Docs

- [Hazelcast](hazelcast.md)

- [Mesos](mesos.md)

## Star History

[![Star History Chart](https://api.star-history.com/svg?repos=HariSekhon/Knowledge-Base&type=Date)](https://star-history.com/#HariSekhon/Knowledge-Base&Date)

## Memes

From my [LinkedIn](https://linkedin.com/in/HariSekhon):

![BForbidden Unix Knowledge](images/devops_apprentice_reads_from_ancient_books_of_forbidden_unix_knowledge.jpeg)

I tried to make these docs as short as possible... but as you can see above, I didn't quite make it.

I've been both the bottom and top of this meme:

![Reading vs Trying](images/reading_documentation_for_30_mins_vs_4_hours_trying_and_failing_until_it_works.jpeg)

## More Core Repos

### Knowledge

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Knowledge-Base&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Knowledge-Base)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Diagrams-as-Code&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Diagrams-as-Code)

### DevOps Code

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=DevOps-Bash-tools&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/DevOps-Bash-tools)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=DevOps-Python-tools&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/DevOps-Python-tools)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=DevOps-Perl-tools&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/DevOps-Perl-tools)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=DevOps-Golang-tools&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/DevOps-Golang-tools)

### Containerization

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Kubernetes-configs&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Kubernetes-configs)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Dockerfiles&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Dockerfiles)

### CI/CD

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=GitHub-Actions&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/GitHub-Actions)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Jenkins&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Jenkins)

### DBA - SQL

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=SQL-scripts&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/SQL-scripts)

### DevOps Reloaded

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Nagios-Plugins&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Nagios-Plugins)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=HAProxy-configs&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/HAProxy-configs)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Terraform&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Terraform)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Packer-templates&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Packer-templates)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Nagios-Plugin-Kafka&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Nagios-Plugin-Kafka)

### Templates

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Templates&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Templates)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Template-repo&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Template-repo)

### Misc

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Spotify-tools&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Spotify-tools)

[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=HariSekhon&repo=Spotify-playlists&theme=ambient_gradient&description_lines_count=3)](https://github.com/HariSekhon/Spotify-playlists)

The rest of my original source repos are

[here](https://github.com/HariSekhon?tab=repositories&q=&type=source&language=&sort=stargazers).

Pre-built Docker images are available on my [DockerHub](https://hub.docker.com/u/harisekhon/).

![](https://hit.yhype.me/github/profile?user_id=2211051)
ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

https://github.com/harisekhon/knowledge-base

Awesome Lists containing this project

README
