{"id":16060849,"url":"https://github.com/geerlingguy/youtube-10k-pods","last_synced_at":"2025-03-17T16:32:21.572Z","repository":{"id":38338268,"uuid":"264285118","full_name":"geerlingguy/youtube-10k-pods","owner":"geerlingguy","description":"10,000 Kubernetes Pods for 10,000 Subscribers","archived":false,"fork":false,"pushed_at":"2020-05-15T23:35:42.000Z","size":11,"stargazers_count":78,"open_issues_count":0,"forks_count":26,"subscribers_count":5,"default_branch":"master","last_synced_at":"2025-03-16T13:02:29.349Z","etag":null,"topics":["ansible","aws","celebration","eks","k3s","kubernetes","subscribers","youtube"],"latest_commit_sha":null,"homepage":"https://www.jeffgeerling.com/blog/2020/10000-kubernetes-pods-10000-subscribers","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/geerlingguy.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null},"funding":{"github":"geerlingguy","patreon":"geerlingguy"}},"created_at":"2020-05-15T19:51:05.000Z","updated_at":"2025-03-15T01:54:26.000Z","dependencies_parsed_at":"2022-08-09T03:00:59.901Z","dependency_job_id":null,"html_url":"https://github.com/geerlingguy/youtube-10k-pods","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Fyoutube-10k-pods","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Fyoutube-10k-pods/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Fyoutube-10k-pods/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Fyoutube-10k-pods/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/geerlingguy","download_url":"https://codeload.github.com/geerlingguy/youtube-10k-pods/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244068980,"owners_count":20392930,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ansible","aws","celebration","eks","k3s","kubernetes","subscribers","youtube"],"created_at":"2024-10-09T04:06:47.537Z","updated_at":"2025-03-17T16:32:21.289Z","avatar_url":"https://github.com/geerlingguy.png","language":null,"funding_links":["https://github.com/sponsors/geerlingguy","https://patreon.com/geerlingguy"],"categories":[],"sub_categories":[],"readme":"# 10,000 Kubernetes Pods for 10,000 Subscribers\n\n\u003cp align=\"center\"\u003e\u003ca href=\"https://www.youtube.com/watch?v=k5ncj3TKL1c\"\u003e\u003cimg src=\"https://img.youtube.com/vi/k5ncj3TKL1c/0.jpg\" alt=\"10,000 Kubernetes Pods for 10,000 Subscribers!\" /\u003e\u003c/a\u003e\u003c/p\u003e\n\n\u003e **tl;dr**: See the blog post that accompanies this project: [10,000 Kubernetes Pods for 10,000 Subscribers](https://www.jeffgeerling.com/blog/2020/10000-kubernetes-pods-10000-subscribers).\n\nThis repository contains automation to build a large Kubernetes cluster in AWS, and run 10,000 Pods on that cluster. And it does it two ways, because I realized that the first way didn't work without running 1,000 vCPUs in my brand new AWS account (AWS support usually doesn't look kindly on people who open a new account and immediately ask for insane capacity increases!).\n\n  - [`attempt-one-eks`](attempt-one-eks/) is the first attempt: build an EKS cluster with 100 `t3.micro` nodes; later updated to use 14 `m5.16xlarge` nodes, which worked but required an insane amount of computing power, which would cost over $30,000/month!\n  - [`attempt-two-k3s`](attempt-two-k3s/) is the second attempt: build a K3s cluster with one `c5.2xlarge` master and 100 `c5.large` nodes. (I almost got it working with `t3.micro` nodes but they started dying when I deployed 100 Pods to each node...).\n\nIn the end, I found out that burstable `t3` instances just aren't ready for massive amounts of pods, no matter what. I run into networking _and_ burst CPU limits. And EKS has some annoying limitations with it's current VPC CNI networking, but those could be overcome if you take the time to swap out a different networking solution.\n\nIf you're interested in automating Kubernetes with Ansible, I have the _perfect_ book for you: [Ansible for Kubernetes](https://www.ansibleforkubernetes.com).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgeerlingguy%2Fyoutube-10k-pods","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgeerlingguy%2Fyoutube-10k-pods","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgeerlingguy%2Fyoutube-10k-pods/lists"}