{"id":13821689,"url":"https://github.com/kubermesh/kubermesh","last_synced_at":"2025-05-16T13:30:39.907Z","repository":{"id":217314277,"uuid":"62445038","full_name":"kubermesh/kubermesh","owner":"kubermesh","description":"Bare metal, self-hosted, self-healing/provisioning, mesh network kubernetes cluster","archived":false,"fork":false,"pushed_at":"2020-03-12T05:49:04.000Z","size":59,"stargazers_count":454,"open_issues_count":4,"forks_count":18,"subscribers_count":19,"default_branch":"master","last_synced_at":"2024-11-19T21:36:18.498Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kubermesh.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-07-02T10:05:11.000Z","updated_at":"2024-05-06T14:00:04.000Z","dependencies_parsed_at":null,"dependency_job_id":"5d213586-4105-49ca-9999-d2138a71b1cb","html_url":"https://github.com/kubermesh/kubermesh","commit_stats":null,"previous_names":["kubermesh/kubermesh"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubermesh%2Fkubermesh","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubermesh%2Fkubermesh/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubermesh%2Fkubermesh/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kubermesh%2Fkubermesh/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kubermesh","download_url":"https://codeload.github.com/kubermesh/kubermesh/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254538249,"owners_count":22087829,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-04T08:01:25.991Z","updated_at":"2025-05-16T13:30:39.657Z","avatar_url":"https://github.com/kubermesh.png","language":"Shell","funding_links":[],"categories":["Shell"],"sub_categories":[],"readme":"# kubermesh\n\n## Goal\n\n1. Deploy to one machine. Say, boot off a USB hard drive.\n2. Plug other machines into the first one. Watch them boot and join the cluster.\n3. Keep going till you run out of machines.\n\nNo need for a traditional network with switches.\n\nEasy replacement, just drop new machines in. And the same goes for adding capacity\n\nThis repo is a prototype trying to achieve the above concepts. For more about the project, see [the blog post](http://ocadotechnology.com/blog/creating-a-distributed-data-centre-architecture-using-kubernetes-and-containers/)\n\n## Local dev prerequisites\n`sudo apt-get install qemu-kvm libvirt-bin docker virtinst`\n\n## Getting started\n\n`./deploy libvirt 4`\n\nThis will set up 4 nodes using libvirt, and run the bootstrap process\n\nUsernames/Passwords are currently hardcoded to `core/core`\n\n## Useful commands\n\n`virt-viewer kubermesh1` - to get a graphical console\n`virsh console kubermesh1` - to get a serial console\n\n## Cleaning up\n\n`./teardown`\n\n## Current address allocations\n\nAnycast addresses:\n- apiserver: fd65:7b9c:569:680:98eb:c508:eb8c:1b80\n- etcd: fd65:7b9c:569:680:98eb:c508:ea6b:b0b2\n- docker hub mirror: [fd65:7b9c:569:680:98e8:1762:7b6e:83f6]:5000\n- gcr.io mirror: [fd65:7b9c:569:680:98e8:1762:7b6e:61d3]:5002\n- quay.io mirror: [fd65:7b9c:569:680:98e8:1762:7abd:e0b7]:5001\n\nlibvirt networking:\n- host \u003c-\u003e gateway: 172.30.0.1/30\n- host \u003c-\u003e gateway: 2001:db8:a001::1/64\n- gateway \u003c-\u003e kubermesh1: 172.30.0.9/29\n- gateway \u003c-\u003e kubermesh1: 2001:db8:a002::10/126\n- gateway docker: 172.30.1.1/24\n- flannel ipv4: 172.31.0.0/16\n- custom ipv4 allocation: 172.30.2.0/24\n- custom ipv6 allocation: 2001:db8::/71\n\nInstallation networking:\n- ??::0/119\n- host: ::0/123\n- host vip: ::0/128\n- mesh interfaces: ::10/123\n- mesh interface 1: ::10/126\n- mesh interface 2: ::14/126\n- mesh interface 3: ::18/126\n- mesh interface 4: ::1c/126\n- pods: ::100/120\n\n## Hardware specific\n### NUCs\n* Disable legacy network boot in the bios, so it will use EFI boot over ipv6\n  * Enter the BIOS\n  * Select Advanced under `Boot Order`\n  * Under `Legacy Boot Priority` disable `Legacy Boot`\n  * Under `Boot Configuration` select `Boot Network Devices Last`\n  * Under `Boot Configuration` select `Unlimited Boot to Network Attempts`\n  * Under `Boot Configuration` check `Network Boot` is set to `UEFI PXE \u0026 iSCSI`\n  * F10\n### USB Devices for the gateway bootstrapping physical hardware\n* Plug USB3 ones into a USB2 port, so qemu can use it without Speed Mismatch errors\n* Might need to add `/run/udev/data/** r,` to `/etc/apparmor.d/abstractions/libvirt-qemu` until qemu fixes that bug\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkubermesh%2Fkubermesh","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkubermesh%2Fkubermesh","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkubermesh%2Fkubermesh/lists"}