Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kevydotvinu/ocp-ipi-baremetal-lab
OpenShift IPI Bare Metal Lab - Fedora CoreOS + Libvirt + VirtualBMC.
https://github.com/kevydotvinu/ocp-ipi-baremetal-lab
ocp ocp4 openshift openshift-cluster openshift-deployment
Last synced: about 2 months ago
JSON representation
OpenShift IPI Bare Metal Lab - Fedora CoreOS + Libvirt + VirtualBMC.
- Host: GitHub
- URL: https://github.com/kevydotvinu/ocp-ipi-baremetal-lab
- Owner: kevydotvinu
- License: mit
- Created: 2022-05-01T14:19:12.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-02-10T08:39:34.000Z (almost 2 years ago)
- Last Synced: 2024-10-16T04:59:38.044Z (3 months ago)
- Topics: ocp, ocp4, openshift, openshift-cluster, openshift-deployment
- Language: Makefile
- Homepage:
- Size: 2.89 MB
- Stars: 3
- Watchers: 3
- Forks: 3
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# OpenShift IPI Baremetal Lab (oibl)
A lab environment that can be used for studying the OpenShift bare metal IPI deployment and its internal parts. It also fulfils the need for creating an OpenShift cluster with minimal intervention and time.
## Architecture
## Deployment sequence
```mermaid
sequenceDiagram
autonumber
rect rgb(245, 255, 245)
Note left of Installer: baremetal
network
Installer ->> Libvirt: Hey, I need a bootrap node.
Libvirt -->> Installer: Hey back, bootrap VM is created.
Bootstrap (ironic) ->> VirtualBMC: Hey master0, turn on, please.
Bootstrap (ironic) ->> VirtualBMC: Hey master1, turn it on.
Bootstrap (ironic) ->> VirtualBMC: Hey master2, power the node on.
VirtualBMC ->> Libvirt: Hey, I got a request for the three baremetal node. Please start all three pre-created master VMs.
Libvirt ->> Master0: start master0
Libvirt ->> Master1: start master1
Libvirt ->> Master2: start master2
Libvirt -->> VirtualBMC: The three master VMs are started. Don't worry. They will act like baremetal nodes.
VirtualBMC -->> Bootstrap (ironic): Hey back, the baremetal nodes are started and running. Take control.
end
rect rgb(255, 245, 245)
Master0 ->> Bootstrap (ironic): Hey there!
Master1 ->> Bootstrap (ironic): Hello!
Master2 ->> Bootstrap (ironic): Hi!
Note right of Master2: provisioning
network
end
```
## Prerequisites
|Machine|Operating System|CPU|RAM|DISK|
|:-:|:-:|:-:|:-:|:-:|
|Provisioner node|[Fedora CoreOS](https://getfedora.org/en/coreos/download/)|20|80 GB|240 GB|
> Enable nested virtualization if the host is a VM. For example, in Red Hat Virtualization, enable the `Pass-Through Host CPU` CPU option in the Virtual Machine settings (Under the Host section).
> Use the Testing release stream of Fedora CoreOS.
> ```bash
> export ISO=$(curl -s https://builds.coreos.fedoraproject.org/streams/testing.json | \
> jq -r .architectures.x86_64.artifacts.metal.formats.iso.disk.location)
> curl -# -O ${ISO}
## Preparation
### Install and configure provisioner node
```bash
$ echo 1 | sudo tee /proc/sys/net/ipv6/conf/all/disable_ipv6
$ sudo coreos-installer install /dev/sda --ignition-url=https://bit.ly/oibl-ignition
$ sudo systemctl reboot
$ ssh kni@ (Enter `Kni@123` as password)
$ sudo rpm-ostree rebase --experimental \
ostree-unverified-registry:docker.io/kevydotvinu/oibl-ostree
$ sudo rpm-ostree kargs --append=selinux=0 --reboot
```
## Usage
### Check if the host is ready
Wait for the machine to become ready itself with the hosted services such as DHCP, VBMC and Webserver. If you list the containers using Podman, you could see the below list.
```bash
$ sudo podman ps --format "{{.Names}}"
webserver
vbmc
dhcp
```
Once the system is ready, you will also get notified with a broadcase message:
```bash
The containerized services (webserver vbmc dhcp) are ready.
You can start the OpenShift baremetal IPI installation now.
```
### Create cluster
```bash
$ oibl help
$ oibl ssh-pullsecret OCM_TOKEN=
$ oibl install-config RELEASE=stable-4.10
$ oibl cluster LOGLEVEL=info
```
## Customization
### Generate an ignition (Optional)
```bash
$ git clone --recurse-submodules https://github.com/kevydotvinu/ocp-ipi-baremetal-lab
$ cd ocp-ipi-baremetal-lab
$ make generate-ignition
$ ls ignition/00-core.ign
```
### Build and push an ostree container image (Optional)
```bash
$ git clone --recurse-submodules https://github.com/kevydotvinu/ocp-ipi-baremetal-lab
$ cd ocp-ipi-baremetal-lab
$ podman login --authfile auth.json
$ make build-push-ostree OSTREE_IMAGE=//
```
## Tips
### Get SSH access to FCOS LiveCD session
Serve the SSH public key from your workstation using python module
```bash
$ sudo iptables -I INPUT 1 -p tcp --dport 9900 -j ACCEPT
$ python -m SimpleHTTPServer 9900 || python3 -m http.server 9900
```
Collect the SSH key from FCOS LiveCD
```bash
$ curl --create-dirs --output ~/.ssh/authorized_keys http://:9900/.ssh/id_rsa.pub
```
Access FCOS LiveCD session using SSH from your workstation
```bash
$ ssh core@
```
## Known issues
### Docker rate limit
**Error**
```bash
error: remote error: reading manifest latest in docker.io/kevydotvinu/oibl-ostree: \
toomanyrequests: You have reached your pull rate limit. You may increase the limit \
by authenticating and upgrading: https://www.docker.com/increase-rate-limit
```
**Workaround**
```bash
sudo podman login docker.io
```
### The containerized services are not ready
**Error**
```bash
Makefile:14: *** The containerized services (dhcp vbmc webserver) are not ready. \
Check with 'sudo podman ps' and wait for a while to retry. Stop.
```
**Workaround**
```bash
sudo systemctl status dhcp vbmc webserver
sudo systemctl restart dhcp vbmc webserver
```
### The VMs are not ready
**Error**
```bash
Makefile:19: *** The VMs are not ready. Please check their status with \
'sudo systemctl restart master0 master1 master2 worker0 worker1'. Stop.
```
**Workaround**
```bash
sudo systemctl status master0 master1 master2 worker0 worker1
sudo systemctl restart master0 master1 master2 worker0 worker1
```