Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/oracle-japan/ochacafe-kubevirt

OCHaCafe Season 8 #5 - Kubernetesで構築するIaaS基盤
https://github.com/oracle-japan/ochacafe-kubevirt

iaas kubernetes kubevirt ochacafe vm

Last synced: about 4 hours ago
JSON representation

OCHaCafe Season 8 #5 - Kubernetesで構築するIaaS基盤

Host: GitHub
URL: https://github.com/oracle-japan/ochacafe-kubevirt
Owner: oracle-japan
Created: 2024-05-31T02:24:31.000Z (6 months ago)
Default Branch: master
Last Pushed: 2024-06-04T09:16:13.000Z (6 months ago)
Last Synced: 2024-06-04T14:12:55.484Z (6 months ago)
Topics: iaas, kubernetes, kubevirt, ochacafe, vm
Homepage:
Size: 13.7 KB
Stars: 0
Watchers: 3
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

README

# OCHaCafe Season8 #5 - Kubernetesで構築するIaaS基盤

## ディレクトリ構成

```sh
.
├── prepare
│ ├── snapshot.yaml
│ └── storageclass.yaml
├── README.md
├── script
│ └── ping.sh
├── templates
│ ├── common-preferences-bundle-v1.0.0.yaml
│ └── common-templates.yaml
└── vms
├── simple_demo.yaml
└── vm_demo.yaml

4 directories, 8 files
```

## OKEとminikubeのプロビジョニング

### OKE

OKEのプロビジョニングはこちらを参考に実施してください。
Worker Nodeのスペックは`VM.Standard.E5.Flex`シェイプで2oCPU、16GB RAMで作成してください。
なお、CNIはFlannelで構築してください。

### minikube

以下のコマンドを実行します。

```sh
curl -LO https://storage.googleapis.com/minikube/releases/latest/minikube-linux-amd64
```

```sh
sudo install minikube-linux-amd64 /usr/local/bin/minikube && rm minikube-linux-amd64
```

```sh
minikube start --nodes=2 --cni=flannel
```

## KubeVirtのインストール

### OKE/minikube共通

#### KubeVirtのインストール

```sh
export VERSION=$(curl -s https://storage.googleapis.com/kubevirt-prow/release/kubevirt/kubevirt/stable.txt)
```

```sh
echo $VERSION
```

```sh
kubectl create -f https://github.com/kubevirt/kubevirt/releases/download/${VERSION}/kubevirt-operator.yaml
```

```sh
kubectl create -f https://github.com/kubevirt/kubevirt/releases/download/${VERSION}/kubevirt-cr.yaml
```

以下のコマンドを実行し、`Deployed`になればインストールは完了

```sh
$ kubectl get kubevirt.kubevirt.io/kubevirt -n kubevirt -o=jsonpath="{.status.phase}"
Deployed
```

virtctlをインストール

```sh
VERSION=$(kubectl get kubevirt.kubevirt.io/kubevirt -n kubevirt -o=jsonpath="{.status.observedKubeVirtVersion}")
ARCH=$(uname -s | tr A-Z a-z)-$(uname -m | sed 's/x86_64/amd64/') || windows-amd64.exe
```

```sh
echo ${ARCH}
```

```sh
curl -L -o virtctl https://github.com/kubevirt/kubevirt/releases/download/${VERSION}/virtctl-${VERSION}-${ARCH}
```

```sh
chmod +x virtctl
```

```sh
sudo install virtctl /usr/local/bin
```

#### minikubeのみ

nested virtualizationを有効化

```sh
kubectl -n kubevirt patch kubevirt kubevirt --type=merge --patch '{"spec":{"configuration":{"developerConfiguration":{"useEmulation":true}}}}'
```

#### VolumeSnapshotClass/VolumeSnapshotのインストール

```sh
kubectl apply -f https://raw.githubusercontent.com/kubernetes-csi/external-snapshotter/master/client/config/crd/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
```

```sh
kubectl apply -f https://raw.githubusercontent.com/kubernetes-csi/external-snapshotter/master/client/config/crd/snapshot.storage.k8s.io_volumesnapshots.yaml
```

#### OKEのみ

##### VolumeSnapshotClass(OCI Block Volume Driver)のインストール

```sh
kubectl apply -f prepare/snapshot.yaml
```

#### CDI(Containerized Data Importer)のインストール

```sh
export TAG=$(curl -s -w %{redirect_url} https://github.com/kubevirt/containerized-data-importer/releases/latest)
export VERSION=$(echo ${TAG##*/})
```

```sh
kubectl apply -f https://github.com/kubevirt/containerized-data-importer/releases/download/$VERSION/cdi-operator.yaml
kubectl apply -f https://github.com/kubevirt/containerized-data-importer/releases/download/$VERSION/cdi-cr.yaml
```

#### minikubeのみ

##### VolumeSnapshotClass(NFS CSI Driver)のインストール

```sh
curl -skSL https://raw.githubusercontent.com/kubernetes-csi/csi-driver-nfs/v4.7.0/deploy/install-driver.sh | bash -s v4.7.0 --
```

```sh
kubectl apply -f prepare/nfs.yaml
```

#### LiveMigrationのFeature Gateを有効化

```sh
kubectl apply -f - <`
```

```sh
sed -i "s%ssh-rsa.*%$PUBKEY%" vms/vm_demo.yaml
```

### VMの作成

```sh
kubectl apply -f vms/vm_demo.yaml
```

### SSH接続用Seriviceの作成

```sh
virtctl expose vm ocha-vm --name=ocha-ssh --port=20222 --target-port=22 --type=LoadBalancer
```

アサインされているパブリックIPを確認

```sh
kubect get svc ocha-ssh
```

```sh
ssh -i private.pem [email protected] -p 20222
```

### ヘルスチェックの確認

```sh
sudo systemctl stop nginx
```

```sh
$ kubectl get vm -w
NAME AGE STATUS READY
ocha-vm 28m Running True
ocha-vm 29m Stopped True
ocha-vm 29m Stopped False
ocha-vm 29m Starting False
ocha-vm 29m Starting False
ocha-vm 29m Starting False
ocha-vm 29m Starting False
ocha-vm 29m Starting False
ocha-vm 29m Running False
ocha-vm 29m Running True
```

## 実践！！KubeVirtのデモ - LiveMigration - (minikube)

### minikubeへの切り替え

[kubectx](https://github.com/ahmetb/kubectx)をインストール

```sh
kubectx minikube
```

### VMの作成

```sh
kubectl apply -f vms/simple_demo.yaml
```

### Live Migration

SSH接続後にバックグラウンドで8080番ポートでhttp接続受付

```sh
virtctl console testvm
```

```sh
while true; do ( echo "HTTP/1.0 200 Ok"; echo; echo "Migration test" ) | nc -l -p 8080; done &
```

NodePortで8080ポートを公開

```sh
virtctl expose vmi testvm --name=testvm-http --port=8080 --type=NodePort
```

別ターミナルでtestvmに対してhttp pingを送信

```sh
IP=$(minikube ip)
PORT=$(kubectl get svc testvm-http -o jsonpath='{.spec.ports[0].nodePort}')
```

```sh
curl ${IP}:${PORT}
```

Migrateを実行

```sh
virtctl migrate testvm
```

Pod(VM)のMigrate状態を観察

```sh
$ kuebctl get pods -o -w
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
virt-launcher-testvm-2t4bn 3/3 Running 0 12s 10.244.1.21 minikube-m02 1/1
virt-launcher-testvm-zp99b 0/3 Init:0/2 0 1s minikube 0/1
virt-launcher-testvm-zp99b 0/3 Init:1/2 0 2s 10.244.0.18 minikube 0/1
virt-launcher-testvm-zp99b 0/3 PodInitializing 0 3s 10.244.0.18 minikube 0/1
virt-launcher-testvm-zp99b 3/3 Running 0 4s 10.244.0.18 minikube 0/1
virt-launcher-testvm-zp99b 3/3 Running 0 6s 10.244.0.18 minikube 0/1
virt-launcher-testvm-zp99b 3/3 Running 0 6s 10.244.0.18 minikube 1/1
virt-launcher-testvm-zp99b 3/3 Running 0 6s 10.244.0.18 minikube 1/1
virt-launcher-testvm-zp99b 3/3 Running 0 7s 10.244.0.18 minikube 1/1
virt-launcher-testvm-2t4bn 2/3 NotReady 0 18s 10.244.1.21 minikube-m02 1/1
virt-launcher-testvm-2t4bn 1/3 NotReady 0 19s 10.244.1.21 minikube-m02 1/1
virt-launcher-testvm-2t4bn 0/3 Completed 0 20s 10.244.1.21 minikube-m02 1/1
virt-launcher-testvm-2t4bn 0/3 Completed 0 21s minikube-m02 1/1
virt-launcher-testvm-2t4bn 0/3 Completed 0 22s 10.244.1.21 minikube-m02 1/1
```

Migrate後でもhttp pingが通ることを確認

```sh
curl ${IP}:${PORT}
```