Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/lennard0711/vfio
This is the config for my VFIO gaming VM
https://github.com/lennard0711/vfio
kvm vfio vfio-setup virtual-machine virtualization
Last synced: about 2 months ago
JSON representation
This is the config for my VFIO gaming VM
- Host: GitHub
- URL: https://github.com/lennard0711/vfio
- Owner: lennard0711
- License: eupl-1.2
- Created: 2021-04-01T23:20:48.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-05-25T15:29:53.000Z (over 2 years ago)
- Last Synced: 2024-06-12T08:56:41.903Z (4 months ago)
- Topics: kvm, vfio, vfio-setup, virtual-machine, virtualization
- Language: Shell
- Homepage:
- Size: 34.2 KB
- Stars: 31
- Watchers: 1
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# VFIO
In this repo you can find everything about my VFIO setup. I mainly use it for gaming on a Windows VM while using a Arch Linux host system.
I mostly used the Arch Wiki to setup everything, especially this page: [PCI passthrough via OVMF](https://wiki.archlinux.org/index.php/PCI_passthrough_via_OVMF)
## TODOs
- [x] Create QEMU hooks to disable host screen 1 after booting the VM
- [x] Isolate pinned CPUs
- [ ] Pass through USB controller for hotplugging support in the VM
- [ ] Document mainboard settings
## Hardware
Type | Device | Info
------------ | ------------- | -------------
Mainboard | ASRock X570 Pro4
CPU | AMD Ryzen 7 3700x | 8C/16T
GPU | AMD XFX Radeon RX 580 GTS Core Aktiv | VFIO
GPU | MSI GeForce GT 1030 Aero ITX | Host
RAM | 16GB G.Skill Aegis DDR4-3200
RAM | 16GB G.Skill Aegis DDR4-3200
SSD | 500 GB Crucial P1 NVMe | /dev/nvme0n1
SSD | 500 GB Crucial MX500 SATA | /dev/sdb
HDD | 1000 GB Seagate BarraCuda ST1000DM010 | /dev/sda
HDD | 1000 GB Seagate BarraCuda ST1000DM010 | /dev/sdc
## Mainboard Settings
tba
## Installation
### Arch Linux
#### Packages
* `libvirt`
* `qemu`
* `edk2-ovmf`
* `ebtables`
* `dnsmasq`
* `bridge-utils`
* `openbsd-netcat`
* `virt-manager`
Install all packages via pacman:
`sudo pacman -S libvirt qemu edk2-ovmf ebtables dnsmasq bridge-utils openbsd-netcat virt-manager`
Enable & start the libvirt service:
`sudo systemctl enable --now libvirtd.service`
#### User Group
Add yourself to the `libvirt` group to get passwordless access to the QEMU system socket.
## Partition Setup
All devices are luks2 encrypted.
All hard drives have at least one lvm volume which is passed through to the VM.
`/dev/sda` is used as a HDD to store all games on.
`/dev/sdb` is used as the SSD to run the OS and most programs.
`/dev/sdc` is used to store my other VMs.
```
sda 8:0 0 931,5G 0 disk
└─win10-hdd 254:5 0 931,5G 0 crypt
└─win10--hdd-games 254:6 0 931,5G 0 lvm
sdb 8:16 0 465,8G 0 disk
└─win10-ssd 254:3 0 465,7G 0 crypt
└─win10--ssd-root 254:4 0 465,7G 0 lvm
sdc 8:32 0 931,5G 0 disk
└─sdc1 8:33 0 931,5G 0 part
└─libvirt 254:7 0 931,5G 0 crypt
├─libvirt-gentoo 254:8 0 50G 0 lvm
├─libvirt-fedora 254:9 0 100G 0 lvm
├─libvirt-ubuntu 254:10 0 100G 0 lvm
├─libvirt-rhel 254:11 0 100G 0 lvm
└─libvirt-RDPWindows 254:12 0 80G 0 lvm
nvme0n1 259:0 0 465,8G 0 disk
├─nvme0n1p1 259:1 0 512M 0 part /boot
└─nvme0n1p2 259:2 0 465,3G 0 part
└─cryptroot 254:0 0 465,2G 0 crypt
├─arch-swap 254:1 0 32G 0 lvm [SWAP]
└─arch-root 254:2 0 433,2G 0 lvm /
```
## VM config
### Hypervisor Details
Type | Info
------------ | -------------
Hypervisor | KVM
Architecture | x86_64
Emulator | /usr/bin/qemu-system-x86_64
Chipset | i440FX
Firmware | UEFI x86_64: /usr/share/edk2-ovmf/x64/OVMF_CODE.fd
### CPU
#### Cores
Use 1 Socket with 6 cores and 2 threads = 12 threads
To use the nested virtualisation feature on Windows with an AMD Chipset, you'll need to use the Windows insider builds!
I don't use it for my Windows VM but for others (RHEL), that's why I have it enabled in the `/etc/modprode.d/kvm.conf` config.
So unless you want to play Valorant which needs Hyper-V enabled and working nested virtualisation in order to work, you can skip the `/etc/modprode.d/kvm.conf` part.
`/etc/libvirt/qemu/win10.xml`
```xml
```
`/etc/modprobe.d/kvm.conf`
```
options kvm_amd nested=1
options kvm ignore_msrs=1
```
#### CPU pinning
This pins specific CPUs to my VM, but it won't hinder other processes to use them.
`/etc/libvirt/qemu/win10.xml`
```xml
12
```
#### CPU isolation
This isolates the pinned CPUs to hinder processes from the host to use them
```bash
systemctl set-property --runtime -- user.slice AllowedCPUs=0,1,8,9
systemctl set-property --runtime -- system.slice AllowedCPUs=0,1,8,9
systemctl set-property --runtime -- init.scope AllowedCPUs=0,1,8,9
```
This frees all CPUs to let the host use all CPUs again
```bash
systemctl set-property --runtime -- user.slice AllowedCPUs=0-15
systemctl set-property --runtime -- system.slice AllowedCPUs=0-15
systemctl set-property --runtime -- init.scope AllowedCPUs=0-15
```
I use these commands in my QEMU hook script [here](https://github.com/lennard0711/vfio/blob/main/etc/libvirt/hooks/qemu.d/win10.sh)
### Disks
#### Boot Disk / SSD
`/etc/libvirt/qemu/win10.xml`
```xml
```
#### HDD
`/etc/libvirt/qemu/win10.xml`
```xml
```
### Audio
I pass my audio directly to my pulseaudio server (provided by pipewire).
`/etc/libvirt/qemu.conf`
```
user = "lennard0711"
```
`/etc/libvirt/qemu/win10.xml`
```xml
```
### Automatic monitor switching
All my monitors are set to autodetect signals.
My Linux GPU is connected via DVI to my gaming monitor so i just deactivate it via xrandr.
To get my dual screen setup back, I just enable the DVI output again and set the HDMI output as primary display.
With this QEMU hook script it switches my monitors automatically when i start/stop my VM
`/etc/libvirt/hooks/qemu.d/win10.sh`
```bash
#!/bin/bash
if [[ $1 == "win10" ]]; then
if [[ $2 == "started" ]]; then
# CPU isolation
systemctl set-property --runtime -- user.slice AllowedCPUs=0,1,8,9
systemctl set-property --runtime -- system.slice AllowedCPUs=0,1,8,9
systemctl set-property --runtime -- init.scope AllowedCPUs=0,1,8,9
# Disable DVI-D-0
su -l lennard0711 -c "DISPLAY=:0 xrandr --output DVI-D-0 --off"
fi
if [[ $2 == "stopped" ]]; then
# Free all CPUs
systemctl set-property --runtime -- user.slice AllowedCPUs=0-15
systemctl set-property --runtime -- system.slice AllowedCPUs=0-15
systemctl set-property --runtime -- init.scope AllowedCPUs=0-15
# Enable DVI-D-0
su -l lennard0711 -c "DISPLAY=:0 xrandr --output DVI-D-0 --auto --left-of HDMI-0"
su -l lennard0711 -c "DISPLAY=:0 xrandr --output HDMI-0 --primary"
fi
fi
```