https://github.com/efenstor/pytorch-rocm-gfx1010
Instructions on how to build PyTorch on Debian 12 with support for the AMD gfx1010 architecture
https://github.com/efenstor/pytorch-rocm-gfx1010
5600xt 5700xt amdgpu building-instructions chainner comfyui gfx1010 pytorch radeon rocm torchaudio torchvision
Last synced: about 2 months ago
JSON representation
Instructions on how to build PyTorch on Debian 12 with support for the AMD gfx1010 architecture
- Host: GitHub
- URL: https://github.com/efenstor/pytorch-rocm-gfx1010
- Owner: Efenstor
- Created: 2025-04-12T19:44:17.000Z (about 2 months ago)
- Default Branch: main
- Last Pushed: 2025-04-12T20:07:42.000Z (about 2 months ago)
- Last Synced: 2025-04-13T11:14:27.874Z (about 2 months ago)
- Topics: 5600xt, 5700xt, amdgpu, building-instructions, chainner, comfyui, gfx1010, pytorch, radeon, rocm, torchaudio, torchvision
- Homepage:
- Size: 10.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# PyTorch for Radeon RX 5600/5700 (gfx1010) on Debian 12
Pre-built wheels
--
Pre-built wheels of PyTorch 2.6.0, TorchVision 0.2.1 and TorchAudio 2.6.0 (built for ROCm 6.3.4 and Python 3.11) are located in the "*prebuilt*" directory.
There is no guarantee that those will work with your particular configuration of video card, ROCm version, Python version, PyTorch version, kernel version, etc.
For best results use the following instructions to build those wheels yourself.
Introduction
--
These instructions are the result of the efforts to make PyTorch work with unofficially-supported AMD gfx1010 GPUs (Radeon RX 5000 series) on Debian 12.
Unfortunately **none** of the pre-compiled binaries work for gfx1010 GPUs. Anecdotally they did work in the past but no more, even with not-so-fresh versions of PyTorch.
Using various tricks, such as setting the `HSA_OVERRIDE_GFX_VERSION=10.3.0` environment variable or using older versions of ROCm, PyTorch or kernel do not work as well causing either:
1. "Compile with \`TORCH_USE_HIP_DSA\` to enable device-side assertions" message
2. Crashing X11 every time calculations begin
3. Calculations going on forever with 100% GPU load and no characteristic noises coming out of the GPU, which means no actual work is being done
The only working solution seems to be is to build PyTorch and TorchVision from the source code with the support for gfx1010 architecture explicitly on.
The resulting Python wheels were tested with [chaiNNer](https://github.com/chaiNNer-org/chaiNNer) and [ComfyUI](https://github.com/comfyanonymous/ComfyUI) and both seem to work fine.
Building Requirements
--
build-essential
cmake
python3
git
ROCm (for ROCm build)
To begin with you have to install ROCm. Unfortunately you have to trust AMD here: although ROCm is open-source building it from the source is another enormous task. Good news is that despite the instructions from AMD there is no actual need to install the proprietary amdgpu driver (amdgpu-dkms) and that the upcoming Debian 13 (trixie) will have ROCm in its repositories out of the box.
Download and install *amdgpu-install* as described [here](https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/install-methods/amdgpu-installer/amdgpu-installer-debian.html). Then execute `apt install rocm` as root.
Then install all the rest of the requirements using the usual `apt install`.
Prepare
--
Create and activate a venv:
python3 -m venv pytorch
cd pytorch
source bin/activate
Later to exit the venv execute `deactivate`.
Building
--
The following instructions are given for PyTorch 2.6, when a new version arrives just replace 2.6 with the new numbers.
git clone https://github.com/pytorch/pytorch.git --branch=release/2.6 --recurse-submodules pytorch-release-2.6-git
cd pytorch-release-2.6-git
pip install -r requirements.txt
python3 tools/amd_build/build_amd.py
MAX_JOBS=$(nproc) CMAKE_BUILD_PARALLEL_LEVEL=$(nproc) CMAKE_POLICY_VERSION_MINIMUM=3.5 PYTORCH_ROCM_ARCH=gfx1010 python3 setup.py bdist_wheel
The resulting wheel will be in the *dist* directory. Be patient, build takes a very long time even on modern 8-core CPUs.
To later build TorchVision and/or TorchAudio you have to install PyTorch in the same venv:
pip install pytorch-release-2.6-git/dist/torch-2.6.0a0+git1eba9b3-cp311-cp311-linux_x86_64.whl
Troubleshooting
--
If you get "all warnings being treated as errors" messages then do:
echo "set(CMAKE_C_FLAGS "${CMAKE_CXX_FLAGS} -Wno-error=maybe-uninitialized -Wno-error=uninitialized -Wno-error=restrict")" >> third_party/fbgemm/CMakeLists.txt
echo "set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -Wno-error=maybe-uninitialized -Wno-error=uninitialized -Wno-error=restrict")" >> third_party/fbgemm/CMakeLists.txt
If you get "error: use of undeclared identifier 'CK_BUFFER_RESOURCE_3RD_DWORD'" messages then you have to apply patches (read [here](https://github.com/ROCm/composable_kernel/issues/775#issuecomment-2725632592) about this issue):
git apply --directory=third_party/composable_kernel patches/3e23090b5b29d0eea3bbec0ee1b03a182894c831.patch
git apply --directory=third_party/composable_kernel patches/5465fcc9e25ab9828b9d34ce5d341a127ff8ea9e.patch
git apply --directory=third_party/composable_kernel patches/88952b6d4e6bea810aaa4c063bdaf5b8252acb1c.patch
If a patch cannot be applied it is probably not needed for your version of Torch, at least in my case `3e23090b5b29d0eea3bbec0ee1b03a182894c831.patch` could not be applied but the build still completed successfully.
TorchVision
--
git clone https://github.com/pytorch/vision.git --branch=release/0.21 --recurse-submodules vision-release-0.21-git
cd vision-release-0.21-git
MAX_JOBS=$(nproc) CMAKE_BUILD_PARALLEL_LEVEL=$(nproc) CMAKE_POLICY_VERSION_MINIMUM=3.5 python3 setup.py bdist_wheel
The resulting wheel will be in the *dist* directory.
TorchAudio
--
git clone https://github.com/pytorch/audio.git --branch=release/2.6 --recurse-submodules audio-release-2.6-git
cd audio-release-2.6-git
MAX_JOBS=$(nproc) CMAKE_BUILD_PARALLEL_LEVEL=$(nproc) CMAKE_POLICY_VERSION_MINIMUM=3.5 python3 setup.py bdist_wheel
The resulting wheel will be in the "dist" directory.
Using with chaiNNer
--
If you have a new installation then run chaiNNer, let it download all the basic components but don't install any dependencies.
Then execute:
cd /python/python/bin
./chainner_pip install
Replace and with paths to the wheels you built.
After that run chaiNNer and install all the rest of the dependencies, PyTorch and TorchVision should already be marked as installed.
If you already ran chaiNNer before and installed all dependencies then before installing the wheels execute:
./chainner_pip uninstall torch torchvision
Using with ComfyUI
--
Create and activate a venv:
python3 -m venv comfyui
cd comfyui
Clone the ComfyUI repository:
git clone https://github.com/comfyanonymous/ComfyUI.git
Open the `ComfyUI/requirements.txt` file in a text editor and comment out *torch*, *torchvision* and *torchaudio* (keep *torchsde*):
#torch
torchsde
#torchvision
#torchaudio
Install your torch, torchvision and torchaudio:
bin/pip install
Replace and with paths to the wheels you built.
Install the rest of the requirements:
bin/pip install -r ComfyUI/requirements.txt
Run ComfyUI:
bin/python main.py --bf16-vae
There is a [big discussion](https://github.com/comfyanonymous/ComfyUI/issues/5759) on how to prevent freezing using VAE decoding with similar GPUs, in general the conclusion is that adding `--bf16-vae` should be enough. Another potentially useful variant is:
MIOPEN_FIND_MODE=FAST python main.py --bf16-vae --reserve-vram 0.9
Torch for Vulkan (not required)
--
Torch can be built with the Vulkan backend which in theory would allow it to run without ROCm, but in practice unlike PyTorch for ROCm it is not a direct replacement for GeForce CUDA and should be explicitly supported by the end-user software. Therefore the following instructions are more like a bonus for those who one day may find such a software.
Additional requirement: `glslc`
All the instructions are the same as for ROCm, except for the build command:
MAX_JOBS=$(nproc) CMAKE_BUILD_PARALLEL_LEVEL=$(nproc) CMAKE_POLICY_VERSION_MINIMUM=3.5 USE_VULKAN=1 USE_VULKAN_SHADERC_RUNTIME=1 USE_VULKAN_WRAPPER=0 python3 setup.py bdist_wheel
If you get "is not a member of \‘torch::jit::cuda\’" errors then apply patch:
git apply patches/a72d9c3b7554b78a91a3d61b9041b3d1d7acf319.patch
Additional environment variables to try (untested):
USE_VULKAN_FP16_INFERENCE=ON
USE_VULKAN_RELAXED_PRECISION=ON