ROCm-AI-Installer

Installation scripts for an AI applications using ROCm on Linux.

Info:

Note

From version 10.0, the script is distribution-independent thanks to the use of Podman.
All you need is a correctly configured Podman and amdgpu.

Important

All models and applications are tested on a GPU with 24GB of VRAM.
Some applications may not work on GPUs with less VRAM.

Test platform:

Name	Info
CPU	AMD Ryzen 9 9950X3D
GPU	AMD Radeon 7900XTX
RAM	64GB DDR5 6600MHz
Motherboard	Gigabyte X870 AORUS ELITE WIFI7 (BIOS F8)
OS	Debian 13.2
Kernel	6.12.57+deb13-amd64

Text generation:

Name	Links	Additional information
KoboldCPP	https://github.com/YellowRoseCx/koboldcpp-rocm	Support GGML and GGUF models.
Text generation web UI	https://github.com/oobabooga/text-generation-webui https://github.com/ROCm/bitsandbytes.git https://github.com/turboderp/exllamav2	1. Support ExLlamaV2, llama.cpp and Transformers. 2. If you are using Transformers, it is recommended to use sdpa option instead of flash_attention_2.
SillyTavern	https://github.com/SillyTavern/SillyTavern
llama.cpp	https://github.com/ggerganov/llama.cpp	1. Put model.gguf into llama.cpp folder. 2. In run.sh file, change the values of GPU offload layers and context size to match your model.

SillyTavern Extensions:

Name	Link	Additional information
WhisperSpeech web UI	https://github.com/Mateusz-Dera/whisperspeech-webui	Install and run WhisperSpeech web UI first.

Image & video generation:

Name	Links	Additional information
ComfyUI	https://github.com/comfyanonymous/ComfyUI	Workflows templates are in the workflows folder.

ComfyUI Addons:

Name	Link	Additional information
ComfyUI-Manager	https://github.com/ltdrdata/ComfyUI-Manager	Manage nodes of ComfyUI. After first run change custom_nodes/ComfyUI-Manager/config.ini security_level to weak.
GGUF	https://github.com/calcuis/gguf	GGUF models loader.
ComfyUI-AuraSR	https://github.com/alexisrolland/ComfyUI-AuraSR https://huggingface.co/fal/AuraSR https://huggingface.co/fal/AuraSR-v2	ComfyUI node to upscale images.
AuraFlow-v0.3	https://huggingface.co/fal/AuraFlow-v0.3	Text to image model.
Qwen-Image GGUF	https://huggingface.co/Qwen/Qwen-Image https://huggingface.co/QuantStack/Qwen-Image-Edit-2509-GGUF https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI https://huggingface.co/lightx2v/Qwen-Image-Lightning	Text to image model. Qwen Image-Quant: Q6_K
Qwen-Image-Edit GGUF	https://huggingface.co/Qwen/Qwen-Image-Edit https://huggingface.co/calcuis/qwen-image-edit-ggu https://huggingface.co/Comfy-Org/Qwen-Image-Edit_ComfyUI https://huggingface.co/city96/Qwen-Image-gguf https://huggingface.co/lightx2v/Qwen-Image-Lightning	Text to image model. Qwen Image-Quant-Edit quant: Q4_K_M
Qwen-Image-Edit-2509 GGUF	https://huggingface.co/Qwen/Qwen-Image-Edit-2509 https://huggingface.co/calcuis/qwen-image-edit-gguf https://huggingface.co/Comfy-Org/Qwen-Image-Edit_ComfyUI https://huggingface.co/city96/Qwen-Image-gguf https://huggingface.co/lightx2v/Qwen-Image-Lightning	Text to image model. Qwen Image-Quant-Edit-2509 quant: Q4_0
Wan2.2-TI2V-5B	https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged	Text to video model. Workflow also supports image to video.
Z-Image-Turbo	https://huggingface.co/Tongyi-MAI/Z-Image-Turbo https://huggingface.co/Comfy-Org/z_image_turbo	Text to image model.

Music generation:

Name	Links	Additional information
ACE-Step	https://github.com/ace-step/ACE-Step

Voice generation:

Name	Links	Additional information
WhisperSpeech web UI	https://github.com/Mateusz-Dera/whisperspeech-webui https://github.com/collabora/WhisperSpeech
F5-TTS	https://github.com/SWivid/F5-TTS	Remember to select voice.
Matcha-TTS	https://github.com/shivammehta25/Matcha-TTS
Dia	https://github.com/nari-labs/dia https://github.com/tralamazza/dia/tree/optional-rocm-cuda	Script uses the optional-rocm-cuda fork by tralamazza.
KaniTTS	https://github.com/nineninesix-ai/kani-tts	If you want to change the default model, edit the kanitts/config.py file.

3D generation:

Name	Links	Additional information
PartCrafter	https://github.com/wgsxm/PartCrafter	Added custom simple UI. Uses a modified version of PyTorch Cluster for ROCm https://github.com/Mateusz-Dera/pytorch_cluster_rocm.
TRELLIS-AMD	https://github.com/CalebisGross/TRELLIS-AMD	GLB Export Takes 5-10 Minutes. Mesh preview may show grey, but the actual export works correctly.

Instalation:

1. Install Podman.

Note

If you are using Debian 13.2, you can use sudo apt-get update && sudo apt-get -y install podman podman-compose qemu-system (should also work on Ubuntu 24.04)

2. Make sure that /dev/dri and /dev/kfd are accessible.

ls /dev/dri
ls /dev/kfd

Important

Your distribution must have amdgpu configured.

3. Make sure that your user has permissions for the video and render groups.

sudo usermod -aG video,render $USER

Important

If not, you need reboot after this step.

4. Clone repository.

git clone https://github.com/Mateusz-Dera/ROCm-AI-Installer.git

5. Run installer.

./install.sh

6. Set variables

Note

By default, the script is configured for AMD Radeon 7900XTX.
For other cards and architectures, edit GFX and HSA_OVERRIDE_GFX_VERSION.

7. Create a container if you are upgrading or running the script for the first time.

8. Install the applications of your choice.

9. Go to the application folder and run:

./run.sh

Note

Everything is configured to start from the host side (You don't need to enter the container).

Container:

Checking the container

To check if the container is running:

podman ps

Starting the container

If the container is not running, start it with:

podman start rocm

Accessing container bash

To enter the container's bash shell:

podman exec -it rocm bash

Removing the container

To stop and remove the container:

podman stop rocm
podman rm rocm

Or force remove (stop and remove in one command):

podman rm -f rocm