Support for AMD ROCm compatible GPUs.

[cupertinomiranda]

This patch adds support for AMD ROCm capable GPUs to the project, for Linux at the moment.

Hope you find the implementation sane and complete.
I have been using it for the last couple of days with great success.

[dkspwndj]

No plan at windows radeon support?

[cupertinomiranda]

No plan at windows radeon support?

If by Radeon support you mean any card that has ROCm support, then the answer is yes. However, I will need some time to setup a windows environment to try it. It would be nice if someone with a Windows setup could contribute it, considering that it could be a very easy patch.

It works with other low end cards as well. It is in no way limited to the AI PRO R9700.

[ptelder]

This command will fail on systems with an inactive AMD iGPU in addition to an AMD discrete GPU.

The amd-smi metric JSON returns an empty usage attribute in gpu_data for an inactive iGPU looking like:

"usage": "N/A",

[ptelder]

There's an issue for systems with an inactive iGPU on line 147 of ui/src/app/api/gpu/route.ts. The JSON returned for an inactive iGPU has an empty usage attribute.

Here's what the first chunk of an iGPU looks like:

"gpu_data": [
    {
        "gpu": 1,
        "usage": "N/A",
        "power": {
            "socket_power": "N/A",
            "gfx_voltage": "N/A",
            "soc_voltage": "N/A",
            "mem_voltage": "N/A",
            "throttle_status": "N/A",
            "power_management": "N/A"
        },

The missing data kills the parsing and prevents other GPUs from being detected.

[cupertinomiranda]

Thanks for the comment. Will change the patch with a renewed improved version.

[peyloride]

Update, latest bitsandbytes packages now include rocm support. I was able to run with it and your changes.