[Bug]: EHW Exception: unknown ext. buffer Id

[K1ngfish3r]

Which component impacted?

Encode

Is it regression? Good in old configuration?

No, this issue exist a long time

What happened?

The bug presented in #331 is still an issue.

I am using vpl-gpu-rt from AerynOS and since their main toolchain uses clang/llvm, I am experiecing this issue in version 26.1.2

Using the fix.patch in #331 (comment) fixes the issue, and would like to know if it can be merged into main

What's the usage scenario when you are seeing the problem?

Transcode for media delivery

What impacted?

No response

Debug Information

libva - 2.23.0
libva-utils - 2.23.0
gmmlib - 22.9.0
intel-media-driver - 25.3.4

$ ls /dev/dri
by-path/  card0  renderD128

vainfo.log

Do you want to contribute a patch to fix the issue?

Yes, please use fix.patch

[Bossonor]

Commit ae7c340 already included this fix.patch.

[K1ngfish3r]

Commit ae7c340 already included this fix.patch.

built vpl-gpu-rt at the commit, issue persists

log of test run at ae7c340

$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -c:v vp9_qsv -i "64 WEBM.webm" -c:v av1_qsv -global_quality 25 -c:a copy test.mkv
ffmpeg version 8.0.1 Copyright (c) 2000-2025 the FFmpeg developers
  built with clang version 21.1.8 (AerynOS)
  configuration: --prefix=/usr --cc=clang --cxx=clang++ --ld=clang++ --nm=llvm-nm --disable-static --disable-stripping --enable-lto --enable-shared --enable-gpl --enable-cuda-llvm --enable-ladspa --enable-lcms2 --enable-libaom --enable-libass --enable-libbs2b --enable-libcdio --enable-libdav1d --enable-libdrm --enable-libdvdnav --enable-libdvdread --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libharfbuzz --enable-libjxl --enable-liblc3 --enable-libmp3lame --enable-libmysofa --enable-libopenh264 --enable-libopus --enable-libplacebo --enable-libpulse --enable-libqrencode --enable-librav1e --enable-librsvg --enable-libshaderc --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libv4l2 --enable-libvorbis --enable-libvpl --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxcb --enable-libxml2 --enable-libzimg --enable-lv2 --enable-nvdec --enable-nvenc --enable-opencl --enable-opengl --enable-openssl --enable-vaapi --enable-vapoursynth --enable-version3 --enable-vulkan
  libavutil      60.  8.100 / 60.  8.100
  libavcodec     62. 11.100 / 62. 11.100
  libavformat    62.  3.100 / 62.  3.100
  libavdevice    62.  1.100 / 62.  1.100
  libavfilter    11.  4.100 / 11.  4.100
  libswscale      9.  1.100 /  9.  1.100
  libswresample   6.  1.100 /  6.  1.100
Input #0, matroska,webm, from '64 WEBM.webm':
  Metadata:
    COMPATIBLE_BRANDS: mp42isom
    MAJOR_BRAND     : mp42
    MINOR_VERSION   : 512
    ENCODER         : Lavf62.3.100
  Duration: 00:02:43.20, start: -0.007000, bitrate: 348 kb/s
  Stream #0:0: Video: vp9 (Profile 0), yuv420p(tv, bt709, progressive), 854x480, SAR 853:854 DAR 853:480, 30 fps, 30 tbr, 1k tbn (default)
    Metadata:
      ENCODER         : Lavc62.11.100 libvpx-vp9
      HANDLER_NAME    : VideoHandler
      VENDOR_ID       : [0][0][0][0]
      DURATION        : 00:02:43.200000000
  Stream #0:1: Audio: opus, 48000 Hz, mono, fltp, start -0.007000 (default)
    Metadata:
      ENCODER         : Lavc62.11.100 libopus
      HANDLER_NAME    : SoundHandler
      VENDOR_ID       : [0][0][0][0]
      DURATION        : 00:02:43.196000000
libva info: VA-API version 1.23.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
libva info: VA-API version 1.23.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
File 'test.mkv' already exists. Overwrite? [y/N] y
Stream mapping:
  Stream #0:0 -> #0:0 (vp9 (vp9_qsv) -> av1 (av1_qsv))
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
EHW Exception: unknown ext. buffer Id
[av1_qsv @ 0x56057d41f900] Error initializing the encoder: unknown error (-1)
[vost#0:0/av1_qsv @ 0x56057d41f480] [enc:av1_qsv @ 0x56057d41f880] Error while opening encoder - maybe incorrect parameters such as bit_rate, rate, width or height.
[vf#0:0 @ 0x56057d41fdc0] Error sending frames to consumers: Unknown error occurred
[vf#0:0 @ 0x56057d41fdc0] Task finished with error code: -1313558101 (Unknown error occurred)
[vf#0:0 @ 0x56057d41fdc0] Terminating thread with return code -1313558101 (Unknown error occurred)
[vost#0:0/av1_qsv @ 0x56057d41f480] [enc:av1_qsv @ 0x56057d41f880] Could not open encoder before EOF
[vost#0:0/av1_qsv @ 0x56057d41f480] Task finished with error code: -22 (Invalid argument)
[vost#0:0/av1_qsv @ 0x56057d41f480] Terminating thread with return code -22 (Invalid argument)
[out#0/matroska @ 0x56057d4161c0] Nothing was written into output file, because at least one of its streams received no packets.             
frame=    0 fps=0.0 q=0.0 Lsize=       0KiB time=N/A bitrate=N/A speed=N/A elapsed=0:00:00.01
Conversion failed!

log of test run with fix.patch at ae7c340

$ ffmpeg -hwaccel qsv -hwaccel_output_format qsv -c:v vp9_qsv -i "64 WEBM.webm" -c:v av1_qsv -global_quality 25 -c:a copy test.mkv
ffmpeg version 8.0.1 Copyright (c) 2000-2025 the FFmpeg developers
  built with clang version 21.1.8 (AerynOS)
  configuration: --prefix=/usr --cc=clang --cxx=clang++ --ld=clang++ --nm=llvm-nm --disable-static --disable-stripping --enable-lto --enable-shared --enable-gpl --enable-cuda-llvm --enable-ladspa --enable-lcms2 --enable-libaom --enable-libass --enable-libbs2b --enable-libcdio --enable-libdav1d --enable-libdrm --enable-libdvdnav --enable-libdvdread --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libharfbuzz --enable-libjxl --enable-liblc3 --enable-libmp3lame --enable-libmysofa --enable-libopenh264 --enable-libopus --enable-libplacebo --enable-libpulse --enable-libqrencode --enable-librav1e --enable-librsvg --enable-libshaderc --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libv4l2 --enable-libvorbis --enable-libvpl --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxcb --enable-libxml2 --enable-libzimg --enable-lv2 --enable-nvdec --enable-nvenc --enable-opencl --enable-opengl --enable-openssl --enable-vaapi --enable-vapoursynth --enable-version3 --enable-vulkan
  libavutil      60.  8.100 / 60.  8.100
  libavcodec     62. 11.100 / 62. 11.100
  libavformat    62.  3.100 / 62.  3.100
  libavdevice    62.  1.100 / 62.  1.100
  libavfilter    11.  4.100 / 11.  4.100
  libswscale      9.  1.100 /  9.  1.100
  libswresample   6.  1.100 /  6.  1.100
Input #0, matroska,webm, from '64 WEBM.webm':
  Metadata:
    COMPATIBLE_BRANDS: mp42isom
    MAJOR_BRAND     : mp42
    MINOR_VERSION   : 512
    ENCODER         : Lavf62.3.100
  Duration: 00:02:43.20, start: -0.007000, bitrate: 348 kb/s
  Stream #0:0: Video: vp9 (Profile 0), yuv420p(tv, bt709, progressive), 854x480, SAR 853:854 DAR 853:480, 30 fps, 30 tbr, 1k tbn (default)
    Metadata:
      ENCODER         : Lavc62.11.100 libvpx-vp9
      HANDLER_NAME    : VideoHandler
      VENDOR_ID       : [0][0][0][0]
      DURATION        : 00:02:43.200000000
  Stream #0:1: Audio: opus, 48000 Hz, mono, fltp, start -0.007000 (default)
    Metadata:
      ENCODER         : Lavc62.11.100 libopus
      HANDLER_NAME    : SoundHandler
      VENDOR_ID       : [0][0][0][0]
      DURATION        : 00:02:43.196000000
libva info: VA-API version 1.23.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
libva info: VA-API version 1.23.0
libva info: User environment variable requested driver 'iHD'
libva info: Trying to open /usr/lib/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_22
libva info: va_openDriver() returns 0
File 'test.mkv' already exists. Overwrite? [y/N] y
Stream mapping:
  Stream #0:0 -> #0:0 (vp9 (vp9_qsv) -> av1 (av1_qsv))
  Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
Output #0, matroska, to 'test.mkv':
  Metadata:
    COMPATIBLE_BRANDS: mp42isom
    MAJOR_BRAND     : mp42
    MINOR_VERSION   : 512
    encoder         : Lavf62.3.100
  Stream #0:0: Video: av1 (AV01 / 0x31305641), qsv(tv, bt709, progressive), 854x480 [SAR 853:854 DAR 853:480], q=2-31, 30 fps, 1k tbn (default)
    Metadata:
      encoder         : Lavc62.11.100 av1_qsv
      HANDLER_NAME    : VideoHandler
      VENDOR_ID       : [0][0][0][0]
      DURATION        : 00:02:43.200000000
  Stream #0:1: Audio: opus ([255][255][255][255] / 0xFFFFFFFF), 48000 Hz, mono, fltp (default)
    Metadata:
      ENCODER         : Lavc62.11.100 libopus
      HANDLER_NAME    : SoundHandler
      VENDOR_ID       : [0][0][0][0]
      DURATION        : 00:02:43.196000000
[opus @ 0x563513d524c0] Error parsing Opus packet header.5.36 bitrate= 661.4kbits/s speed=77.7x elapsed=0:00:02.00
[out#0/matroska @ 0x563513d8b1c0] video:11192KiB audio:1442KiB subtitle:0KiB other streams:0KiB global headers:0KiB muxing overhead: 0.617450%
frame= 4896 fps=2339 q=-0.0 Lsize=   12712KiB time=00:02:43.16 bitrate= 638.2kbits/s speed=  78x elapsed=0:00:02.09

[theonlychant]

ok I tried to look into the issue and I think the issue occurs because mfxExtAV1AuxData in ts_ext_buffers_decl.h is guarded by #if defined(__MFXAV1_H__) in the api\mediadisk_structures\ts_ext_buffers_decl.h . When building with Clang/LLVM, mfxav1.h is not included before mfx_utils_extbuf.h so the processes ts_ext_buffers_decl.h, so the AV1 buffer ID is never registered. This leads to the runtime exception: unknown ext. buffer Id now I am not sure if it was because of the missing lib but let me know if that helps

[K1ngfish3r]

ok I tried to look into the issue and I think the issue occurs because mfxExtAV1AuxData in ts_ext_buffers_decl.h is guarded by #if defined(__MFXAV1_H__) in the api\mediadisk_structures\ts_ext_buffers_decl.h . When building with Clang/LLVM, mfxav1.h is not included before mfx_utils_extbuf.h so the processes ts_ext_buffers_decl.h, so the AV1 buffer ID is never registered. This leads to the runtime exception: unknown ext. buffer Id now I am not sure if it was because of the missing lib but let me know if that helps

I built vpl-gpu-rt with this PR and I can say that it solves the issue!
vpl-gpu-rt was built on tag 26.1.3 + your PR