Is it possible to run video test first?

[yanj-github]

Is it possible to prioritize video tests when both mixed audio and video tests are selected? Specifically, a "video test" refers to either a video-only test or a combined video-and-audio test.

When OF processes the recording, it starts by searching the QR code area. If a QR code area is detected for both the mezzanine and TR status, it stops and saves this area for cropping during QR code detection in the image frames. However, if the mezzanine QR code isn't found within the timeout, the process defaults to using the left half of the screen.

This fallback can negatively impact QR code detection accuracy, especially on small-screen devices. To mitigate this issue, it would be helpful if the test runner could re-arrange the tests to ensure that a test containing video always runs first.

[louaybassbouss]

@yanj-github the OF script should know that it analyses a Video Only/ Audio Only or Mixed Test from the QR code displayed between the tests and change the behaviour. We could add to change the order as a feature request, but in any case we need to run http tests before https tests.

[jpiesing]

@louaybassbouss Do you know if the W3C test runner has hooks to support this kind of re-ordering?

[louaybassbouss]

@jpiesing the default behaviour is sorting by pathname, but we can control the order if I am not wrong. the order http before https is added in WAVE TR because we run tests in a single window. If you run https tests first, it is not possible to go back http (redirect from https to http on almost all browsers not possible).

[yanj-github]

@yanj-github the OF script should know that it analyses a Video Only/ Audio Only or Mixed Test from the QR code displayed between the tests and change the behaviour. We could add to change the order as a feature request, but in any case we need to run http tests before https tests.

Thanks Louay,
If can have one video test as a 1st test it is fine. And yes I can see the concern where we have audio tests with only one https video test which it might not possible to run video test 1st.
Yes it can get ordering from API but what OF looking for is the time in the recording where it could see all QR codes to jump to. This is not at the stage of searching the QR code area.
At the moment user can provide --range to jump to the recording where it contains mezzanine QR code.
please see information here:
https://github.com/cta-wave/device-observation-framework?tab=readme-ov-file#additional-options
add '--range {id(file_index):start(s):duration(s)}'when you runs test.

[louaybassbouss]

let me check how easy to control the order and how to tell the TR which order to use. The TR does not know about video only, audio only or mixed tests. I think the best way could be to add a prefix to the group names like 1v (first prio is video), 2m (second is mixed) , 3a (third is audio only). Wdyt?

[yanj-github]

let me check how easy to control the order and how to tell the TR which order to use. The TR does not know about video only, audio only or mixed tests. I think the best way could be to add a prefix to the group names like 1v (first prio is video), 2m (second is mixed) , 3a (third is audio only). Wdyt?

Anything contains audio you can find "at"(audio track) from the name. e.g: regular-playback-of-a-cmaf-presentation__t1_at1.html
Can this be used for sorting please? If so you dont have to change much.