Skip to content

[video utils] group and reorder by number of frames#38374

Merged
zucchini-nlp merged 1 commit intohuggingface:mainfrom
zucchini-nlp:video-group-reorder
May 27, 2025
Merged

[video utils] group and reorder by number of frames#38374
zucchini-nlp merged 1 commit intohuggingface:mainfrom
zucchini-nlp:video-group-reorder

Conversation

@zucchini-nlp
Copy link
Copy Markdown
Member

What does this PR do?

Fixes #38352. Though we cannot handle in transformers videos of different shapes (yet!), it seems to be failing for vLLM

This PR ensures that videos are grouped not only by frame size, but also number of frames. A small test added and is green for me locally

@zucchini-nlp zucchini-nlp requested a review from Cyrilvallez May 26, 2025 10:22
@zucchini-nlp zucchini-nlp added the for patch Tag issues / labels that should be included in the next patch label May 26, 2025
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Copy Markdown
Collaborator

@ArthurZucker ArthurZucker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the quick fix

@zucchini-nlp zucchini-nlp merged commit 19fdb75 into huggingface:main May 27, 2025
21 checks passed
ArthurZucker added a commit that referenced this pull request May 30, 2025
* make it go brrrr

* date time

* update

* fix

* up

* uppp

* up

* no number i

* udpate

* fix

* [paligemma] fix processor with suffix (#38365)

fix pg processor

* [video utils] group and reorder by number of frames (#38374)

fix

* Fix convert to original state dict for VLMs (#38385)

* fix convert to original state dict

* fix

* lint

* Update modeling_utils.py

* update

* warn

* no verbose

* fginal

* ouft

* style

---------

Co-authored-by: Raushan Turganbay <raushan@huggingface.co>
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

for patch Tag issues / labels that should be included in the next patch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

video_utils.group_videos_by_shape does not consider video length

3 participants