Skip to content

Fix tests for Vision LLMs#30270

Closed
zucchini-nlp wants to merge 1 commit intohuggingface:mainfrom
zucchini-nlp:vision_lms_fixtest
Closed

Fix tests for Vision LLMs#30270
zucchini-nlp wants to merge 1 commit intohuggingface:mainfrom
zucchini-nlp:vision_lms_fixtest

Conversation

@zucchini-nlp
Copy link
Copy Markdown
Member

What does this PR do?

IDEFICS-2 pull request has added MODEL_FOR_VISION_2_SEQ_MAPPING_NAMES to the preparation of inputs in "test_modeling_common.py". That started causing test failures for composite vision language models, which do not have "seq_length" in their tester. This PR adds "seq_length" in a similar way "batch_size" was added to these models before.

All tests for the changed models are passing locally. Llava and other VLMs do not have a composite structure, so the tests are passing without a fix.

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@amyeroberts
Copy link
Copy Markdown
Contributor

Thanks for opening @zucchini-nlp and addressing so quickly! This should be fixed on main. I had a PR open to addressed - #30258 - and was waiting for review. Decided to merge to avoid red on main

@zucchini-nlp
Copy link
Copy Markdown
Member Author

Ah I see, thanks. I'll close this PR then :)

@zucchini-nlp zucchini-nlp deleted the vision_lms_fixtest branch April 17, 2024 07:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants