Add ONNX export support for DinoV2, Hiera, Maskformer, PVT, SigLIP, SwinV2, VitMAE, and VitMSN models#2001
Add ONNX export support for DinoV2, Hiera, Maskformer, PVT, SigLIP, SwinV2, VitMAE, and VitMSN models#2001
Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
|
@xenova Hi xenova! I think you missed to add official support for maskformer optimum/optimum/onnxruntime/modeling_ort.py Line 1773 in de07c7a |
| "feature-extraction", | ||
| "masked-im", |
There was a problem hiding this comment.
I think "image-feature-extraction" (or "feature-extraction") should be enough https://huggingface.co/datasets/huggingface/transformers-metadata/blob/main/pipeline_tags.json#L1128
| "feature-extraction", | |
| "masked-im", | |
| "feature-extraction", |
if not the correct class needed to load the model can be added to _CUSTOM_CLASSES : for vit-mae I only see AutoModel or AutoModelForPreTraining
| "vit-msn": supported_tasks_mapping( | ||
| "feature-extraction", | ||
| "image-classification", | ||
| "masked-im", |
There was a problem hiding this comment.
same I think can be removed :
| "masked-im", |
|
Also seems there is an issue for Maskformer for the feature-extraction task the expected output name seems to be "transformer_decoder_last_hidden_state" https://github.com/huggingface/transformers/blob/69e31eb1bf123d5bd0183b753da83ab7dd9c2eec/src/transformers/models/maskformer/modeling_maskformer.py#L1615 while feature-extraction gives "last_hidden_state", can be fixed by updating edit : should be fixed with 3fa346c |
|
Thanks so much @echarlaix! 🚀 |
What does this PR do?
Fixes # (issue)
Before submitting
Who can review?