🐛 Describe the bug
CI details: Qwen2VLConfig, monkey patch impl related
Text config is seperated out from the general config in transformers>=4.52.0.
Qwen2VLRotaryEmbedding takes Qwen2VLTextConfig intead of Qwen2VLConfig now.
huggingface/transformers#37268
We also need to check all VLMs monkey patch since most models are refactored into TextModel and VisionModel
blocked on: huggingface/transformers#38331 (can walkaround by passing hidden_size and vocab_size to config dict directly though) fixed by huggingface/transformers#38372
Reproduce
No response
Versions
liger_kernel==0.5.9
transformers>=4.52.0
🐛 Describe the bug
CI details: Qwen2VLConfig, monkey patch impl related
Text config is seperated out from the general config in transformers>=4.52.0.
Qwen2VLRotaryEmbedding takes
Qwen2VLTextConfigintead ofQwen2VLConfignow.huggingface/transformers#37268
We also need to check all VLMs monkey patch since most models are refactored into TextModel and VisionModel
blocked on: huggingface/transformers#38331 (can walkaround by passing hidden_size and vocab_size to config dict directly though)fixed by huggingface/transformers#38372Reproduce
No response
Versions
liger_kernel==0.5.9
transformers>=4.52.0