Throws an error when using Qwen2-vl On Mac

[chigkim]

There was a bug that prevents from Qwen2-vl to run on Mac. The fix has been merged to llama.cpp yesterday.
ggml-org#10896
Thanks!

[chigkim]

Here's the error:

ggml_metal_encode_node: error: unsupported op 'ROPE'
ggml/src/ggml-metal/ggml-metal.m:1263: unsupported op

[LostRuins]

I don't think wholesale disabling the GPU is a good idea. I'll wait and see if upstream develops a better solution - otherwise I'll only run clip on CPU for this specific model on macOS.

[chigkim]

Isn't that what the fix did for now? Only run clip on cpu on mac?

[LostRuins]

Fixed, please update

[chigkim]

Thanks it works now.