ZImagePipeline Add Lora

[snz2]

Currently, ZImagePipeline does not support applying LoRA models. This limits the flexibility of the pipeline when trying to use specific styles or customized models.

I would like to request native support for LoRA in ZImagePipeline. Please enable the pipeline to apply LoRA weights.

[asomoza]

Hi, thanks for the issue, I'm adding a lora we can use to test this and track it: https://huggingface.co/renderartist/Technically-Color-Z-Image-Turbo

ccing: @sayakpaul

[sayakpaul]

@snz2 would you like to contribute the support? It's relatively easy to enable native LoRA support actually:

1. Create a ZImageLoraLoaderMixin class like this:

   diffusers/src/diffusers/loaders/lora_pipeline.py

   Line 5088 in b010a8c

   class Flux2LoraLoaderMixin(LoraBaseMixin):

2. Extend the corresponding ZImagePipeline to subclass from ZImageLoraLoaderMixin
3. That's it.

Additionally, we need to add a conversion function in case the LoRA isn't in the Diffusers format.

If you're not interested, that's fine too. I will get to it, soon.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[yiyixuxu]

fixed in #12750 it seems!