Skip to content

Conversation

@CaffreyR
Copy link

@CaffreyR CaffreyR commented Dec 17, 2023

What does this PR do?

Fix bugs of Stable Diffusion mentioned in #6201 , might could merge together with #6135

Fixes #6201

Before submitting

Who can review?

@patrickvonplaten and @sayakpaul
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

@sayakpaul
Copy link
Member

Cc: @williamberman here.

lora_scale=lora_scale,
clip_skip=self.clip_skip,
)
if prompt_embeds is None and negative_prompt_embeds is None:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is not correct. Even if prompt_embeds is not None self.encode_prompt should be called (see how the prompt_embeds variable is passed to the function)

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then please see https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/train_dreambooth_lora.py#L1239,
when prompt_embeds is given, the model does not give prompt to the pipeline.

@github-actions
Copy link
Contributor

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@github-actions github-actions bot added the stale Issues that haven't received updates label Jan 18, 2024
@github-actions github-actions bot closed this Jan 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

stale Issues that haven't received updates

Projects

None yet

Development

Successfully merging this pull request may close these issues.

pipeline_stable_diffusion.py trys to encode the prompt when there is no prompt and prompt_embeds and negative_prompt_embeds are given

3 participants