Add ControlNet #358
Add ControlNet #358
Conversation
Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
Signed-off-by: Walter Hugo Lopez Pinaya <ianonimato@hotmail.com>
There was a problem hiding this comment.
Nice Walter, looks good to me!
As I understand it, the ControlNet needs to be initalised with the same weights as the trained diffusion model. Should we provide a helper function for that? If you agree, we could do it in another PR as I know @virginiafdez is already working on a tutorial with this controlnet and don't want to hold up its merging anymore
|
Hello, For now, I''m not working on a GitHub branch of the repo, but offline as I need to make sure the model works and such. But yeah, I think maybe it's better to do it like @marksgraham says ! |
Thank you for the suggestion, @marksgraham . I agree, I think it will be great to have helpers to initialise the controlnets |
Implements #296