Skip to content

v0.2.0#217

Merged
contentis merged 12 commits intomainfrom
dev
Jan 5, 2024
Merged

v0.2.0#217
contentis merged 12 commits intomainfrom
dev

Conversation

@contentis
Copy link
Collaborator

Features

  • Faster LoRA checkpoint conversion.
  • Combining multiple LoRAs at runtime.
  • Use prompt embedding for LoRA.
  • SDXL LoRA support.
  • Automatic engine selection.
  • Improved HIGHRES.FIX engine selection
  • PyTorch fallback.
  • Print the correct profile is loaded.

Minor

  • Use script callback to handle inference.
  • External data format for ONNX
  • Deleted dead code and duplications

@contentis contentis merged commit e2b6980 into main Jan 5, 2024
contentis added a commit that referenced this pull request Jan 8, 2024
…udnn-cu11 uninstall due to interactive python shell opening (#226)

* v0.2.0 (#217)

* fix typo (#79)

* Print correct profile when engine is loaded

* Use scripts callbacks

* increase max resolution

* adding native LoRA support, avoiding model.py import error and some refactoring

* more refactoring and added typing

* Enable torch fallback

* update inastall

* change default XL engine

* cc independent lora

* Update Instrucitons

---------

Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Fix subprocess blocking issue when installing

---------

Co-authored-by: Luca <lspindler@nvidia.com>
Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>
contentis added a commit that referenced this pull request Jan 9, 2024
* v0.2.0 (#217)

* fix typo (#79)

* Print correct profile when engine is loaded

* Use scripts callbacks

* increase max resolution

* adding native LoRA support, avoiding model.py import error and some refactoring

* more refactoring and added typing

* Enable torch fallback

* update inastall

* change default XL engine

* cc independent lora

* Update Instrucitons

---------

Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Resolve AttributeError on generation without Unet

---------

Co-authored-by: Luca <lspindler@nvidia.com>
Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>
contentis added a commit that referenced this pull request Feb 5, 2024
…udnn-cu11 uninstall due to interactive python shell opening (#226)

* v0.2.0 (#217)

* fix typo (#79)

* Print correct profile when engine is loaded

* Use scripts callbacks

* increase max resolution

* adding native LoRA support, avoiding model.py import error and some refactoring

* more refactoring and added typing

* Enable torch fallback

* update inastall

* change default XL engine

* cc independent lora

* Update Instrucitons

---------

Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Fix subprocess blocking issue when installing

---------

Co-authored-by: Luca <lspindler@nvidia.com>
Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>
contentis added a commit that referenced this pull request Feb 5, 2024
* v0.2.0 (#217)

* fix typo (#79)

* Print correct profile when engine is loaded

* Use scripts callbacks

* increase max resolution

* adding native LoRA support, avoiding model.py import error and some refactoring

* more refactoring and added typing

* Enable torch fallback

* update inastall

* change default XL engine

* cc independent lora

* Update Instrucitons

---------

Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Resolve AttributeError on generation without Unet

---------

Co-authored-by: Luca <lspindler@nvidia.com>
Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>
contentis added a commit that referenced this pull request Mar 13, 2024
* fix typo (#79)

* Faster and simplified install

* Print correct profile when engine is loaded

* Use scripts callbacks

* increase max resolution

* adding native LoRA support, avoiding model.py import error and some refactoring

* more refactoring and added typing

* Enable torch fallback

* update inastall

* change default XL engine

* cc independent lora

* Update Instrucitons

* Fix for #225 Install.py silently blocked by blocking call of nvidia-cudnn-cu11 uninstall due to interactive python shell opening (#226)

* v0.2.0 (#217)

* fix typo (#79)

* Print correct profile when engine is loaded

* Use scripts callbacks

* increase max resolution

* adding native LoRA support, avoiding model.py import error and some refactoring

* more refactoring and added typing

* Enable torch fallback

* update inastall

* change default XL engine

* cc independent lora

* Update Instrucitons

---------

Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Fix subprocess blocking issue when installing

---------

Co-authored-by: Luca <lspindler@nvidia.com>
Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Resolve AttributeError on generation without Unet (#224)

* v0.2.0 (#217)

* fix typo (#79)

* Print correct profile when engine is loaded

* Use scripts callbacks

* increase max resolution

* adding native LoRA support, avoiding model.py import error and some refactoring

* more refactoring and added typing

* Enable torch fallback

* update inastall

* change default XL engine

* cc independent lora

* Update Instrucitons

---------

Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Resolve AttributeError on generation without Unet

---------

Co-authored-by: Luca <lspindler@nvidia.com>
Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>

* Fixes crashes cause by lora checkpoint configs missing sd version (#251)

During the initial Lora loading process, if a config for a specified **.safetensor** file does not contain the property **"sd version"**, the plugin crashes and does not show the trt tab. 

fixes the issue by inferencing the model version as unknown

* Fix AttributeError when accessing profile_idx of NoneType (#259)

* fix #157

---------

Co-authored-by: Rudra <92840555+Rudra-Ji@users.noreply.github.com>
Co-authored-by: Andrew Vuong <andrewtvuong@utexas.edu>
Co-authored-by: Aether <59086566+AetherMagee@users.noreply.github.com>
Co-authored-by: ZN <72399198+Zn10plays@users.noreply.github.com>
Co-authored-by: Yuki Shindo <shinshin86@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants