I was reading this interesting post about a new method of training Microsoft came up with. (Using LoRA for Efficient Stable Diffusion Fine-Tuning)
Full model fine-tuning of Stable Diffusion used to be slow and difficult, and that’s part of the reason why lighter-weight methods such as Dreambooth or Textual Inversion have become so popular. With LoRA, it is much easier to fine-tune a model on a custom dataset.
With LoRA, it is now possible to publish a single 3.29 MB file to allow others to use your fine-tuned model.
This would make at runtime downloads of models a lot easier too. The blog post includes an example and a link to a HuggingFace space UI.
Is this going to be implemented into this repo?