You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update lora.md with a more accurate description of rank (#6724)
* Update lora.md with a more accurate description of rank
* Update docs/source/en/training/lora.md
Co-authored-by: Steven Liu <[email protected]>
---------
Co-authored-by: Steven Liu <[email protected]>
Many of the basic and important parameters are described in the [Text-to-image](text2image#script-parameters) training guide, so this guide just focuses on the LoRA relevant parameters:
106
106
107
-
-`--rank`: the number of low-rank matrices to train
107
+
-`--rank`: the inner dimension of the low-rank matrices to train; a higher rank means more trainable parameters
108
108
-`--learning_rate`: the default learning rate is 1e-4, but with LoRA, you can use a higher learning rate
0 commit comments