Skip to content

Commit 7f58a76

Browse files
xheditstevhliu
andauthored
Update lora.md with a more accurate description of rank (#6724)
* Update lora.md with a more accurate description of rank * Update docs/source/en/training/lora.md Co-authored-by: Steven Liu <[email protected]> --------- Co-authored-by: Steven Liu <[email protected]>
1 parent 09b7bfc commit 7f58a76

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/source/en/training/lora.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -104,7 +104,7 @@ accelerate launch train_text_to_image_lora.py \
104104

105105
Many of the basic and important parameters are described in the [Text-to-image](text2image#script-parameters) training guide, so this guide just focuses on the LoRA relevant parameters:
106106

107-
- `--rank`: the number of low-rank matrices to train
107+
- `--rank`: the inner dimension of the low-rank matrices to train; a higher rank means more trainable parameters
108108
- `--learning_rate`: the default learning rate is 1e-4, but with LoRA, you can use a higher learning rate
109109

110110
## Training script

0 commit comments

Comments
 (0)