Skip to content

Commit bb7fb66

Browse files
committed
update
1 parent 8163687 commit bb7fb66

File tree

1 file changed

+6
-2
lines changed

1 file changed

+6
-2
lines changed

docs/source/en/quantization/quanto.md

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -85,8 +85,12 @@ from diffusers import FluxTransformer2DModel, QuantoConfig
8585

8686
model_id = "black-forest-labs/FLUX.1-dev"
8787
quantization_config = QuantoConfig(weights_dtype="float8")
88-
transformer = FluxTransformer2DModel.from_pretrained(model_id, quantization_config=quantization_config, torch_dtype=torch.bfloat16)
89-
88+
transformer = FluxTransformer2DModel.from_pretrained(
89+
model_id,
90+
subfolder="transformer",
91+
quantization_config=quantization_config,
92+
torch_dtype=torch.bfloat16,
93+
)
9094
# save quantized model to reuse
9195
transformer.save_pretrained("<your quantized model save path>")
9296

0 commit comments

Comments
 (0)