From d70c8edb8c2a5fe8a0d797c39c3cb7857012db4d Mon Sep 17 00:00:00 2001 From: filipstrand Date: Wed, 17 Dec 2025 21:20:22 +0100 Subject: [PATCH] Add small README note on pre-quantized models on Huggingface --- README.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index fd7066f..70ebb67 100644 --- a/README.md +++ b/README.md @@ -861,9 +861,13 @@ mflux-generate-fibo \ --width 1024 \ --height 1024 \ --steps 20 \ - --seed 42 \ + --seed 42 ``` +⚠️ * Note: As of MFLUX v.0.13, some internal changes have been made which breaks compatibility with older pre-quantized models. +Newer ones will be uploaded, but in the meantime, you can always save a new quantized version from the original weights using the [mflux-save](#-saving-a-quantized-version-to-disk) command.* +To save disk space, you can delete the original full 16-bit model from the Huggingface cache after saving the quantized version. + --- ### 💽 Running a model directly from disk