Instructions to use MutantSparrow/LowBitMoss with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusion Single File
How to use MutantSparrow/LowBitMoss with Diffusion Single File:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
MutantSparrow commited on
Commit ·
6f25ffe
1
Parent(s): c9c6a93
Add visual model-card evidence and README banner
Browse files- README.md +9 -0
- SHA256SUMS.txt +5 -2
- assets/banner.png +3 -0
- evidence/model-cards/MODELCARD_mixG_tuned.png +3 -0
- evidence/model-cards/MODELCARD_mixG_x.png +3 -0
- release-manifest.json +14 -2
README.md
CHANGED
|
@@ -23,6 +23,8 @@ language:
|
|
| 23 |
|
| 24 |
**Low-bit MOSS-Image for consumer hardware**
|
| 25 |
|
|
|
|
|
|
|
| 26 |
[](https://github.com/MutantSparrow/LowBitMoss)
|
| 27 |
[](https://huggingface.co/MutantSparrow/LowBitMoss)
|
| 28 |
[](https://github.com/MutantSparrow/LowBitMoss/blob/main/paper/whitepaper.pdf)
|
|
@@ -36,6 +38,13 @@ The **7.18 GB small distilled package** combines a 2.14 GB DiT, a 4.93 GB pruned
|
|
| 36 |
|
| 37 |
**Author's hands-on validation.** I have also manually benchmarked the models and reviewed their outputs, and I am satisfied with the results. The images have a softer rendering style, but the models retain a surprising amount of visual information and image quality. This is my qualitative assessment from hands-on use; the numerical results in the paper refer to the evaluation configurations described above.
|
| 38 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
## Abstract
|
| 40 |
|
| 41 |
LowBitMoss explores how mixed-precision quantization can bring MOSS-Image SFT diffusion transformers to consumer hardware. We apply block-wise quantization-aware distillation on a single 16 GB GPU to the 5.08B-parameter DiT, combining learnable group scales, student-stream inputs, and low-rank corrections. Released DiT files occupy 1.72-2.93 GB, compared with 10.16 GB for the bf16 teacher. On 24 prompts at 768 px, the 2.14 GB mixG_tuned model achieves model-judge acceptance of 4.21/5 and letter-exact rendering of all six text prompts. The 1.85 GB and 1.72 GB variants broaden the available storage options.
|
|
|
|
| 23 |
|
| 24 |
**Low-bit MOSS-Image for consumer hardware**
|
| 25 |
|
| 26 |
+
<a href="https://huggingface.co/MutantSparrow/LowBitMoss/resolve/main/assets/banner.png"><img src="https://huggingface.co/MutantSparrow/LowBitMoss/resolve/main/assets/banner.png" alt="LowBitMoss example generations across photography, illustration, and text" width="960"></a>
|
| 27 |
+
|
| 28 |
[](https://github.com/MutantSparrow/LowBitMoss)
|
| 29 |
[](https://huggingface.co/MutantSparrow/LowBitMoss)
|
| 30 |
[](https://github.com/MutantSparrow/LowBitMoss/blob/main/paper/whitepaper.pdf)
|
|
|
|
| 38 |
|
| 39 |
**Author's hands-on validation.** I have also manually benchmarked the models and reviewed their outputs, and I am satisfied with the results. The images have a softer rendering style, but the models retain a surprising amount of visual information and image quality. This is my qualitative assessment from hands-on use; the numerical results in the paper refer to the evaluation configurations described above.
|
| 40 |
|
| 41 |
+
## Visual evidence
|
| 42 |
+
|
| 43 |
+
Full-resolution visual model cards show example outputs across subjects, styles, text rendering, and complex prompts.
|
| 44 |
+
|
| 45 |
+
- [mixG_x model card (PNG)](https://huggingface.co/MutantSparrow/LowBitMoss/resolve/main/evidence/model-cards/MODELCARD_mixG_x.png)
|
| 46 |
+
- [mixG_tuned model card (PNG)](https://huggingface.co/MutantSparrow/LowBitMoss/resolve/main/evidence/model-cards/MODELCARD_mixG_tuned.png)
|
| 47 |
+
|
| 48 |
## Abstract
|
| 49 |
|
| 50 |
LowBitMoss explores how mixed-precision quantization can bring MOSS-Image SFT diffusion transformers to consumer hardware. We apply block-wise quantization-aware distillation on a single 16 GB GPU to the 5.08B-parameter DiT, combining learnable group scales, student-stream inputs, and low-rank corrections. Released DiT files occupy 1.72-2.93 GB, compared with 10.16 GB for the bf16 teacher. On 24 prompts at 768 px, the 2.14 GB mixG_tuned model achieves model-judge acceptance of 4.21/5 and letter-exact rendering of all six text prompts. The 1.85 GB and 1.72 GB variants broaden the available storage options.
|
SHA256SUMS.txt
CHANGED
|
@@ -3,8 +3,9 @@ a58b01ad36f1644c3ae2b30eee61078e7fccaf442d43b28d58bebb3ba7e66cd1 .gitattributes
|
|
| 3 |
c56b2014c09408266f8059dd25fdcfdd890f468240ce71e7b25a3f1d6210803d DATA.md
|
| 4 |
cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30 LICENSE
|
| 5 |
3dba711274d65b49a5c2bd92bc0f7cbd23cb7f599d3cb8f590043c92b205f959 NOTICE
|
| 6 |
-
|
| 7 |
71ca2235fd0fecc30822186c59da69ee55b9c369e56e66edf9809d18a8e3fb0b THIRD_PARTY_NOTICES.md
|
|
|
|
| 8 |
3b8fbe7d9dc818f1547ef9473720367a71b9663787e0d7488c49911594ba90d4 data/calib_512/p-t0000.pt
|
| 9 |
1ce8fc5220e18e87f42124b3ce07ba254e1481c77566f0f25c5b0d5c5f8a8db9 data/calib_512/p-t0001.pt
|
| 10 |
23cb854bf7f1c47f01d225b128726c4482e9704c413cd0abe4b790e13e3993ab data/calib_512/p-t0002.pt
|
|
@@ -4019,6 +4020,8 @@ e1de232f64628ef5830c40d20b48307c0cda26dd19b881b0bde14bc3aef720bb eval/v_ffn_mid
|
|
| 4019 |
bc75ad6c7c80975157507b1b9812bf98ec1319125c4f9b6f46bc1e06dd6e2ba4 eval/v_ffn_mid3/latents/10_seed3001.latent
|
| 4020 |
08bcb025b4bcdfc10b3bc3d5faa183ee0aeee32c16ed91baf40c4969aabe0f71 eval/v_ffn_mid3/latents/14_seed4001.latent
|
| 4021 |
8c6aa5ef4c5d8462a033867384605dbd0ad9af9b9229039b95d176c2ba5fc636 eval/v_ffn_mid3/latents/15_seed4002.latent
|
|
|
|
|
|
|
| 4022 |
cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30 licenses/OpenMOSS-Team--MOSS-Image-SFT--LICENSE
|
| 4023 |
bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a licenses/Qwen--Qwen3.5-9B--LICENSE
|
| 4024 |
715266eabd1d6aa98e8f03f6cc90b237ac53ccdcdbb23642e4dfd36a5fc6d6bb licenses/sources.json
|
|
@@ -4065,7 +4068,7 @@ d9d81b071d446cd7391b7c0d156be038f6c6ddf5f273e6b083aa4a9dfd83aa45 paper/whitepap
|
|
| 4065 |
c85d3050b830a2a48d1c30ce3cb0bf82b84a2de2ad3bcea753f9fa466cb08298 prompts/calib_prompts.json
|
| 4066 |
77777cb798f4580f992b8534ca73d4095056183cdba87544b9808d818e50af44 prompts/calib_text_prompts.json
|
| 4067 |
38debc6129c47f14fe30351d3ed29b1ec1a8b70882489683b0acc66614cb5a1f prompts/eval_prompts.json
|
| 4068 |
-
|
| 4069 |
bfd42d73586f52bdb4397e219d9b95441b1af84b3f9212c7286cdc509928d274 text_encoder/qwen3.5_9b_w4a8_gptq_pruned.safetensors
|
| 4070 |
6689491a55e03345d31e0521965d64ed29187f7768f00d456a9a1181ddd10321 vae/flux2-small-decoder-vae.safetensors
|
| 4071 |
ea4273f02d1fafbf8e1d1c2cf6018ed8748652eb0bf34f2dd91171f16f15ab62 vae/flux2-vae-small-decoder.safetensors
|
|
|
|
| 3 |
c56b2014c09408266f8059dd25fdcfdd890f468240ce71e7b25a3f1d6210803d DATA.md
|
| 4 |
cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30 LICENSE
|
| 5 |
3dba711274d65b49a5c2bd92bc0f7cbd23cb7f599d3cb8f590043c92b205f959 NOTICE
|
| 6 |
+
805e6e8139c02ddbfaba38135b3b39369a0e04704000c4d5a1ffcfc5cc2df73f README.md
|
| 7 |
71ca2235fd0fecc30822186c59da69ee55b9c369e56e66edf9809d18a8e3fb0b THIRD_PARTY_NOTICES.md
|
| 8 |
+
579ddf41e80ce1ad2ef764b3a608c19f08afa6a912a491b8ca3b8e7e3a0ecc3d assets/banner.png
|
| 9 |
3b8fbe7d9dc818f1547ef9473720367a71b9663787e0d7488c49911594ba90d4 data/calib_512/p-t0000.pt
|
| 10 |
1ce8fc5220e18e87f42124b3ce07ba254e1481c77566f0f25c5b0d5c5f8a8db9 data/calib_512/p-t0001.pt
|
| 11 |
23cb854bf7f1c47f01d225b128726c4482e9704c413cd0abe4b790e13e3993ab data/calib_512/p-t0002.pt
|
|
|
|
| 4020 |
bc75ad6c7c80975157507b1b9812bf98ec1319125c4f9b6f46bc1e06dd6e2ba4 eval/v_ffn_mid3/latents/10_seed3001.latent
|
| 4021 |
08bcb025b4bcdfc10b3bc3d5faa183ee0aeee32c16ed91baf40c4969aabe0f71 eval/v_ffn_mid3/latents/14_seed4001.latent
|
| 4022 |
8c6aa5ef4c5d8462a033867384605dbd0ad9af9b9229039b95d176c2ba5fc636 eval/v_ffn_mid3/latents/15_seed4002.latent
|
| 4023 |
+
b191ba5d813fd623303f9903dac5dfc5d98548d2f173dc93a480bd83796dc012 evidence/model-cards/MODELCARD_mixG_tuned.png
|
| 4024 |
+
3cfdcac4277a4d766b767f91bb84ee5cea80460ad43e962657dbb2ecf3d99481 evidence/model-cards/MODELCARD_mixG_x.png
|
| 4025 |
cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30 licenses/OpenMOSS-Team--MOSS-Image-SFT--LICENSE
|
| 4026 |
bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a licenses/Qwen--Qwen3.5-9B--LICENSE
|
| 4027 |
715266eabd1d6aa98e8f03f6cc90b237ac53ccdcdbb23642e4dfd36a5fc6d6bb licenses/sources.json
|
|
|
|
| 4068 |
c85d3050b830a2a48d1c30ce3cb0bf82b84a2de2ad3bcea753f9fa466cb08298 prompts/calib_prompts.json
|
| 4069 |
77777cb798f4580f992b8534ca73d4095056183cdba87544b9808d818e50af44 prompts/calib_text_prompts.json
|
| 4070 |
38debc6129c47f14fe30351d3ed29b1ec1a8b70882489683b0acc66614cb5a1f prompts/eval_prompts.json
|
| 4071 |
+
bbded9a987c783cb5af2bae6fc8f79d7f9eec96141d197fa1ff44fe89c3758ef release-manifest.json
|
| 4072 |
bfd42d73586f52bdb4397e219d9b95441b1af84b3f9212c7286cdc509928d274 text_encoder/qwen3.5_9b_w4a8_gptq_pruned.safetensors
|
| 4073 |
6689491a55e03345d31e0521965d64ed29187f7768f00d456a9a1181ddd10321 vae/flux2-small-decoder-vae.safetensors
|
| 4074 |
ea4273f02d1fafbf8e1d1c2cf6018ed8748652eb0bf34f2dd91171f16f15ab62 vae/flux2-vae-small-decoder.safetensors
|
assets/banner.png
ADDED
|
Git LFS Details
|
evidence/model-cards/MODELCARD_mixG_tuned.png
ADDED
|
Git LFS Details
|
evidence/model-cards/MODELCARD_mixG_x.png
ADDED
|
Git LFS Details
|
release-manifest.json
CHANGED
|
@@ -25,13 +25,17 @@
|
|
| 25 |
"sha256": "3dba711274d65b49a5c2bd92bc0f7cbd23cb7f599d3cb8f590043c92b205f959"
|
| 26 |
},
|
| 27 |
"README.md": {
|
| 28 |
-
"bytes":
|
| 29 |
-
"sha256": "
|
| 30 |
},
|
| 31 |
"THIRD_PARTY_NOTICES.md": {
|
| 32 |
"bytes": 1850,
|
| 33 |
"sha256": "71ca2235fd0fecc30822186c59da69ee55b9c369e56e66edf9809d18a8e3fb0b"
|
| 34 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
"data/calib_512/p-t0000.pt": {
|
| 36 |
"bytes": 18448879,
|
| 37 |
"sha256": "3b8fbe7d9dc818f1547ef9473720367a71b9663787e0d7488c49911594ba90d4"
|
|
@@ -16088,6 +16092,14 @@
|
|
| 16088 |
"bytes": 1179744,
|
| 16089 |
"sha256": "8c6aa5ef4c5d8462a033867384605dbd0ad9af9b9229039b95d176c2ba5fc636"
|
| 16090 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16091 |
"licenses/OpenMOSS-Team--MOSS-Image-SFT--LICENSE": {
|
| 16092 |
"bytes": 11358,
|
| 16093 |
"sha256": "cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30"
|
|
|
|
| 25 |
"sha256": "3dba711274d65b49a5c2bd92bc0f7cbd23cb7f599d3cb8f590043c92b205f959"
|
| 26 |
},
|
| 27 |
"README.md": {
|
| 28 |
+
"bytes": 9817,
|
| 29 |
+
"sha256": "805e6e8139c02ddbfaba38135b3b39369a0e04704000c4d5a1ffcfc5cc2df73f"
|
| 30 |
},
|
| 31 |
"THIRD_PARTY_NOTICES.md": {
|
| 32 |
"bytes": 1850,
|
| 33 |
"sha256": "71ca2235fd0fecc30822186c59da69ee55b9c369e56e66edf9809d18a8e3fb0b"
|
| 34 |
},
|
| 35 |
+
"assets/banner.png": {
|
| 36 |
+
"bytes": 7617691,
|
| 37 |
+
"sha256": "579ddf41e80ce1ad2ef764b3a608c19f08afa6a912a491b8ca3b8e7e3a0ecc3d"
|
| 38 |
+
},
|
| 39 |
"data/calib_512/p-t0000.pt": {
|
| 40 |
"bytes": 18448879,
|
| 41 |
"sha256": "3b8fbe7d9dc818f1547ef9473720367a71b9663787e0d7488c49911594ba90d4"
|
|
|
|
| 16092 |
"bytes": 1179744,
|
| 16093 |
"sha256": "8c6aa5ef4c5d8462a033867384605dbd0ad9af9b9229039b95d176c2ba5fc636"
|
| 16094 |
},
|
| 16095 |
+
"evidence/model-cards/MODELCARD_mixG_tuned.png": {
|
| 16096 |
+
"bytes": 19465245,
|
| 16097 |
+
"sha256": "b191ba5d813fd623303f9903dac5dfc5d98548d2f173dc93a480bd83796dc012"
|
| 16098 |
+
},
|
| 16099 |
+
"evidence/model-cards/MODELCARD_mixG_x.png": {
|
| 16100 |
+
"bytes": 19195520,
|
| 16101 |
+
"sha256": "3cfdcac4277a4d766b767f91bb84ee5cea80460ad43e962657dbb2ecf3d99481"
|
| 16102 |
+
},
|
| 16103 |
"licenses/OpenMOSS-Team--MOSS-Image-SFT--LICENSE": {
|
| 16104 |
"bytes": 11358,
|
| 16105 |
"sha256": "cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30"
|