Update README.md

README.md

@@ -1,3 +1,23 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+base_model:
+- THUDM/CogView4-6B
+base_model_relation: quantized
+tags:
+- quanto
+---
+## Quantization settings
+
+- `vae.`: `torch.bfloat16`. No quantization.
+- `text_encoder.layers.`:
+  - Int8 with [Optimum Quanto](https://github.com/huggingface/optimum-quanto)
+  - Target layers:`["q_proj", "k_proj", "v_proj", "o_proj", "mlp.down_proj", "mlp.gate_up_proj"]`
+- `diffusion_model.`:
+  - Int8 with [Optimum Quanto](https://github.com/huggingface/optimum-quanto)
+  - Target layers: `["to_q", "to_k", "to_v", "to_out.0", "ff.net.0.proj", "ff.net.2"]`
+
+## VRAM cosumption
+
+- Text encoder (`text_encoder.`): about 11 GB
+- Denoiser (`diffusion_model.`): about 10 GB
+- VAE (`vae.`): about 1.5 GB