Update Weights

.gitattributes

@@ -1,3 +1,5 @@
+*.png filter=lfs diff=lfs merge=lfs -text
+*.jpg filter=lfs diff=lfs merge=lfs -text
 *.7z filter=lfs diff=lfs merge=lfs -text
 *.arrow filter=lfs diff=lfs merge=lfs -text
 *.bin filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,151 @@
 ---
 license: apache-2.0
+library_name: videox_fun
 ---
+
+# Z-Image-Fun-Lora-Distill
+
+[![Github](https://img.shields.io/badge/🎬%20Code-VideoX_Fun-blue)](https://github.com/aigc-apps/VideoX-Fun)
+
+
+## Model Card
+
+| Name | Description |
+|--|--|
+| Z-Image-Fun-Lora-Distill-8-Steps.safetensors | This is a Distill LoRA for Z-Image that distills both steps and CFG. This model does not require CFG and uses 8 steps for inference. |
+
+## Model Features
+- This is a Distill LoRA for Z-Image that distills both steps and CFG.  It does not use any Z-Image-Turbo related weights and is trained from scratch. It is compatible with other Z-Image LoRAs and [Controls](https://huggingface.co/alibaba-pai/Z-Image-Fun-Controlnet-Union-2.1).
+- This model will slightly reduce the output quality and change the output composition of the model. For specific comparisons, please refer to the Results section. In most cases, the Distill LoRA performs well; currently, the biggest issue is that it may make the generated results brighter.
+- The purpose of this model is to provide fast generation compatibility for Z-Image derivative models, not to replace Z-Image-Turbo.
+
+## TODO
+- Optimize the output brightness; 
+- Train a 4-step LoRA.
+
+## Results
+### Work itself
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="results/output1.png" width="100%" /></td>
+    <td><img src="results/output1_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="results/output2.png" width="100%" /></td>
+    <td><img src="results/output2_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="results/output3.png" width="100%" /></td>
+    <td><img src="results/output3_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="results/output4.png" width="100%" /></td>
+    <td><img src="results/output4_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+### Work with Controlnet
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Pose + Inpaint</td>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="asset/inpaint.jpg" width="100%" /><img src="asset/mask.jpg" width="100%" /></td>
+    <td><img src="results/inpaint.png" width="100%" /></td>
+    <td><img src="results/inpaint_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Pose + Inpaint</td>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="asset/inpaint.jpg" width="100%" /><img src="asset/mask.jpg" width="100%" /><img src="asset/pose.jpg" width="100%" /></td>
+    <td><img src="results/pose_inpaint.png" width="100%" /></td>
+    <td><img src="results/pose_inpaint_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Pose</td>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="asset/pose2.jpg" width="100%" /></td>
+    <td><img src="results/pose2.png" width="100%" /></td>
+    <td><img src="results/pose2_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Pose</td>
+    <td>Output 25 steps</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="asset/pose4.jpg" width="100%" /></td>
+    <td><img src="results/pose4.png" width="100%" /></td>
+    <td><img src="results/pose4_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Canny</td>
+    <td>Output</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="asset/canny.jpg" width="100%" /></td>
+    <td><img src="results/canny.png" width="100%" /></td>
+    <td><img src="results/canny_8steps.png" width="100%" /></td>
+  </tr>
+</table>
+
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Depth</td>
+    <td>Output</td>
+    <td>Output 8 steps</td>
+  </tr>
+  <tr>
+    <td><img src="asset/gray.jpg" width="100%" /></td>
+    <td><img src="results/gray.png" width="100%" /></td>
+    <td><img src="results/gray_8steps.png" width="100%" /></td>
+  </tr>
+</table>

Z-Image-Fun-Lora-Distill-8-Steps.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18172fcd081c5ec7187fbe81efe141c76fbd6019f9ca0624fc22f00b9d856fa1
+size 200577236