Text-to-Video
Safetensors
MLX
Wan2.2
mlx-gen
mflux
apple-silicon
8-bit precision
mixed-q8-bf16
wan
video-generation
wan-a14b
Instructions to use AbstractFramework/wan2.2-t2v-a14b-diffusers-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AbstractFramework/wan2.2-t2v-a14b-diffusers-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir wan2.2-t2v-a14b-diffusers-8bit AbstractFramework/wan2.2-t2v-a14b-diffusers-8bit
- Wan2.2
How to use AbstractFramework/wan2.2-t2v-a14b-diffusers-8bit with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Improve validation summary readability
Browse files
README.md
CHANGED
|
@@ -44,17 +44,26 @@ See the [MLX-Gen quantization docs](https://github.com/lpalbou/mlx-gen/blob/main
|
|
| 44 |
|
| 45 |
## Local Validation
|
| 46 |
|
| 47 |
-
Validation used 384x224, 17 frames, 12 denoising steps, guidance 4, guidance-2 3, fps 8, and seed 4242 on Apple Silicon.
|
| 48 |
|
| 49 |
-
|
| 50 |
-
| --- | ---: | --- | --- | ---: | ---: | ---: | --- |
|
| 51 |
-
| Upstream source snapshot | 118 GiB | BF16 runtime from FP32/BF16 source files | release inactive denoiser | 32.99 GiB | 48.90 GiB | 108.31 s | Baseline source-cache run. |
|
| 52 |
-
| BF16 prepared folder | 64 GiB | BF16 | release inactive denoiser | 32.98 GiB | 45.12 GiB | 114.39 s | Output was byte-identical to the source-cache run. |
|
| 53 |
-
| This mixed q8/BF16 folder | 40 GiB | q8 transformer block linears, BF16 sensitive paths and VAE | release inactive denoiser | 20.84 GiB | 31.75 GiB | 110.34 s | Lower usage memory; not byte-identical to BF16 but passed side-by-side validation. |
|
| 54 |
-
| This mixed q8/BF16 folder | 40 GiB | q8 transformer block linears, BF16 sensitive paths and VAE | no denoiser release | 35.19 GiB | 50.55 GiB | 108.10 s | Retains both quantized A14B denoisers through decode. |
|
| 55 |
-
| This mixed q8/BF16 folder | 40 GiB | q8 transformer block linears, BF16 sensitive paths and VAE | low-RAM release | 15.48 GiB | 20.74 GiB | 108.70 s | Lowest measured usage-memory mode. |
|
| 56 |
|
| 57 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
|
| 59 |
## Compatibility
|
| 60 |
|
|
|
|
| 44 |
|
| 45 |
## Local Validation
|
| 46 |
|
| 47 |
+
Validation used 384x224, 17 frames, 12 denoising steps, guidance 4, guidance-2 3, fps 8, and seed 4242 on Apple Silicon. The memory numbers cover the full run from model init through video save. MLX peak is the MLX allocator peak; physical peak is the Darwin process physical footprint, which better reflects Apple Silicon unified-memory pressure than RSS alone.
|
| 48 |
|
| 49 |
+
Bottom line:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
+
- The BF16 package reduces storage, not runtime memory.
|
| 52 |
+
- This mixed q8/BF16 package reduces both storage and runtime memory. This is the package to use when generation memory footprint matters.
|
| 53 |
+
|
| 54 |
+
| Layout | Disk | Runtime Memory | Improvement |
|
| 55 |
+
| --- | ---: | --- | --- |
|
| 56 |
+
| Original source snapshot | 118 GiB | Baseline | Baseline. |
|
| 57 |
+
| BF16 package | 64 GiB | Same class as original | Storage only; output was byte-identical. |
|
| 58 |
+
| This mixed q8/BF16 package | 40 GiB | Lower | Storage and memory; side-by-side quality validation passed. |
|
| 59 |
+
|
| 60 |
+
Compared with the original source snapshot, this mixed q8/BF16 package cuts disk usage by about 66%, MLX peak memory by about 37%, and physical peak memory by about 35% in this validation run. It is not byte-identical to BF16, but the validation contact sheet stayed in the same visual family. The prepared q8/BF16 output was byte-identical to running `--quantize 8` from the upstream source snapshot.
|
| 61 |
+
|
| 62 |
+
Raw measurements:
|
| 63 |
+
|
| 64 |
+
- Original source snapshot: 32.99 GiB MLX peak, 48.90 GiB physical peak, 108.31 s.
|
| 65 |
+
- BF16 package: 32.98 GiB MLX peak, 45.12 GiB physical peak, 114.39 s.
|
| 66 |
+
- This mixed q8/BF16 package: 20.84 GiB MLX peak, 31.75 GiB physical peak, 110.34 s.
|
| 67 |
|
| 68 |
## Compatibility
|
| 69 |
|