dgrauet commited on
Commit
ed7d9e8
·
verified ·
1 Parent(s): 88574d3

Add model card

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlx
3
+ license: apache-2.0
4
+ base_model: netflix/void-model
5
+ tags:
6
+ - mlx
7
+ - mlx-forge
8
+ - apple-silicon
9
+ - safetensors
10
+ - quantized
11
+ - int4
12
+ ---
13
+
14
+ # dgrauet/void-model-mlx-q4
15
+
16
+ Int4 quantization (group_size 64, transformer Linear weights only) of
17
+ [dgrauet/void-model-mlx](https://huggingface.co/dgrauet/void-model-mlx), the MLX
18
+ conversion of [netflix/void-model](https://huggingface.co/netflix/void-model).
19
+
20
+ Quantized with [mlx-forge](https://github.com/dgrauet/mlx-forge)
21
+ (`mlx-forge convert void-model --quantize --bits 4`).
22
+
23
+ **This is the 32 GB configuration**: paired with the q8 base model, a full
24
+ two-pass BigBen run (30 steps, 13 frames, 352×624) peaks at ~23.7 GB —
25
+ under the 26.8 GB recommended working set of a 32 GB Apple Silicon Mac.
26
+ Quality vs the bf16 weights: PSNR ≈ 35.5 dB on the same seed.
27
+
28
+ ## Usage
29
+
30
+ These weights are loaded by [void-model-mlx](https://github.com/dgrauet/void-model-mlx):
31
+
32
+ ```bash
33
+ python -m void_mlx.infer \
34
+ --sample sample/BigBen \
35
+ --pass1 weights/q4/void_pass1.safetensors \
36
+ --pass2 weights/q4/void_pass2.safetensors \
37
+ --base-model /path/to/CogVideoX-Fun-V1.5-5b-InP-mlx-q8 \
38
+ --steps 30 --max-frames 13 --height 352 --width 624 \
39
+ --output result.gif
40
+ ```
41
+
42
+ Keep `quantize_config.json` next to the weights (the loader also infers
43
+ bits/group_size from the weight shapes if it is missing).
44
+
45
+ ## Related Projects
46
+
47
+ - **void-model-mlx (inference):** https://github.com/dgrauet/void-model-mlx
48
+ - **VideoX-Fun-mlx (engine):** https://github.com/dgrauet/VideoX-Fun-mlx
49
+ - **Base model weights (q8):** https://huggingface.co/dgrauet/CogVideoX-Fun-V1.5-5b-InP-mlx-q8
50
+ - **bf16 variant:** https://huggingface.co/dgrauet/void-model-mlx
51
+ - **q8 variant:** https://huggingface.co/dgrauet/void-model-mlx-q8
52
+
53
+ ## Files
54
+
55
+ - `config.json`
56
+ - `quantize_config.json` (bits=4, group_size=64)
57
+ - `void_pass1.safetensors` (4.31 GB)
58
+ - `void_pass2.safetensors` (4.31 GB)