dgrauet commited on
Commit
fa1e75c
·
verified ·
1 Parent(s): 9d28cb0

Add model card

Browse files
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlx
3
+ license: apache-2.0
4
+ base_model: netflix/void-model
5
+ tags:
6
+ - mlx
7
+ - mlx-forge
8
+ - apple-silicon
9
+ - safetensors
10
+ - quantized
11
+ - int8
12
+ ---
13
+
14
+ # dgrauet/void-model-mlx-q8
15
+
16
+ Int8 quantization (group_size 64, transformer Linear weights only) of
17
+ [dgrauet/void-model-mlx](https://huggingface.co/dgrauet/void-model-mlx), the MLX
18
+ conversion of [netflix/void-model](https://huggingface.co/netflix/void-model).
19
+
20
+ Quantized with [mlx-forge](https://github.com/dgrauet/mlx-forge)
21
+ (`mlx-forge convert void-model --quantize --bits 8`).
22
+
23
+ Good quality/memory balance (~48 GB RAM recommended for the full two-pass
24
+ pipeline). On 32 GB Macs use the q4 variant instead.
25
+
26
+ ## Usage
27
+
28
+ These weights are loaded by [void-model-mlx](https://github.com/dgrauet/void-model-mlx):
29
+
30
+ ```bash
31
+ python -m void_mlx.infer \
32
+ --sample sample/BigBen \
33
+ --pass1 weights/q8/void_pass1.safetensors \
34
+ --pass2 weights/q8/void_pass2.safetensors \
35
+ --base-model /path/to/CogVideoX-Fun-V1.5-5b-InP-mlx-q8 \
36
+ --steps 30 --max-frames 13 --height 352 --width 624 \
37
+ --output result.gif
38
+ ```
39
+
40
+ Keep `quantize_config.json` next to the weights (the loader also infers
41
+ bits/group_size from the weight shapes if it is missing).
42
+
43
+ ## Related Projects
44
+
45
+ - **void-model-mlx (inference):** https://github.com/dgrauet/void-model-mlx
46
+ - **VideoX-Fun-mlx (engine):** https://github.com/dgrauet/VideoX-Fun-mlx
47
+ - **Base model weights (q8):** https://huggingface.co/dgrauet/CogVideoX-Fun-V1.5-5b-InP-mlx-q8
48
+ - **bf16 variant:** https://huggingface.co/dgrauet/void-model-mlx
49
+ - **q4 variant:** https://huggingface.co/dgrauet/void-model-mlx-q4
50
+
51
+ ## Files
52
+
53
+ - `config.json`
54
+ - `quantize_config.json` (bits=8, group_size=64)
55
+ - `void_pass1.safetensors` (6.68 GB)
56
+ - `void_pass2.safetensors` (6.68 GB)