Instructions to use dgrauet/void-model-mlx-q4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use dgrauet/void-model-mlx-q4 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir void-model-mlx-q4 dgrauet/void-model-mlx-q4
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Add model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: mlx
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
base_model: netflix/void-model
|
| 5 |
+
tags:
|
| 6 |
+
- mlx
|
| 7 |
+
- mlx-forge
|
| 8 |
+
- apple-silicon
|
| 9 |
+
- safetensors
|
| 10 |
+
- quantized
|
| 11 |
+
- int4
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# dgrauet/void-model-mlx-q4
|
| 15 |
+
|
| 16 |
+
Int4 quantization (group_size 64, transformer Linear weights only) of
|
| 17 |
+
[dgrauet/void-model-mlx](https://huggingface.co/dgrauet/void-model-mlx), the MLX
|
| 18 |
+
conversion of [netflix/void-model](https://huggingface.co/netflix/void-model).
|
| 19 |
+
|
| 20 |
+
Quantized with [mlx-forge](https://github.com/dgrauet/mlx-forge)
|
| 21 |
+
(`mlx-forge convert void-model --quantize --bits 4`).
|
| 22 |
+
|
| 23 |
+
**This is the 32 GB configuration**: paired with the q8 base model, a full
|
| 24 |
+
two-pass BigBen run (30 steps, 13 frames, 352×624) peaks at ~23.7 GB —
|
| 25 |
+
under the 26.8 GB recommended working set of a 32 GB Apple Silicon Mac.
|
| 26 |
+
Quality vs the bf16 weights: PSNR ≈ 35.5 dB on the same seed.
|
| 27 |
+
|
| 28 |
+
## Usage
|
| 29 |
+
|
| 30 |
+
These weights are loaded by [void-model-mlx](https://github.com/dgrauet/void-model-mlx):
|
| 31 |
+
|
| 32 |
+
```bash
|
| 33 |
+
python -m void_mlx.infer \
|
| 34 |
+
--sample sample/BigBen \
|
| 35 |
+
--pass1 weights/q4/void_pass1.safetensors \
|
| 36 |
+
--pass2 weights/q4/void_pass2.safetensors \
|
| 37 |
+
--base-model /path/to/CogVideoX-Fun-V1.5-5b-InP-mlx-q8 \
|
| 38 |
+
--steps 30 --max-frames 13 --height 352 --width 624 \
|
| 39 |
+
--output result.gif
|
| 40 |
+
```
|
| 41 |
+
|
| 42 |
+
Keep `quantize_config.json` next to the weights (the loader also infers
|
| 43 |
+
bits/group_size from the weight shapes if it is missing).
|
| 44 |
+
|
| 45 |
+
## Related Projects
|
| 46 |
+
|
| 47 |
+
- **void-model-mlx (inference):** https://github.com/dgrauet/void-model-mlx
|
| 48 |
+
- **VideoX-Fun-mlx (engine):** https://github.com/dgrauet/VideoX-Fun-mlx
|
| 49 |
+
- **Base model weights (q8):** https://huggingface.co/dgrauet/CogVideoX-Fun-V1.5-5b-InP-mlx-q8
|
| 50 |
+
- **bf16 variant:** https://huggingface.co/dgrauet/void-model-mlx
|
| 51 |
+
- **q8 variant:** https://huggingface.co/dgrauet/void-model-mlx-q8
|
| 52 |
+
|
| 53 |
+
## Files
|
| 54 |
+
|
| 55 |
+
- `config.json`
|
| 56 |
+
- `quantize_config.json` (bits=4, group_size=64)
|
| 57 |
+
- `void_pass1.safetensors` (4.31 GB)
|
| 58 |
+
- `void_pass2.safetensors` (4.31 GB)
|