[docs] simplify FastH3 model card
Browse files
README.md
CHANGED
|
@@ -25,88 +25,44 @@ tags:
|
|
| 25 |
|
| 26 |
# FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900
|
| 27 |
|
| 28 |
-
FastH3
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
|
|
|
| 32 |
|
| 33 |
-
|
| 34 |
-
|
|
|
|
|
|
|
| 35 |
|
| 36 |
-
>
|
| 37 |
-
> Sparse Attention (VSA-H3) backend and kernel enabled at 90% sparsity with
|
| 38 |
-
> 64-token tiles. Dense attention is not a supported substitute.
|
| 39 |
|
| 40 |
-
##
|
| 41 |
-
|
| 42 |
-
- Training run: `20260825T003627Z-v11-dataonly-sp2-fastgen-fix`
|
| 43 |
-
- Lineage parent: `20260823T191211Z-v11-dataonly-sp2-initial`
|
| 44 |
-
- W&B: [arg07fnt](https://wandb.ai/wlsaidhi/h3-dmd2-vsa/runs/arg07fnt)
|
| 45 |
-
- Step: 1900
|
| 46 |
-
- Transformer content SHA-256: `932493fce3c32de6bb49e0d568ec493bec365a62b0e5a92262ab73a1619f0dda`
|
| 47 |
-
- Checkpoint metadata SHA-256: `d93f3974fa6a916a0989327b8861c0fb9f5c028b33f95e65c45925ea49dcdbfe`
|
| 48 |
-
- FastVideo execution commit: `6ac300b5a7c472e3a139f1cb3ff7a03b58f3e26e`
|
| 49 |
-
- Data commit: `b92be606a439c67006220459df236d18c48fd38c3e11f4771d21fe0d078a3371`
|
| 50 |
-
|
| 51 |
-
`checkpoint_content.json` records every indexed transformer shard and digest.
|
| 52 |
-
`checkpoint_metadata.json` preserves the source training configuration.
|
| 53 |
-
|
| 54 |
-
## Contents
|
| 55 |
-
|
| 56 |
-
This is a self-contained Diffusers modular-pipeline package. The distilled
|
| 57 |
-
bf16 student is under `transformer/`; the text encoder, tokenizer, processor,
|
| 58 |
-
video VAE, audio VAE, and schedulers are unmodified MiniMax-H3 components.
|
| 59 |
-
|
| 60 |
-
The `transformer_ref` component is not bundled because this student targets
|
| 61 |
-
T2AV. Its modular-index entry remains on `MiniMaxAI/MiniMax-H3`.
|
| 62 |
-
|
| 63 |
-
## Exact FastVideo inference contract
|
| 64 |
-
|
| 65 |
-
The student was trained on the explicit ladder `[999, 749, 500, 250]`. These
|
| 66 |
-
are four transformer forwards; do not replace the ladder with an arbitrary
|
| 67 |
-
four-point scheduler grid.
|
| 68 |
|
| 69 |
```bash
|
| 70 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
|
|
|
|
| 72 |
python examples/inference/basic/basic_fasth3.py \
|
| 73 |
--model-path FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900 \
|
| 74 |
-
--prompt
|
| 75 |
-
--
|
| 76 |
-
--
|
| 77 |
-
--vsa-sparsity 0.9 \
|
| 78 |
-
--vsa-tile-size 64 \
|
| 79 |
-
--vsa-kernel sm100a
|
| 80 |
```
|
| 81 |
|
| 82 |
-
The
|
| 83 |
-
|
| 84 |
-
|
| 85 |
-
FastVideo commit.
|
| 86 |
-
|
| 87 |
-
## Training summary
|
| 88 |
-
|
| 89 |
-
- Method: data-only DMD2 on synthetic Base-H3 video latents. The student is
|
| 90 |
-
trained from forward-noised target latents; no data-free carried rollout is
|
| 91 |
-
mixed into this run.
|
| 92 |
-
- Student grid: `[999, 749, 500, 250]`.
|
| 93 |
-
- Student attention: VSA-H3 at 90% sparsity with 64-token tiles.
|
| 94 |
-
- Global batch size: 64.
|
| 95 |
-
- Student and critic learning rate: `2e-06` and
|
| 96 |
-
`2e-06`.
|
| 97 |
-
- Precision: fp32 training state and bf16 inference export.
|
| 98 |
-
- Training topology: 64 B200 GPUs, SP=2,
|
| 99 |
-
HSDP replicate=1 / shard=64.
|
| 100 |
-
- Continuous score-clock shift: `2.4`; warp max: `0.999`.
|
| 101 |
-
|
| 102 |
-
## Limitations
|
| 103 |
|
| 104 |
-
|
| 105 |
-
- T2AV only; the reference-conditioned transformer was not distilled here.
|
| 106 |
-
- Quality remains below base MiniMax-H3 on difficult motion, fine structure,
|
| 107 |
-
and some audio details.
|
| 108 |
-
- Sampling outside the trained ladder or attention geometry is
|
| 109 |
-
off-distribution.
|
| 110 |
-
- Inherits the MiniMax H3 Community License and base-model limitations.
|
| 111 |
|
| 112 |
-
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
# FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900
|
| 27 |
|
| 28 |
+
A FastH3 Preview v1 ablation from
|
| 29 |
+
[FastVideo](https://github.com/hao-ai-lab/FastVideo). It generates synchronized
|
| 30 |
+
video and audio from text with four transformer forwards. This step-1900 model
|
| 31 |
+
was trained with DMD2 on synthetic Base H3 videos and uses VSA-H3 at 90%
|
| 32 |
+
sparsity.
|
| 33 |
|
| 34 |
+
[Blog](https://haoailab.com/blogs/fasth3-preview/) 路
|
| 35 |
+
[Matching LoRA](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-synthetic-step1900) 路
|
| 36 |
+
[Recommended checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) 路
|
| 37 |
+
[FastH3 collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3)
|
| 38 |
|
| 39 |
+
> This checkpoint requires FastVideo's VSA-H3 attention backend.
|
|
|
|
|
|
|
| 40 |
|
| 41 |
+
## Run with FastVideo
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
|
| 43 |
```bash
|
| 44 |
+
git clone https://github.com/hao-ai-lab/FastVideo.git
|
| 45 |
+
cd FastVideo
|
| 46 |
+
uv venv --python 3.12
|
| 47 |
+
source .venv/bin/activate
|
| 48 |
+
UV_TORCH_BACKEND=cu130 uv pip install -e ".[fasth3]"
|
| 49 |
+
```
|
| 50 |
|
| 51 |
+
```bash
|
| 52 |
python examples/inference/basic/basic_fasth3.py \
|
| 53 |
--model-path FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900 \
|
| 54 |
+
--prompt "your prompt" \
|
| 55 |
+
--no-warmup \
|
| 56 |
+
--repeats 1
|
|
|
|
|
|
|
|
|
|
| 57 |
```
|
| 58 |
|
| 59 |
+
The script uses FastVideo's optimized four-GPU defaults and the trained
|
| 60 |
+
four-forward schedule. On systems without the Blackwell kernels, add
|
| 61 |
+
`--vsa-kernel triton --no-fa4`; adjust `--num-gpus` for your setup.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
+
## Scope
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 64 |
|
| 65 |
+
This preview supports text-to-audio-video generation. FL2VA and Ref2VA were
|
| 66 |
+
not distilled. Difficult motion, fine detail, and some audio may remain below
|
| 67 |
+
the base MiniMax H3 model. This checkpoint inherits the
|
| 68 |
+
[MiniMax H3 Community License](LICENSE).
|