wlsaidhi commited on
Commit
ff589c8
verified
1 Parent(s): 040ec75

[docs] simplify FastH3 model card

Browse files
Files changed (1) hide show
  1. README.md +29 -73
README.md CHANGED
@@ -25,88 +25,44 @@ tags:
25
 
26
  # FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900
27
 
28
- FastH3 4-Step Preview v1 checkpoint from FastVideo. This variant is the
29
- `dmd2_sp2_fsdp64_v11_dataonly_mixed_vsa64` synthetic-data DMD2 MiniMax-H3
30
- student at training step 1900. It generates synchronized video and audio with
31
- four transformer forwards and uses VSA-H3 at 90% sparsity.
 
32
 
33
- See the complete [FastH3 4-Step Preview v1
34
- collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3).
 
 
35
 
36
- > **VSA requirement:** This checkpoint must be run with FastVideo's Video
37
- > Sparse Attention (VSA-H3) backend and kernel enabled at 90% sparsity with
38
- > 64-token tiles. Dense attention is not a supported substitute.
39
 
40
- ## Checkpoint identity
41
-
42
- - Training run: `20260825T003627Z-v11-dataonly-sp2-fastgen-fix`
43
- - Lineage parent: `20260823T191211Z-v11-dataonly-sp2-initial`
44
- - W&B: [arg07fnt](https://wandb.ai/wlsaidhi/h3-dmd2-vsa/runs/arg07fnt)
45
- - Step: 1900
46
- - Transformer content SHA-256: `932493fce3c32de6bb49e0d568ec493bec365a62b0e5a92262ab73a1619f0dda`
47
- - Checkpoint metadata SHA-256: `d93f3974fa6a916a0989327b8861c0fb9f5c028b33f95e65c45925ea49dcdbfe`
48
- - FastVideo execution commit: `6ac300b5a7c472e3a139f1cb3ff7a03b58f3e26e`
49
- - Data commit: `b92be606a439c67006220459df236d18c48fd38c3e11f4771d21fe0d078a3371`
50
-
51
- `checkpoint_content.json` records every indexed transformer shard and digest.
52
- `checkpoint_metadata.json` preserves the source training configuration.
53
-
54
- ## Contents
55
-
56
- This is a self-contained Diffusers modular-pipeline package. The distilled
57
- bf16 student is under `transformer/`; the text encoder, tokenizer, processor,
58
- video VAE, audio VAE, and schedulers are unmodified MiniMax-H3 components.
59
-
60
- The `transformer_ref` component is not bundled because this student targets
61
- T2AV. Its modular-index entry remains on `MiniMaxAI/MiniMax-H3`.
62
-
63
- ## Exact FastVideo inference contract
64
-
65
- The student was trained on the explicit ladder `[999, 749, 500, 250]`. These
66
- are four transformer forwards; do not replace the ladder with an arbitrary
67
- four-point scheduler grid.
68
 
69
  ```bash
70
- export FASTVIDEO_DMD_DENOISING_STEPS=999,749,500,250
 
 
 
 
 
71
 
 
72
  python examples/inference/basic/basic_fasth3.py \
73
  --model-path FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900 \
74
- --prompt '<MiniMax-H3 T2AV prompt>' \
75
- --steps 5 \
76
- --num-gpus 4 \
77
- --vsa-sparsity 0.9 \
78
- --vsa-tile-size 64 \
79
- --vsa-kernel sm100a
80
  ```
81
 
82
- The five scheduler grid points execute the four trained jumps. Use guidance
83
- scale 1.0 and VSA-H3 at 90% sparsity with 64-token tiles. Compilation is an
84
- optional runtime optimization; first validate output parity on the pinned
85
- FastVideo commit.
86
-
87
- ## Training summary
88
-
89
- - Method: data-only DMD2 on synthetic Base-H3 video latents. The student is
90
- trained from forward-noised target latents; no data-free carried rollout is
91
- mixed into this run.
92
- - Student grid: `[999, 749, 500, 250]`.
93
- - Student attention: VSA-H3 at 90% sparsity with 64-token tiles.
94
- - Global batch size: 64.
95
- - Student and critic learning rate: `2e-06` and
96
- `2e-06`.
97
- - Precision: fp32 training state and bf16 inference export.
98
- - Training topology: 64 B200 GPUs, SP=2,
99
- HSDP replicate=1 / shard=64.
100
- - Continuous score-clock shift: `2.4`; warp max: `0.999`.
101
-
102
- ## Limitations
103
 
104
- - Intermediate checkpoint at step 1900 of a planned 4000-step run.
105
- - T2AV only; the reference-conditioned transformer was not distilled here.
106
- - Quality remains below base MiniMax-H3 on difficult motion, fine structure,
107
- and some audio details.
108
- - Sampling outside the trained ladder or attention geometry is
109
- off-distribution.
110
- - Inherits the MiniMax H3 Community License and base-model limitations.
111
 
112
- Indexed student: 688 bf16 tensors / 70,099,502,592 logical bytes.
 
 
 
 
25
 
26
  # FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900
27
 
28
+ A FastH3 Preview v1 ablation from
29
+ [FastVideo](https://github.com/hao-ai-lab/FastVideo). It generates synchronized
30
+ video and audio from text with four transformer forwards. This step-1900 model
31
+ was trained with DMD2 on synthetic Base H3 videos and uses VSA-H3 at 90%
32
+ sparsity.
33
 
34
+ [Blog](https://haoailab.com/blogs/fasth3-preview/)
35
+ [Matching LoRA](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-synthetic-step1900)
36
+ [Recommended checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) 路
37
+ [FastH3 collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3)
38
 
39
+ > This checkpoint requires FastVideo's VSA-H3 attention backend.
 
 
40
 
41
+ ## Run with FastVideo
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
 
43
  ```bash
44
+ git clone https://github.com/hao-ai-lab/FastVideo.git
45
+ cd FastVideo
46
+ uv venv --python 3.12
47
+ source .venv/bin/activate
48
+ UV_TORCH_BACKEND=cu130 uv pip install -e ".[fasth3]"
49
+ ```
50
 
51
+ ```bash
52
  python examples/inference/basic/basic_fasth3.py \
53
  --model-path FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900 \
54
+ --prompt "your prompt" \
55
+ --no-warmup \
56
+ --repeats 1
 
 
 
57
  ```
58
 
59
+ The script uses FastVideo's optimized four-GPU defaults and the trained
60
+ four-forward schedule. On systems without the Blackwell kernels, add
61
+ `--vsa-kernel triton --no-fa4`; adjust `--num-gpus` for your setup.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
 
63
+ ## Scope
 
 
 
 
 
 
64
 
65
+ This preview supports text-to-audio-video generation. FL2VA and Ref2VA were
66
+ not distilled. Difficult motion, fine detail, and some audio may remain below
67
+ the base MiniMax H3 model. This checkpoint inherits the
68
+ [MiniMax H3 Community License](LICENSE).