wlsaidhi commited on
Commit
2b025dc
verified
1 Parent(s): fcfb58f

[docs] simplify FastH3 model card

Browse files
Files changed (1) hide show
  1. README.md +26 -69
README.md CHANGED
@@ -25,83 +25,40 @@ tags:
25
 
26
  # FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree
27
 
28
- FastH3 4-Step Preview v1 checkpoint from FastVideo. This variant is the
29
- `dmd2_sp4_fsdp32_v12_datafree_mixed_dense_fa4` data-free DMD2 MiniMax-H3
30
- student at training step 1000. It generates synchronized video and audio with
31
- four transformer forwards and uses dense FlashAttention.
32
 
33
- See the complete [FastH3 4-Step Preview v1
34
- collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3).
 
 
35
 
36
- ## Checkpoint identity
37
-
38
- - Training run: `20260826T014507Z-v12-datafree-dense-fa4-r300-rack2`
39
- - Lineage parent: `20260825T010407Z-v12-datafree-dense-fa4`
40
- - W&B: [bdpc9m5x](https://wandb.ai/wlsaidhi/h3-dmd2-vsa/runs/bdpc9m5x)
41
- - Step: 1000
42
- - Transformer content SHA-256: `3f56129acb9749f2ae4e52bab176c09406bf027d68c6f020cf5ff99e651b1609`
43
- - Checkpoint metadata SHA-256: `a1ae1a4ec117b5bc79f61da4ee5d4003694f27dc6dfe55e9166b59d2b387e6b9`
44
- - FastVideo execution commit: `aa6e6c1c1e15f879011a47996c7d6bc8381eaf89`
45
- - Data commit: `b92be606a439c67006220459df236d18c48fd38c3e11f4771d21fe0d078a3371`
46
-
47
- `checkpoint_content.json` records every indexed transformer shard and digest.
48
- `checkpoint_metadata.json` preserves the source training configuration.
49
-
50
- ## Contents
51
-
52
- This is a self-contained Diffusers modular-pipeline package. The distilled
53
- bf16 student is under `transformer/`; the text encoder, tokenizer, processor,
54
- video VAE, audio VAE, and schedulers are unmodified MiniMax-H3 components.
55
-
56
- The `transformer_ref` component is not bundled because this student targets
57
- T2AV. Its modular-index entry remains on `MiniMaxAI/MiniMax-H3`.
58
-
59
- ## Exact FastVideo inference contract
60
-
61
- The student was trained on the explicit ladder `[999, 749, 500, 250]`. These
62
- are four transformer forwards; do not replace the ladder with an arbitrary
63
- four-point scheduler grid.
64
 
65
  ```bash
66
- export FASTVIDEO_DMD_DENOISING_STEPS=999,749,500,250
67
- export FASTVIDEO_ATTENTION_BACKEND=FLASH_ATTN
 
 
 
 
68
 
 
 
69
  python examples/inference/basic/basic_minimax_h3_t2v.py \
70
  --model-path FastVideo/FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree \
71
- --prompt '<MiniMax-H3 T2AV prompt>' \
72
- --steps 5 \
73
- --num-gpus 4
74
  ```
75
 
76
- The five scheduler grid points execute the four trained jumps. Use guidance
77
- scale 1.0 and dense FlashAttention (the FA4 route on the pinned B200 stack).
78
- Compilation is an optional runtime optimization; first validate output parity
79
- on the pinned FastVideo commit.
80
-
81
- ## Training summary
82
-
83
- - Method: data-free DMD2 with carried backward-simulation ODE rollouts.
84
- Training consumes text conditioning and student-generated latents rather
85
- than target video latents.
86
- - Student grid: `[999, 749, 500, 250]`.
87
- - Student attention: dense FlashAttention (the FA4 route on the pinned B200
88
- stack).
89
- - Global batch size: 64.
90
- - Student and critic learning rate: `2e-06` and
91
- `2e-06`.
92
- - Precision: fp32 training state and bf16 inference export.
93
- - Training topology: 32 B200 GPUs, SP=4,
94
- HSDP replicate=1 / shard=32.
95
- - Continuous score-clock shift: `2.4`; warp max: `0.999`.
96
-
97
- ## Limitations
98
 
99
- - Intermediate checkpoint at step 1000 of a planned 4000-step run.
100
- - T2AV only; the reference-conditioned transformer was not distilled here.
101
- - Quality remains below base MiniMax-H3 on difficult motion, fine structure,
102
- and some audio details.
103
- - Sampling outside the trained ladder or attention geometry is
104
- off-distribution.
105
- - Inherits the MiniMax H3 Community License and base-model limitations.
106
 
107
- Indexed student: 638 bf16 tensors / 66,245,985,792 logical bytes.
 
 
 
 
25
 
26
  # FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree
27
 
28
+ A dense-attention FastH3 Preview v1 ablation from
29
+ [FastVideo](https://github.com/hao-ai-lab/FastVideo). It generates synchronized
30
+ video and audio from text with four transformer forwards. This step-1000 model
31
+ was trained with data-free DMD2.
32
 
33
+ [Blog](https://haoailab.com/blogs/fasth3-preview/)
34
+ [Matching LoRA](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/dense-datafree)
35
+ [Recommended checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) 路
36
+ [FastH3 collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3)
37
 
38
+ ## Run with FastVideo
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
 
40
  ```bash
41
+ git clone https://github.com/hao-ai-lab/FastVideo.git
42
+ cd FastVideo
43
+ uv venv --python 3.12
44
+ source .venv/bin/activate
45
+ UV_TORCH_BACKEND=cu130 uv pip install -e ".[fasth3]"
46
+ ```
47
 
48
+ ```bash
49
+ FASTVIDEO_ATTENTION_BACKEND=FLASH_ATTN \
50
  python examples/inference/basic/basic_minimax_h3_t2v.py \
51
  --model-path FastVideo/FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree \
52
+ --prompt "your prompt" \
53
+ --steps 5
 
54
  ```
55
 
56
+ Five scheduler points execute the trained four transformer forwards. Adjust
57
+ `--num-gpus` for your setup.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
58
 
59
+ ## Scope
 
 
 
 
 
 
60
 
61
+ This preview supports text-to-audio-video generation. FL2VA and Ref2VA were
62
+ not distilled. Difficult motion, fine detail, and some audio may remain below
63
+ the base MiniMax H3 model. This checkpoint inherits the
64
+ [MiniMax H3 Community License](LICENSE).