wlsaidhi commited on
Commit
c0e8ec2
·
verified ·
1 Parent(s): d62accb

[docs] simplify FastH3 model card

Browse files
Files changed (1) hide show
  1. README.md +33 -60
README.md CHANGED
@@ -22,74 +22,47 @@ tags:
22
 
23
  # FastVideo-FastH3-4-step-Preview-v1-LoRA
24
 
25
- Private umbrella repository for the four rank-64 LoRA variants in the
26
- [FastH3 4-Step Preview v1
27
- family](https://huggingface.co/collections/FastVideo/fastvideo-fasth3).
28
- Each adapter reconstructs one corresponding distilled transformer from the
29
- MiniMax H3 base model.
30
 
31
- > **VSA requirement:** The three VSA adapters must be loaded and run with
32
- > FastVideo's Video Sparse Attention (VSA-H3) backend and kernel enabled. VSA
33
- > must be enabled before adapter loading so the compression-gate modules exist
34
- > for the adapter's `.set_weight` tensors. Dense attention is not a supported
35
- > substitute. The Dense / Data-Free adapter does not require VSA.
36
 
37
- ## Variants
38
-
39
- | Variant | Adapter path | Full checkpoint | Attention | Training source | Step |
40
- |---|---|---|---|---|---:|
41
- | VSA / Data-Free | `vsa-datafree/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) | VSA, 90% sparse, tile 64 | Prompts only | 1300 |
42
- | VSA / Synthetic | `vsa-synthetic-step1300/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1300) | VSA, 90% sparse, tile 64 | Synthetic Base-H3 videos | 1300 |
43
- | VSA / Synthetic | `vsa-synthetic-step1900/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900) | VSA, 90% sparse, tile 64 | Synthetic Base-H3 videos | 1900 |
44
- | Dense / Data-Free | `dense-datafree/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree) | Dense | Prompts only | 1000 |
45
-
46
- `adapter_manifest.json` pins the source repository revision, LFS SHA-256,
47
- byte size, and full-checkpoint mapping for every file.
48
-
49
- The VSA / Data-Free adapter is the historical v10.5 step-1300 artifact. It
50
- predates later score-clock and FastGen-alignment corrections and is retained
51
- for exact v10.5 reproduction.
52
 
53
- ## Download one adapter
54
-
55
- Download only the variant you need:
56
 
57
  ```bash
58
- hf download FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA \
59
- vsa-synthetic-step1900/adapter_model.safetensors \
60
- --local-dir ./FastH3-Preview-v1-LoRA
 
 
61
  ```
62
 
63
- Then pass the resulting local `.safetensors` file as FastVideo's `lora_path`.
64
- The adapter must be supplied while constructing the pipeline, before weights
65
- are sharded.
66
-
67
- Do not pass the bare combined repository ID as `lora_path`: it contains four
68
- adapter files. Select and download one explicit variant first.
69
-
70
- Use the trained four-jump ladder `[999, 749, 500, 250]`, represented by five
71
- scheduler points, with guidance scale 1.0. VSA variants require FastVideo's H3
72
- VSA backend; the dense variant must run without VSA.
73
-
74
- ## Adapter format
75
-
76
- These are FastVideo extended LoRA files, not pure PEFT adapters. In addition to
77
- rank-64 `lora_A` and `lora_B` factors, they can contain exact `.diff` and
78
- `.diff_b` tensors. VSA variants also contain `.set_weight` tensors for the
79
- compression gates that do not exist in the base MiniMax H3 transformer. A
80
- loader that ignores these keys will not reconstruct the distilled model.
81
-
82
- ## Source repositories
83
 
84
- The original private repositories remain available for provenance and
85
- backward compatibility:
86
 
87
- - `FastVideo/FastH3-4-step-v1-LoRA`
88
- - `FastVideo/FastH3-4-step-v1.1-LoRA`
89
- - `FastVideo/FastH3-4-step-v1.2-LoRA`
90
- - `FastVideo/FastH3-Dense-4-step-v1-LoRA`
91
 
92
- ## License
 
 
 
 
 
93
 
94
- These adapters inherit the MiniMax H3 Community License. Review its territory
95
- and acceptable-use terms before use or redistribution.
 
 
22
 
23
  # FastVideo-FastH3-4-step-Preview-v1-LoRA
24
 
25
+ The compact LoRA releases for FastH3 Preview v1 from
26
+ [FastVideo](https://github.com/hao-ai-lab/FastVideo). Each adapter reconstructs
27
+ one four-forward FastH3 transformer from the MiniMax H3 base model.
 
 
28
 
29
+ [Blog](https://haoailab.com/blogs/fasth3-preview/) ·
30
+ [Recommended full checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) ·
31
+ [FastH3 collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3)
 
 
32
 
33
+ > The three VSA adapters require FastVideo's VSA-H3 backend and kernel. Use
34
+ > FastVideo's launchers rather than a generic PEFT loader; these adapters also
35
+ > contain exact delta and VSA gate tensors.
 
 
 
 
 
 
 
 
 
 
 
 
36
 
37
+ ## Run the recommended adapter
 
 
38
 
39
  ```bash
40
+ git clone https://github.com/hao-ai-lab/FastVideo.git
41
+ cd FastVideo
42
+ uv venv --python 3.12
43
+ source .venv/bin/activate
44
+ UV_TORCH_BACKEND=cu130 uv pip install -e ".[fasth3]"
45
  ```
46
 
47
+ ```bash
48
+ bash examples/inference/basic/run_fasth3_lora_preview_vsa_datafree.sh \
49
+ --prompt "your prompt" \
50
+ --no-warmup \
51
+ --repeats 1
52
+ ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53
 
54
+ Set `FASTH3_LORA_STRENGTH` to change the adapter strength from its default of
55
+ `1.0`.
56
 
57
+ ## Variants
 
 
 
58
 
59
+ | Adapter | Full checkpoint | FastVideo launcher |
60
+ |---|---|---|
61
+ | [VSA / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-datafree) | [VSA / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) | `run_fasth3_lora_preview_vsa_datafree.sh` |
62
+ | [VSA / Synthetic, step 1300](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-synthetic-step1300) | [VSA / Synthetic, step 1300](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1300) | `run_fasth3_lora_preview_vsa_synthetic_step1300.sh` |
63
+ | [VSA / Synthetic, step 1900](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-synthetic-step1900) | [VSA / Synthetic, step 1900](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900) | `run_fasth3_lora_preview_vsa_synthetic_step1900.sh` |
64
+ | [Dense / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/dense-datafree) | [Dense / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree) | `run_fasth3_lora_preview_dense_datafree.sh` |
65
 
66
+ The VSA launchers select VSA-H3 automatically; the dense launcher disables it.
67
+ This preview is for text-to-audio-video generation and inherits the
68
+ [MiniMax H3 Community License](LICENSE).