[docs] simplify FastH3 model card
Browse files
README.md
CHANGED
|
@@ -22,74 +22,47 @@ tags:
|
|
| 22 |
|
| 23 |
# FastVideo-FastH3-4-step-Preview-v1-LoRA
|
| 24 |
|
| 25 |
-
|
| 26 |
-
[
|
| 27 |
-
|
| 28 |
-
Each adapter reconstructs one corresponding distilled transformer from the
|
| 29 |
-
MiniMax H3 base model.
|
| 30 |
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
> for the adapter's `.set_weight` tensors. Dense attention is not a supported
|
| 35 |
-
> substitute. The Dense / Data-Free adapter does not require VSA.
|
| 36 |
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|---|---|---|---|---|---:|
|
| 41 |
-
| VSA / Data-Free | `vsa-datafree/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) | VSA, 90% sparse, tile 64 | Prompts only | 1300 |
|
| 42 |
-
| VSA / Synthetic | `vsa-synthetic-step1300/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1300) | VSA, 90% sparse, tile 64 | Synthetic Base-H3 videos | 1300 |
|
| 43 |
-
| VSA / Synthetic | `vsa-synthetic-step1900/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900) | VSA, 90% sparse, tile 64 | Synthetic Base-H3 videos | 1900 |
|
| 44 |
-
| Dense / Data-Free | `dense-datafree/adapter_model.safetensors` | [checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree) | Dense | Prompts only | 1000 |
|
| 45 |
-
|
| 46 |
-
`adapter_manifest.json` pins the source repository revision, LFS SHA-256,
|
| 47 |
-
byte size, and full-checkpoint mapping for every file.
|
| 48 |
-
|
| 49 |
-
The VSA / Data-Free adapter is the historical v10.5 step-1300 artifact. It
|
| 50 |
-
predates later score-clock and FastGen-alignment corrections and is retained
|
| 51 |
-
for exact v10.5 reproduction.
|
| 52 |
|
| 53 |
-
##
|
| 54 |
-
|
| 55 |
-
Download only the variant you need:
|
| 56 |
|
| 57 |
```bash
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
|
|
|
|
|
|
| 61 |
```
|
| 62 |
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
Use the trained four-jump ladder `[999, 749, 500, 250]`, represented by five
|
| 71 |
-
scheduler points, with guidance scale 1.0. VSA variants require FastVideo's H3
|
| 72 |
-
VSA backend; the dense variant must run without VSA.
|
| 73 |
-
|
| 74 |
-
## Adapter format
|
| 75 |
-
|
| 76 |
-
These are FastVideo extended LoRA files, not pure PEFT adapters. In addition to
|
| 77 |
-
rank-64 `lora_A` and `lora_B` factors, they can contain exact `.diff` and
|
| 78 |
-
`.diff_b` tensors. VSA variants also contain `.set_weight` tensors for the
|
| 79 |
-
compression gates that do not exist in the base MiniMax H3 transformer. A
|
| 80 |
-
loader that ignores these keys will not reconstruct the distilled model.
|
| 81 |
-
|
| 82 |
-
## Source repositories
|
| 83 |
|
| 84 |
-
|
| 85 |
-
|
| 86 |
|
| 87 |
-
|
| 88 |
-
- `FastVideo/FastH3-4-step-v1.1-LoRA`
|
| 89 |
-
- `FastVideo/FastH3-4-step-v1.2-LoRA`
|
| 90 |
-
- `FastVideo/FastH3-Dense-4-step-v1-LoRA`
|
| 91 |
|
| 92 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 93 |
|
| 94 |
-
|
| 95 |
-
|
|
|
|
|
|
| 22 |
|
| 23 |
# FastVideo-FastH3-4-step-Preview-v1-LoRA
|
| 24 |
|
| 25 |
+
The compact LoRA releases for FastH3 Preview v1 from
|
| 26 |
+
[FastVideo](https://github.com/hao-ai-lab/FastVideo). Each adapter reconstructs
|
| 27 |
+
one four-forward FastH3 transformer from the MiniMax H3 base model.
|
|
|
|
|
|
|
| 28 |
|
| 29 |
+
[Blog](https://haoailab.com/blogs/fasth3-preview/) ·
|
| 30 |
+
[Recommended full checkpoint](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) ·
|
| 31 |
+
[FastH3 collection](https://huggingface.co/collections/FastVideo/fastvideo-fasth3)
|
|
|
|
|
|
|
| 32 |
|
| 33 |
+
> The three VSA adapters require FastVideo's VSA-H3 backend and kernel. Use
|
| 34 |
+
> FastVideo's launchers rather than a generic PEFT loader; these adapters also
|
| 35 |
+
> contain exact delta and VSA gate tensors.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
+
## Run the recommended adapter
|
|
|
|
|
|
|
| 38 |
|
| 39 |
```bash
|
| 40 |
+
git clone https://github.com/hao-ai-lab/FastVideo.git
|
| 41 |
+
cd FastVideo
|
| 42 |
+
uv venv --python 3.12
|
| 43 |
+
source .venv/bin/activate
|
| 44 |
+
UV_TORCH_BACKEND=cu130 uv pip install -e ".[fasth3]"
|
| 45 |
```
|
| 46 |
|
| 47 |
+
```bash
|
| 48 |
+
bash examples/inference/basic/run_fasth3_lora_preview_vsa_datafree.sh \
|
| 49 |
+
--prompt "your prompt" \
|
| 50 |
+
--no-warmup \
|
| 51 |
+
--repeats 1
|
| 52 |
+
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
|
| 54 |
+
Set `FASTH3_LORA_STRENGTH` to change the adapter strength from its default of
|
| 55 |
+
`1.0`.
|
| 56 |
|
| 57 |
+
## Variants
|
|
|
|
|
|
|
|
|
|
| 58 |
|
| 59 |
+
| Adapter | Full checkpoint | FastVideo launcher |
|
| 60 |
+
|---|---|---|
|
| 61 |
+
| [VSA / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-datafree) | [VSA / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree) | `run_fasth3_lora_preview_vsa_datafree.sh` |
|
| 62 |
+
| [VSA / Synthetic, step 1300](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-synthetic-step1300) | [VSA / Synthetic, step 1300](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1300) | `run_fasth3_lora_preview_vsa_synthetic_step1300.sh` |
|
| 63 |
+
| [VSA / Synthetic, step 1900](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/vsa-synthetic-step1900) | [VSA / Synthetic, step 1900](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1900) | `run_fasth3_lora_preview_vsa_synthetic_step1900.sh` |
|
| 64 |
+
| [Dense / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-LoRA/tree/main/dense-datafree) | [Dense / Data-Free](https://huggingface.co/FastVideo/FastVideo-FastH3-4-step-Preview-v1-Dense-DataFree) | `run_fasth3_lora_preview_dense_datafree.sh` |
|
| 65 |
|
| 66 |
+
The VSA launchers select VSA-H3 automatically; the dense launcher disables it.
|
| 67 |
+
This preview is for text-to-audio-video generation and inherits the
|
| 68 |
+
[MiniMax H3 Community License](LICENSE).
|