PencilHu commited on
Commit
84824e4
·
verified ·
1 Parent(s): 87ed7b9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +71 -0
README.md ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ pipeline_tag: image-to-video
6
+ tags:
7
+ - world-model
8
+ - video-generation
9
+ - perspective-switching
10
+ - lora
11
+ - lingbot-world
12
+ base_model: robbyant/lingbot-world-base-cam
13
+ ---
14
+
15
+ # SwitchWorld FullFlow v2 adapters
16
+
17
+ SwitchWorld adds in-stream FP/TP viewpoint switching to LingBot-World. This
18
+ repository contains the completed FullFlow v2 adapter sequence for both the
19
+ high-noise and low-noise branches. The LingBot-World base checkpoint is required
20
+ separately and is not duplicated here.
21
+
22
+ ## Files
23
+
24
+ | File | Role |
25
+ | --- | --- |
26
+ | `front_fp_high_rank128.pt` | high-noise branch after FP expert training |
27
+ | `front_tp_high_rank128.pt` | high-noise branch after TP expert training |
28
+ | `joint_high_rank128.pt` | high-noise final adapter after transition training |
29
+ | `front_fp_low_rank128.pt` | low-noise branch after FP expert training |
30
+ | `front_tp_low_rank128.pt` | low-noise branch after TP expert training |
31
+ | `joint_low_rank128.pt` | low-noise final adapter after transition training |
32
+
33
+ For normal inference, use `joint_high_rank128.pt` and
34
+ `joint_low_rank128.pt`. The four intermediate checkpoints are included for
35
+ reproducibility and ablations.
36
+
37
+ ## Download
38
+
39
+ ```bash
40
+ hf download PencilHu/SwitchWorld --local-dir checkpoints/switchworld-fullflow-v2
41
+ ```
42
+
43
+ ## Base model and code
44
+
45
+ - Base model: [robbyant/lingbot-world-base-cam](https://huggingface.co/robbyant/lingbot-world-base-cam)
46
+ - Code: [yizhiqianbi/SwitchWorld](https://github.com/yizhiqianbi/SwitchWorld)
47
+ - Results: [SwitchWorld Gallery](https://yizhiqianbi.github.io/SwitchWorld-Gallery/archive/)
48
+
49
+ ## Training layout
50
+
51
+ Each noise branch was trained in three ordered stages. The FP expert is updated
52
+ first, the TP expert is updated from that checkpoint, and the transition module
53
+ is updated last while shared/FP/TP weights are frozen. Frozen-component digest
54
+ checks passed for the completed local run.
55
+
56
+ ## Limitations
57
+
58
+ - These are adapters/checkpoints for the SwitchWorld research code, not a
59
+ standalone Diffusers pipeline.
60
+ - Generation inherits the limitations and hardware requirements of
61
+ LingBot-World and Wan2.2.
62
+ - The gallery includes research outputs from multiple stages, including
63
+ baselines and failure cases; it should not be interpreted as a curated quality
64
+ benchmark.
65
+ - Several evaluation metric interfaces in the codebase still have explicitly
66
+ marked mock backends. Do not treat mock values as model claims.
67
+
68
+ ## License
69
+
70
+ Apache-2.0. The required upstream base model and datasets remain subject to
71
+ their own licenses and terms.