Improve model card with paper links and usage

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +15 -20
README.md CHANGED
@@ -1,27 +1,28 @@
1
  ---
2
- license: apache-2.0
3
  language:
4
  - en
 
 
5
  tags:
6
  - text-to-video
7
  - video-generation
8
  - human-motion
9
  - reinforcement-learning
10
  - lora
11
- base_model: Wan-AI/Wan2.1-T2V-1.3B
12
- pipeline_tag: text-to-video
13
  ---
14
 
15
  # PhyMotion — Causal Forcing 1.3B
16
 
17
- LoRA adapter for **Causal Forcing 1.3B** (the autoregressive distilled version of Wan2.1 T2V-1.3B),
18
- post-trained with RL using the **PhyMotion** reward — a structured 3D motion reward grounded in
19
- SMPL recovery + MuJoCo inverse dynamics.
 
 
 
20
 
21
- * Project page: https://phy-motion.github.io
22
- * Training code: https://github.com/h6kplus/PhyMotion
23
- * Prompt dataset: https://huggingface.co/datasets/6kplus/PhyMotion-MotionX-Prompts
24
- * Paper: *PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generation*
25
 
26
  ## What's in this repo
27
 
@@ -30,13 +31,9 @@ SMPL recovery + MuJoCo inverse dynamics.
30
  | `adapter_model.bin` | PEFT LoRA weights (rank 256, targets `CausalWanAttentionBlock`) |
31
  | `adapter_config.json` | LoRA configuration |
32
 
33
- The training/eval prompt lists live in a separate dataset repo:
34
- [`6kplus/PhyMotion-MotionX-Prompts`](https://huggingface.co/datasets/6kplus/PhyMotion-MotionX-Prompts).
35
-
36
  ## Usage
37
 
38
- Clone the PhyMotion training repo, place the base model checkpoint and this LoRA, then run
39
- inference (full command in the project README):
40
 
41
  ```bash
42
  git clone https://github.com/h6kplus/PhyMotion.git
@@ -51,6 +48,7 @@ huggingface-cli download 6kplus/PhyMotion-MotionX-Prompts \
51
  --repo-type dataset --local-dir dataset/motionx
52
 
53
  # Inference
 
54
  torchrun --nproc_per_node=1 scripts/inference_wan.py \
55
  --base_model checkpoints/causalforcing/chunkwise/causal_forcing.pt \
56
  --lora_path checkpoints/phymotion-causalforcing \
@@ -63,9 +61,6 @@ torchrun --nproc_per_node=1 scripts/inference_wan.py \
63
  --mixed_precision bf16 --seed 42
64
  ```
65
 
66
- You still need the **base Causal Forcing 1.3B checkpoint** (`causal_forcing.pt`). See the project
67
- page for the download link.
68
-
69
  ## Citation
70
 
71
  ```bibtex
@@ -74,11 +69,11 @@ page for the download link.
74
  author = {Huang, Yidong and Wang, Zun and Lin, Han and Kim, Dong-Ki and
75
  Omidshafiei, Shayegan and Yoon, Jaehong and Cho, Jaemin and
76
  Zhang, Yue and Bansal, Mohit},
77
- journal = {arXiv preprint},
78
  year = {2026}
79
  }
80
  ```
81
 
82
  ## License
83
 
84
- Apache 2.0. The base Wan2.1 / Causal Forcing weights retain their original license.
 
1
  ---
2
+ base_model: Wan-AI/Wan2.1-T2V-1.3B
3
  language:
4
  - en
5
+ license: apache-2.0
6
+ pipeline_tag: text-to-video
7
  tags:
8
  - text-to-video
9
  - video-generation
10
  - human-motion
11
  - reinforcement-learning
12
  - lora
 
 
13
  ---
14
 
15
  # PhyMotion — Causal Forcing 1.3B
16
 
17
+ LoRA adapter for **Causal Forcing 1.3B** (the autoregressive distilled version of Wan2.1 T2V-1.3B), post-trained with RL using the **PhyMotion** reward — a structured 3D motion reward grounded in SMPL recovery and MuJoCo inverse dynamics.
18
+
19
+ * **Paper:** [PhyMotion: Structured 3D Motion Reward for Physics-Grounded Human Video Generation](https://huggingface.co/papers/2605.14269)
20
+ * **Project Page:** https://phy-motion.github.io
21
+ * **Repository:** https://github.com/h6kplus/PhyMotion
22
+ * **Prompt Dataset:** [6kplus/PhyMotion-MotionX-Prompts](https://huggingface.co/datasets/6kplus/PhyMotion-MotionX-Prompts)
23
 
24
+ ## Description
25
+ Generating realistic human motion is a central yet unsolved challenge in video generation. PhyMotion is a structured, fine-grained motion reward that grounds recovered 3D human trajectories in a physics simulator and evaluates motion quality along multiple dimensions of physical feasibility: kinematic plausibility, contact and balance consistency, and dynamic feasibility.
 
 
26
 
27
  ## What's in this repo
28
 
 
31
  | `adapter_model.bin` | PEFT LoRA weights (rank 256, targets `CausalWanAttentionBlock`) |
32
  | `adapter_config.json` | LoRA configuration |
33
 
 
 
 
34
  ## Usage
35
 
36
+ To use this LoRA adapter, clone the [PhyMotion repository](https://github.com/h6kplus/PhyMotion), place the base model checkpoint and this LoRA, then run inference (full instructions available in the repository README):
 
37
 
38
  ```bash
39
  git clone https://github.com/h6kplus/PhyMotion.git
 
48
  --repo-type dataset --local-dir dataset/motionx
49
 
50
  # Inference
51
+ # Note: You still need the base Causal Forcing 1.3B checkpoint (causal_forcing.pt)
52
  torchrun --nproc_per_node=1 scripts/inference_wan.py \
53
  --base_model checkpoints/causalforcing/chunkwise/causal_forcing.pt \
54
  --lora_path checkpoints/phymotion-causalforcing \
 
61
  --mixed_precision bf16 --seed 42
62
  ```
63
 
 
 
 
64
  ## Citation
65
 
66
  ```bibtex
 
69
  author = {Huang, Yidong and Wang, Zun and Lin, Han and Kim, Dong-Ki and
70
  Omidshafiei, Shayegan and Yoon, Jaehong and Cho, Jaemin and
71
  Zhang, Yue and Bansal, Mohit},
72
+ journal = {arXiv preprint arXiv:2605.14269},
73
  year = {2026}
74
  }
75
  ```
76
 
77
  ## License
78
 
79
+ Apache 2.0. The base Wan2.1 / Causal Forcing weights retain their original license.