krahets commited on
Commit
0381cd1
Β·
1 Parent(s): 178b69b

Polish model card and clarify asset licenses

Browse files
.gitattributes CHANGED
@@ -4,6 +4,7 @@
4
  *.bz2 filter=lfs diff=lfs merge=lfs -text
5
  *.ckpt filter=lfs diff=lfs merge=lfs -text
6
  *.ftz filter=lfs diff=lfs merge=lfs -text
 
7
  *.gz filter=lfs diff=lfs merge=lfs -text
8
  *.h5 filter=lfs diff=lfs merge=lfs -text
9
  *.joblib filter=lfs diff=lfs merge=lfs -text
 
4
  *.bz2 filter=lfs diff=lfs merge=lfs -text
5
  *.ckpt filter=lfs diff=lfs merge=lfs -text
6
  *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gif filter=lfs diff=lfs merge=lfs -text
8
  *.gz filter=lfs diff=lfs merge=lfs -text
9
  *.h5 filter=lfs diff=lfs merge=lfs -text
10
  *.joblib filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # 4DAnyone Model Repository Licensing
2
+
3
+ This repository is a collection of separately licensed model and example
4
+ assets. No single license applies to every file. Each license below applies
5
+ only to the paths or material named in its row.
6
+
7
+ ## First-party 4DAnyone assets
8
+
9
+ Copyright 2026 4DAnyone authors.
10
+
11
+ The following first-party assets are licensed under the
12
+ [Apache License 2.0](licenses/APACHE-2.0.txt):
13
+
14
+ - `4danyone/model.safetensors`
15
+ - The sparse support and regression-weight tensors in
16
+ `4danyone/smplx_to_goliath70.pt`
17
+ - Original repository documentation, except for quoted or attributed
18
+ third-party material
19
+
20
+ The Apache-2.0 grant for the regression tensors does not relicense the
21
+ Sapiens2-derived schema metadata stored in the same `.pt` file.
22
+
23
+ ## Asset license map
24
+
25
+ | Asset or material | Component and source | License |
26
+ |---|---|---|
27
+ | `4danyone/model.safetensors` | 4DAnyone generation checkpoint | [Apache-2.0](licenses/APACHE-2.0.txt) |
28
+ | Sparse support and regression-weight tensors in `4danyone/smplx_to_goliath70.pt` | First-party SMPL-X-to-MHR70 regressor | [Apache-2.0](licenses/APACHE-2.0.txt) |
29
+ | MHR70/Goliath keypoint names, order, and structural schema in `4danyone/smplx_to_goliath70.pt` | [Meta Sapiens2](https://github.com/facebookresearch/sapiens2) | [Sapiens2 License](licenses/SAPIENS2-LICENSE.txt) |
30
+ | `4danyone/Wan2.2_VAE.pth` | [Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) video VAE | [Apache-2.0](licenses/APACHE-2.0.txt) |
31
+ | `4danyone/models_t5_umt5-xxl-enc-bf16.pth` | [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) UMT5-XXL encoder | [Apache-2.0](licenses/APACHE-2.0.txt) |
32
+ | `4danyone/umt5-xxl/*` | [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) tokenizer | [Apache-2.0](licenses/APACHE-2.0.txt) |
33
+ | `gvhmr/gvhmr_siga24_release.ckpt` | [GVHMR](https://github.com/zju3dv/GVHMR) | [GVHMR research/non-profit license](licenses/GVHMR-LICENSE.txt) |
34
+ | `gvhmr/epoch=10-step=25000.ckpt` | HMR2.0a from [4DHumans](https://github.com/shubham-goel/4D-Humans) | [MIT](licenses/4DHUMANS-MIT.txt) |
35
+ | `gvhmr/vitpose-h-multi-coco.pth` | [ViTPose](https://github.com/ViTAE-Transformer/ViTPose) | [Apache-2.0](licenses/APACHE-2.0.txt) |
36
+ | `gvhmr/yolov8x.pt` | [Ultralytics YOLOv8](https://github.com/ultralytics/ultralytics) | [AGPL-3.0](licenses/ULTRALYTICS-AGPL-3.0.txt) |
37
+ | `data/source/pexels/*.mp4` | Pexels example clips; individual sources are listed in [`data/source/pexels/README.md`](data/source/pexels/README.md) | [Pexels License](https://www.pexels.com/license/) |
38
+
39
+ The complete bundled license texts are in [`licenses/`](licenses/). Retain the
40
+ applicable license, copyright, and attribution notices when redistributing an
41
+ asset. Third-party assets remain governed by their upstream terms; their
42
+ presence does not change the license of the first-party 4DAnyone checkpoint.
README.md CHANGED
@@ -1,85 +1,64 @@
1
  ---
2
  license: other
 
 
3
  pipeline_tag: video-to-video
4
  tags:
5
  - video-generation
6
- - human-motion
 
7
  - novel-view-synthesis
8
  ---
9
 
10
- # 4DAnyone
11
 
12
- Model and example-data assets for [4DAnyone](https://4danyone.github.io/):
13
- **Create Anyone in 4D from a Casual Monocular Video**.
14
 
15
- Use these assets with the source code at
16
- [ant-research/4DAnyone](https://github.com/ant-research/4DAnyone). The source release
17
- downloads only the files needed by the selected inference path.
 
 
18
 
19
- ## Contents
 
 
 
 
 
 
 
 
20
 
21
  ```text
22
  4danyone/
23
- β”œβ”€β”€ model.safetensors
24
- β”œβ”€β”€ smplx_to_goliath70.pt
25
- β”œβ”€β”€ Wan2.2_VAE.pth
26
- β”œβ”€β”€ models_t5_umt5-xxl-enc-bf16.pth
27
- └── umt5-xxl/
28
- β”œβ”€β”€ special_tokens_map.json
29
- β”œβ”€β”€ spiece.model
30
- β”œβ”€β”€ tokenizer.json
31
- └── tokenizer_config.json
32
 
33
  gvhmr/
34
- β”œβ”€β”€ gvhmr_siga24_release.ckpt
35
- β”œβ”€β”€ epoch=10-step=25000.ckpt
36
- β”œβ”€β”€ vitpose-h-multi-coco.pth
37
- └── yolov8x.pt
38
 
39
  data/source/pexels/
40
- └── eight 121-frame example videos and their provenance README
41
- ```
42
-
43
- The 4DAnyone checkpoint is byte-identified by:
44
-
45
- ```text
46
- 4danyone/model.safetensors
47
- sha256: aff60b0db2d333bd9e960a9cf3333cc8dd40fe76614a22f75a0da72be4e8289f
48
  ```
49
 
50
- The sanitized MHR70 sparse regressor is byte-identified by:
51
-
52
- ```text
53
- 4danyone/smplx_to_goliath70.pt
54
- sha256: 725139e6cd14f986cd835468b2d62ca7abb9ffe29beb204d11f816e8e3fab40f
55
- ```
56
-
57
- `SMPLX_NEUTRAL.npz` is required by the full skeleton-conditioning path but is
58
- not redistributed here. Obtain it from the official SMPL-X website under its
59
- own terms. The static-camera v1 path does not require DPVO weights.
60
-
61
- ## Asset licenses and provenance
62
-
63
- This repository contains assets under multiple licenses; the repository-wide
64
- Hugging Face license field is therefore `other`.
65
-
66
- | Assets | Source | Terms included here |
67
- |---|---|---|
68
- | `4danyone/model.safetensors` | 4DAnyone | Apache-2.0 |
69
- | MHR70 sparse regression tensors and renderer palette | 4DAnyone | Apache-2.0 |
70
- | MHR70/Goliath keypoint name/order schema | [Meta Sapiens2](https://github.com/facebookresearch/sapiens2) | Sapiens2 agreement |
71
- | Wan VAE, T5 encoder, and tokenizer | [Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) and [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) | Apache-2.0 |
72
- | `gvhmr_siga24_release.ckpt` | [zju3dv/GVHMR](https://github.com/zju3dv/GVHMR) | GVHMR research/non-profit license |
73
- | HMR2 checkpoint | [4DHumans](https://github.com/shubham-goel/4D-Humans) | MIT |
74
- | ViTPose checkpoint | [ViTPose](https://github.com/ViTAE-Transformer/ViTPose) | Apache-2.0 |
75
- | YOLOv8 checkpoint | [Ultralytics](https://github.com/ultralytics/ultralytics) | AGPL-3.0 |
76
- | Example clips | [Pexels](https://www.pexels.com/license/) | Pexels license; per-video sources are listed with the clips |
77
-
78
- Full license texts are under `licenses/`. Users are responsible for complying
79
- with every applicable upstream term.
80
 
81
  ## Citation
82
 
 
 
83
  ```bibtex
84
  @article{jin2026fdanyone,
85
  title={4DAnyone: Create Anyone in 4D from a Casual Monocular Video},
 
1
  ---
2
  license: other
3
+ license_name: multiple-licenses
4
+ license_link: https://huggingface.co/krahets/4DAnyone/blob/main/LICENSE
5
  pipeline_tag: video-to-video
6
  tags:
7
  - video-generation
8
+ - multiview-video-generation
9
+ - 4D-human-reconstruction
10
  - novel-view-synthesis
11
  ---
12
 
13
+ <h1 align="center">4DAnyone</h1>
14
 
15
+ <h2 align="center">Create Anyone in 4D from a Casual Monocular Video</h2>
 
16
 
17
+ <p align="center">
18
+ <a href="https://4danyone.github.io/"><strong>Project Page</strong></a>
19
+ &nbsp;|&nbsp;
20
+ <a href="https://github.com/ant-research/4DAnyone"><strong>Code</strong></a>
21
+ </p>
22
 
23
+ <p align="center">
24
+ <img src="assets/teaser.gif" width="100%" alt="4DAnyone teaser">
25
+ </p>
26
+
27
+ <p align="center">
28
+ 4DAnyone turns a casual monocular video into multi-view videos, enabling downstream 4DGS reconstruction.
29
+ </p>
30
+
31
+ ## Models
32
 
33
  ```text
34
  4danyone/
35
+ β”œβ”€β”€ model.safetensors # 4DAnyone multi-view video generation checkpoint
36
+ β”œβ”€β”€ smplx_to_goliath70.pt # Sparse SMPL-X-to-MHR70 keypoint regressor and schema
37
+ β”œβ”€β”€ Wan2.2_VAE.pth # Wan2.2-TI2V-5B video VAE
38
+ β”œβ”€β”€ models_t5_umt5-xxl-enc-bf16.pth # UMT5-XXL text encoder weights
39
+ └── umt5-xxl/ # UMT5-XXL tokenizer
40
+ β”œβ”€β”€ special_tokens_map.json # Special-token mapping
41
+ β”œβ”€β”€ spiece.model # SentencePiece model
42
+ β”œβ”€β”€ tokenizer.json # Serialized fast tokenizer
43
+ └── tokenizer_config.json # Tokenizer configuration
44
 
45
  gvhmr/
46
+ β”œβ”€β”€ gvhmr_siga24_release.ckpt # GVHMR global human-motion recovery checkpoint
47
+ β”œβ”€β”€ epoch=10-step=25000.ckpt # HMR2.0a image-feature extractor checkpoint
48
+ β”œβ”€β”€ vitpose-h-multi-coco.pth # ViTPose-H 2D human-pose checkpoint
49
+ └── yolov8x.pt # YOLOv8-X person detector
50
 
51
  data/source/pexels/
52
+ └── eight 121-frame example videos # Ready-to-run inputs; sources are documented alongside them
 
 
 
 
 
 
 
53
  ```
54
 
55
+ Licensing is asset-specific. See [LICENSE](LICENSE) for the exact scope and
56
+ [licenses/](licenses/) for the complete terms.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
57
 
58
  ## Citation
59
 
60
+ If you find 4DAnyone useful or interesting, please cite our work and give us a star ⭐:
61
+
62
  ```bibtex
63
  @article{jin2026fdanyone,
64
  title={4DAnyone: Create Anyone in 4D from a Casual Monocular Video},
assets/teaser.gif ADDED

Git LFS Details

  • SHA256: 0fa3dfd061d02a265dbb03f17e908a31c0c712bb02ba63b3072d47a380278841
  • Pointer size: 133 Bytes
  • Size of remote file: 15.9 MB
licenses/{MIT.txt β†’ 4DHUMANS-MIT.txt} RENAMED
File without changes
licenses/{GVHMR_LICENSE.txt β†’ GVHMR-LICENSE.txt} RENAMED
File without changes
licenses/{SAPIENS2_LICENSE.txt β†’ SAPIENS2-LICENSE.txt} RENAMED
File without changes
licenses/{AGPL-3.0.txt β†’ ULTRALYTICS-AGPL-3.0.txt} RENAMED
File without changes