Polish model card and clarify asset licenses
Browse files- .gitattributes +1 -0
- LICENSE +42 -0
- README.md +38 -59
- assets/teaser.gif +3 -0
- licenses/{MIT.txt β 4DHUMANS-MIT.txt} +0 -0
- licenses/{GVHMR_LICENSE.txt β GVHMR-LICENSE.txt} +0 -0
- licenses/{SAPIENS2_LICENSE.txt β SAPIENS2-LICENSE.txt} +0 -0
- licenses/{AGPL-3.0.txt β ULTRALYTICS-AGPL-3.0.txt} +0 -0
.gitattributes
CHANGED
|
@@ -4,6 +4,7 @@
|
|
| 4 |
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
*.ftz filter=lfs diff=lfs merge=lfs -text
|
|
|
|
| 7 |
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
*.joblib filter=lfs diff=lfs merge=lfs -text
|
|
|
|
| 4 |
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
+
*.gif filter=lfs diff=lfs merge=lfs -text
|
| 8 |
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 9 |
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 10 |
*.joblib filter=lfs diff=lfs merge=lfs -text
|
LICENSE
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# 4DAnyone Model Repository Licensing
|
| 2 |
+
|
| 3 |
+
This repository is a collection of separately licensed model and example
|
| 4 |
+
assets. No single license applies to every file. Each license below applies
|
| 5 |
+
only to the paths or material named in its row.
|
| 6 |
+
|
| 7 |
+
## First-party 4DAnyone assets
|
| 8 |
+
|
| 9 |
+
Copyright 2026 4DAnyone authors.
|
| 10 |
+
|
| 11 |
+
The following first-party assets are licensed under the
|
| 12 |
+
[Apache License 2.0](licenses/APACHE-2.0.txt):
|
| 13 |
+
|
| 14 |
+
- `4danyone/model.safetensors`
|
| 15 |
+
- The sparse support and regression-weight tensors in
|
| 16 |
+
`4danyone/smplx_to_goliath70.pt`
|
| 17 |
+
- Original repository documentation, except for quoted or attributed
|
| 18 |
+
third-party material
|
| 19 |
+
|
| 20 |
+
The Apache-2.0 grant for the regression tensors does not relicense the
|
| 21 |
+
Sapiens2-derived schema metadata stored in the same `.pt` file.
|
| 22 |
+
|
| 23 |
+
## Asset license map
|
| 24 |
+
|
| 25 |
+
| Asset or material | Component and source | License |
|
| 26 |
+
|---|---|---|
|
| 27 |
+
| `4danyone/model.safetensors` | 4DAnyone generation checkpoint | [Apache-2.0](licenses/APACHE-2.0.txt) |
|
| 28 |
+
| Sparse support and regression-weight tensors in `4danyone/smplx_to_goliath70.pt` | First-party SMPL-X-to-MHR70 regressor | [Apache-2.0](licenses/APACHE-2.0.txt) |
|
| 29 |
+
| MHR70/Goliath keypoint names, order, and structural schema in `4danyone/smplx_to_goliath70.pt` | [Meta Sapiens2](https://github.com/facebookresearch/sapiens2) | [Sapiens2 License](licenses/SAPIENS2-LICENSE.txt) |
|
| 30 |
+
| `4danyone/Wan2.2_VAE.pth` | [Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) video VAE | [Apache-2.0](licenses/APACHE-2.0.txt) |
|
| 31 |
+
| `4danyone/models_t5_umt5-xxl-enc-bf16.pth` | [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) UMT5-XXL encoder | [Apache-2.0](licenses/APACHE-2.0.txt) |
|
| 32 |
+
| `4danyone/umt5-xxl/*` | [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) tokenizer | [Apache-2.0](licenses/APACHE-2.0.txt) |
|
| 33 |
+
| `gvhmr/gvhmr_siga24_release.ckpt` | [GVHMR](https://github.com/zju3dv/GVHMR) | [GVHMR research/non-profit license](licenses/GVHMR-LICENSE.txt) |
|
| 34 |
+
| `gvhmr/epoch=10-step=25000.ckpt` | HMR2.0a from [4DHumans](https://github.com/shubham-goel/4D-Humans) | [MIT](licenses/4DHUMANS-MIT.txt) |
|
| 35 |
+
| `gvhmr/vitpose-h-multi-coco.pth` | [ViTPose](https://github.com/ViTAE-Transformer/ViTPose) | [Apache-2.0](licenses/APACHE-2.0.txt) |
|
| 36 |
+
| `gvhmr/yolov8x.pt` | [Ultralytics YOLOv8](https://github.com/ultralytics/ultralytics) | [AGPL-3.0](licenses/ULTRALYTICS-AGPL-3.0.txt) |
|
| 37 |
+
| `data/source/pexels/*.mp4` | Pexels example clips; individual sources are listed in [`data/source/pexels/README.md`](data/source/pexels/README.md) | [Pexels License](https://www.pexels.com/license/) |
|
| 38 |
+
|
| 39 |
+
The complete bundled license texts are in [`licenses/`](licenses/). Retain the
|
| 40 |
+
applicable license, copyright, and attribution notices when redistributing an
|
| 41 |
+
asset. Third-party assets remain governed by their upstream terms; their
|
| 42 |
+
presence does not change the license of the first-party 4DAnyone checkpoint.
|
README.md
CHANGED
|
@@ -1,85 +1,64 @@
|
|
| 1 |
---
|
| 2 |
license: other
|
|
|
|
|
|
|
| 3 |
pipeline_tag: video-to-video
|
| 4 |
tags:
|
| 5 |
- video-generation
|
| 6 |
-
-
|
|
|
|
| 7 |
- novel-view-synthesis
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
| 11 |
|
| 12 |
-
|
| 13 |
-
**Create Anyone in 4D from a Casual Monocular Video**.
|
| 14 |
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
|
|
|
|
|
|
| 18 |
|
| 19 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
```text
|
| 22 |
4danyone/
|
| 23 |
-
βββ model.safetensors
|
| 24 |
-
βββ smplx_to_goliath70.pt
|
| 25 |
-
βββ Wan2.2_VAE.pth
|
| 26 |
-
βββ models_t5_umt5-xxl-enc-bf16.pth
|
| 27 |
-
βββ umt5-xxl/
|
| 28 |
-
βββ special_tokens_map.json
|
| 29 |
-
βββ spiece.model
|
| 30 |
-
βββ tokenizer.json
|
| 31 |
-
βββ tokenizer_config.json
|
| 32 |
|
| 33 |
gvhmr/
|
| 34 |
-
βββ gvhmr_siga24_release.ckpt
|
| 35 |
-
βββ epoch=10-step=25000.ckpt
|
| 36 |
-
βββ vitpose-h-multi-coco.pth
|
| 37 |
-
βββ yolov8x.pt
|
| 38 |
|
| 39 |
data/source/pexels/
|
| 40 |
-
βββ eight 121-frame example videos
|
| 41 |
-
```
|
| 42 |
-
|
| 43 |
-
The 4DAnyone checkpoint is byte-identified by:
|
| 44 |
-
|
| 45 |
-
```text
|
| 46 |
-
4danyone/model.safetensors
|
| 47 |
-
sha256: aff60b0db2d333bd9e960a9cf3333cc8dd40fe76614a22f75a0da72be4e8289f
|
| 48 |
```
|
| 49 |
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
```text
|
| 53 |
-
4danyone/smplx_to_goliath70.pt
|
| 54 |
-
sha256: 725139e6cd14f986cd835468b2d62ca7abb9ffe29beb204d11f816e8e3fab40f
|
| 55 |
-
```
|
| 56 |
-
|
| 57 |
-
`SMPLX_NEUTRAL.npz` is required by the full skeleton-conditioning path but is
|
| 58 |
-
not redistributed here. Obtain it from the official SMPL-X website under its
|
| 59 |
-
own terms. The static-camera v1 path does not require DPVO weights.
|
| 60 |
-
|
| 61 |
-
## Asset licenses and provenance
|
| 62 |
-
|
| 63 |
-
This repository contains assets under multiple licenses; the repository-wide
|
| 64 |
-
Hugging Face license field is therefore `other`.
|
| 65 |
-
|
| 66 |
-
| Assets | Source | Terms included here |
|
| 67 |
-
|---|---|---|
|
| 68 |
-
| `4danyone/model.safetensors` | 4DAnyone | Apache-2.0 |
|
| 69 |
-
| MHR70 sparse regression tensors and renderer palette | 4DAnyone | Apache-2.0 |
|
| 70 |
-
| MHR70/Goliath keypoint name/order schema | [Meta Sapiens2](https://github.com/facebookresearch/sapiens2) | Sapiens2 agreement |
|
| 71 |
-
| Wan VAE, T5 encoder, and tokenizer | [Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) and [Wan2.1-T2V-1.3B](https://huggingface.co/Wan-AI/Wan2.1-T2V-1.3B) | Apache-2.0 |
|
| 72 |
-
| `gvhmr_siga24_release.ckpt` | [zju3dv/GVHMR](https://github.com/zju3dv/GVHMR) | GVHMR research/non-profit license |
|
| 73 |
-
| HMR2 checkpoint | [4DHumans](https://github.com/shubham-goel/4D-Humans) | MIT |
|
| 74 |
-
| ViTPose checkpoint | [ViTPose](https://github.com/ViTAE-Transformer/ViTPose) | Apache-2.0 |
|
| 75 |
-
| YOLOv8 checkpoint | [Ultralytics](https://github.com/ultralytics/ultralytics) | AGPL-3.0 |
|
| 76 |
-
| Example clips | [Pexels](https://www.pexels.com/license/) | Pexels license; per-video sources are listed with the clips |
|
| 77 |
-
|
| 78 |
-
Full license texts are under `licenses/`. Users are responsible for complying
|
| 79 |
-
with every applicable upstream term.
|
| 80 |
|
| 81 |
## Citation
|
| 82 |
|
|
|
|
|
|
|
| 83 |
```bibtex
|
| 84 |
@article{jin2026fdanyone,
|
| 85 |
title={4DAnyone: Create Anyone in 4D from a Casual Monocular Video},
|
|
|
|
| 1 |
---
|
| 2 |
license: other
|
| 3 |
+
license_name: multiple-licenses
|
| 4 |
+
license_link: https://huggingface.co/krahets/4DAnyone/blob/main/LICENSE
|
| 5 |
pipeline_tag: video-to-video
|
| 6 |
tags:
|
| 7 |
- video-generation
|
| 8 |
+
- multiview-video-generation
|
| 9 |
+
- 4D-human-reconstruction
|
| 10 |
- novel-view-synthesis
|
| 11 |
---
|
| 12 |
|
| 13 |
+
<h1 align="center">4DAnyone</h1>
|
| 14 |
|
| 15 |
+
<h2 align="center">Create Anyone in 4D from a Casual Monocular Video</h2>
|
|
|
|
| 16 |
|
| 17 |
+
<p align="center">
|
| 18 |
+
<a href="https://4danyone.github.io/"><strong>Project Page</strong></a>
|
| 19 |
+
|
|
| 20 |
+
<a href="https://github.com/ant-research/4DAnyone"><strong>Code</strong></a>
|
| 21 |
+
</p>
|
| 22 |
|
| 23 |
+
<p align="center">
|
| 24 |
+
<img src="assets/teaser.gif" width="100%" alt="4DAnyone teaser">
|
| 25 |
+
</p>
|
| 26 |
+
|
| 27 |
+
<p align="center">
|
| 28 |
+
4DAnyone turns a casual monocular video into multi-view videos, enabling downstream 4DGS reconstruction.
|
| 29 |
+
</p>
|
| 30 |
+
|
| 31 |
+
## Models
|
| 32 |
|
| 33 |
```text
|
| 34 |
4danyone/
|
| 35 |
+
βββ model.safetensors # 4DAnyone multi-view video generation checkpoint
|
| 36 |
+
βββ smplx_to_goliath70.pt # Sparse SMPL-X-to-MHR70 keypoint regressor and schema
|
| 37 |
+
βββ Wan2.2_VAE.pth # Wan2.2-TI2V-5B video VAE
|
| 38 |
+
βββ models_t5_umt5-xxl-enc-bf16.pth # UMT5-XXL text encoder weights
|
| 39 |
+
βββ umt5-xxl/ # UMT5-XXL tokenizer
|
| 40 |
+
βββ special_tokens_map.json # Special-token mapping
|
| 41 |
+
βββ spiece.model # SentencePiece model
|
| 42 |
+
βββ tokenizer.json # Serialized fast tokenizer
|
| 43 |
+
βββ tokenizer_config.json # Tokenizer configuration
|
| 44 |
|
| 45 |
gvhmr/
|
| 46 |
+
βββ gvhmr_siga24_release.ckpt # GVHMR global human-motion recovery checkpoint
|
| 47 |
+
βββ epoch=10-step=25000.ckpt # HMR2.0a image-feature extractor checkpoint
|
| 48 |
+
βββ vitpose-h-multi-coco.pth # ViTPose-H 2D human-pose checkpoint
|
| 49 |
+
βββ yolov8x.pt # YOLOv8-X person detector
|
| 50 |
|
| 51 |
data/source/pexels/
|
| 52 |
+
βββ eight 121-frame example videos # Ready-to-run inputs; sources are documented alongside them
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
```
|
| 54 |
|
| 55 |
+
Licensing is asset-specific. See [LICENSE](LICENSE) for the exact scope and
|
| 56 |
+
[licenses/](licenses/) for the complete terms.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
## Citation
|
| 59 |
|
| 60 |
+
If you find 4DAnyone useful or interesting, please cite our work and give us a star β:
|
| 61 |
+
|
| 62 |
```bibtex
|
| 63 |
@article{jin2026fdanyone,
|
| 64 |
title={4DAnyone: Create Anyone in 4D from a Casual Monocular Video},
|
assets/teaser.gif
ADDED
|
Git LFS Details
|
licenses/{MIT.txt β 4DHUMANS-MIT.txt}
RENAMED
|
File without changes
|
licenses/{GVHMR_LICENSE.txt β GVHMR-LICENSE.txt}
RENAMED
|
File without changes
|
licenses/{SAPIENS2_LICENSE.txt β SAPIENS2-LICENSE.txt}
RENAMED
|
File without changes
|
licenses/{AGPL-3.0.txt β ULTRALYTICS-AGPL-3.0.txt}
RENAMED
|
File without changes
|