kehong commited on
Commit
64d0b1c
Β·
0 Parent(s):

Super-squash branch 'main' using huggingface_hub

Browse files
Files changed (3) hide show
  1. .gitattributes +35 -0
  2. README.md +64 -0
  3. video2pos2rot_epoch60.pt +3 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: keypoint-detection
4
+ tags:
5
+ - arxiv:2604.28130
6
+ - motion-capture
7
+ - keypoint-detection
8
+ - animation
9
+ - pose-estimation
10
+ - bvh
11
+ - retargeting
12
+ - animals
13
+ library_name: pytorch
14
+ ---
15
+
16
+ # MoCapAnything V2 β€” Pretrained Weights
17
+
18
+ **End-to-End Motion Capture for Arbitrary Skeletons from Monocular Videos.**
19
+
20
+ This repo hosts the released end-to-end `video2pose2rot` checkpoint: a single network that maps a monocular video (plus a one-frame reference pose of the target species) directly to BVH-ready joint rotations β€” no analytical IK in the loop.
21
+
22
+ - πŸ“„ Paper: [MoCapAnything V2 on HF Papers](https://huggingface.co/papers/2604.28130) Β· [arXiv:2604.28130](https://arxiv.org/abs/2604.28130) Β· Project page: [animotionlab.github.io/MoCapAnythingV2](https://animotionlab.github.io/MoCapAnythingV2/)
23
+ - πŸ’» Code: [github.com/phongdaot/MocapAnything](https://github.com/phongdaot/MocapAnything)
24
+ - πŸ—‚ Demo data: [kehong/MoCapAnythingV2-data-sample](https://huggingface.co/datasets/kehong/MoCapAnythingV2-data-sample)
25
+
26
+ ## Files
27
+
28
+ | File | Description |
29
+ | --- | --- |
30
+ | `video2pos2rot_epoch60.pt` | End-to-end video β†’ pose β†’ rotation model (β‰ˆ464 MB) |
31
+
32
+ The background remover (`briaai/RMBG-1.4`) and the video encoder (`facebook/dinov2-large`) are pulled automatically from their own HuggingFace repos at runtime β€” they are not re-hosted here.
33
+
34
+ ## Usage
35
+
36
+ ```bash
37
+ git clone https://github.com/phongdaot/MocapAnything.git && cd MocapAnything
38
+ pip install torch torchvision numpy opencv-python pillow matplotlib scipy scikit-image \
39
+ trimesh roma pyyaml tqdm huggingface_hub transformers gradio imageio-ffmpeg
40
+
41
+ hf download kehong/MoCapAnythingV2-weights --local-dir ./checkpoints
42
+ hf download kehong/MoCapAnythingV2-data-sample --repo-type dataset --local-dir ./demo/data
43
+
44
+ # command-line inference on the bundled examples
45
+ python inference/video2pose2rot.py --config demo/configs/demo_wild.yaml
46
+ # or the interactive Gradio demo
47
+ python demo/app.py
48
+ ```
49
+
50
+ See the repo's [RUN.md](https://github.com/phongdaot/MocapAnything/blob/main/RUN.md) for the Blender render setup and full options.
51
+
52
+ ## Citation
53
+
54
+ ```bibtex
55
+ @article{gong2026mocapanythingv2,
56
+ title = {MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons},
57
+ author = {Gong, Kehong and Wen, Zhengyu and Phong, Dao Thien and
58
+ Xu, Mingxi and He, Weixia and Wang, Qi and Zhang, Ning and
59
+ Li, Zhengyu and Hou, Guanli and Lian, Dongze and He, Xiaoyu and
60
+ Zhang, Mingyuan and Zhang, Hanwang},
61
+ journal = {arXiv preprint arXiv:2604.28130},
62
+ year = {2026}
63
+ }
64
+ ```
video2pos2rot_epoch60.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f201f553225e937c743486db05c1edf10af37dce096d0c0e8722dda90de0b28f
3
+ size 463907650