openhe commited on
Commit
fdca10d
Β·
verified Β·
1 Parent(s): a57d66c

Add comprehensive README with video descriptions

Browse files
Files changed (1) hide show
  1. README.md +80 -0
README.md ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - 3d-gaussian-splatting
5
+ - avatar
6
+ - novel-view-synthesis
7
+ - human-reconstruction
8
+ ---
9
+
10
+ # GUAVA Demo Videos
11
+
12
+ This repository contains demo videos from [GUAVA: Generalizable Upper Body 3D Gaussian Avatar](https://github.com/Pixel-Talk/GUAVA).
13
+
14
+ ## πŸ“Ή Demo Videos
15
+
16
+ ### 1. Self-Reenactment
17
+ **File**: `demo_videos/self_reenactment.mp4` (3.1MB)
18
+
19
+ Self-reenactment using the same person's video. The model reconstructs a 3D Gaussian avatar and re-renders it from the original viewpoint.
20
+
21
+ ### 2. Cross-Reenactment
22
+ **File**: `demo_videos/cross_reenactment.mp4` (2.0MB)
23
+
24
+ Cross-reenactment transferring motion and expression from one video to a different person's image. This demonstrates the model's ability to generalize across different identities.
25
+
26
+ ### 3. Dynamic Novel Views (Rotation Only)
27
+ **File**: `demo_videos/dynamic_novel_views_rotation.mp4` (1.7MB)
28
+
29
+ Dynamic novel view synthesis with camera rotation around the avatar. The camera orbits around the subject while maintaining a fixed distance, showing the 3D consistency of the reconstructed avatar.
30
+
31
+ ### 4. Dynamic Novel Views (Rotation + Zoom) ⭐
32
+ **File**: `demo_videos/dynamic_novel_views_rotation_zoom.mp4` (1.8MB)
33
+
34
+ **This is the video with both rotation AND zoom!**
35
+
36
+ Dynamic novel view synthesis combining:
37
+ - **Camera rotation**: Horizontal and vertical rotation around the avatar
38
+ - **Camera zoom**: Smooth zoom in/out effect (0.7x to 1.3x distance variation)
39
+
40
+ This demonstrates the full 3D reconstruction quality with both viewpoint changes and distance variations.
41
+
42
+ ## 🎯 Features Demonstrated
43
+
44
+ | Feature | Self | Cross | Rotation | Rotation+Zoom |
45
+ |---------|------|-------|----------|---------------|
46
+ | Identity preservation | βœ… | βœ… | βœ… | βœ… |
47
+ | Motion transfer | βœ… | βœ… | βœ… | βœ… |
48
+ | Novel viewpoints | ❌ | ❌ | βœ… | βœ… |
49
+ | Distance variation | ❌ | ❌ | ❌ | βœ… |
50
+
51
+ ## πŸš€ Technical Details
52
+
53
+ - **Model**: GUAVA (286.98M parameters)
54
+ - **Input**: Tracked video with SMPL-X and FLAME parameters
55
+ - **Output**: 512x512 rendered frames at 30 FPS
56
+ - **Rendering Speed**: ~6-9 iterations/second on single GPU
57
+
58
+ ## πŸ“– Citation
59
+
60
+ If you find this work helpful, please cite:
61
+
62
+ ```bibtex
63
+ @article{GUAVA,
64
+ title={GUAVA: Generalizable Upper Body 3D Gaussian Avatar},
65
+ author={Zhang, Dongbin and Liu, Yunfei and Lin, Lijian and Zhu, Ye and Li, Yang and Qin, Minghan and Li, Yu and Wang, Haoqian},
66
+ journal={arXiv preprint arXiv:2505.03351},
67
+ year={2025}
68
+ }
69
+ ```
70
+
71
+ ## πŸ”— Links
72
+
73
+ - [Project Page](https://eastbeanzhang.github.io/GUAVA/)
74
+ - [Paper](https://arxiv.org/abs/2505.03351)
75
+ - [GitHub](https://github.com/Pixel-Talk/GUAVA)
76
+ - [EHM Tracker](https://github.com/Pixel-Talk/EHM-Tracker/)
77
+
78
+ ## πŸ“ License
79
+
80
+ MIT License