Add comprehensive README with video descriptions
Browse files
README.md
ADDED
|
@@ -0,0 +1,80 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- 3d-gaussian-splatting
|
| 5 |
+
- avatar
|
| 6 |
+
- novel-view-synthesis
|
| 7 |
+
- human-reconstruction
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# GUAVA Demo Videos
|
| 11 |
+
|
| 12 |
+
This repository contains demo videos from [GUAVA: Generalizable Upper Body 3D Gaussian Avatar](https://github.com/Pixel-Talk/GUAVA).
|
| 13 |
+
|
| 14 |
+
## πΉ Demo Videos
|
| 15 |
+
|
| 16 |
+
### 1. Self-Reenactment
|
| 17 |
+
**File**: `demo_videos/self_reenactment.mp4` (3.1MB)
|
| 18 |
+
|
| 19 |
+
Self-reenactment using the same person's video. The model reconstructs a 3D Gaussian avatar and re-renders it from the original viewpoint.
|
| 20 |
+
|
| 21 |
+
### 2. Cross-Reenactment
|
| 22 |
+
**File**: `demo_videos/cross_reenactment.mp4` (2.0MB)
|
| 23 |
+
|
| 24 |
+
Cross-reenactment transferring motion and expression from one video to a different person's image. This demonstrates the model's ability to generalize across different identities.
|
| 25 |
+
|
| 26 |
+
### 3. Dynamic Novel Views (Rotation Only)
|
| 27 |
+
**File**: `demo_videos/dynamic_novel_views_rotation.mp4` (1.7MB)
|
| 28 |
+
|
| 29 |
+
Dynamic novel view synthesis with camera rotation around the avatar. The camera orbits around the subject while maintaining a fixed distance, showing the 3D consistency of the reconstructed avatar.
|
| 30 |
+
|
| 31 |
+
### 4. Dynamic Novel Views (Rotation + Zoom) β
|
| 32 |
+
**File**: `demo_videos/dynamic_novel_views_rotation_zoom.mp4` (1.8MB)
|
| 33 |
+
|
| 34 |
+
**This is the video with both rotation AND zoom!**
|
| 35 |
+
|
| 36 |
+
Dynamic novel view synthesis combining:
|
| 37 |
+
- **Camera rotation**: Horizontal and vertical rotation around the avatar
|
| 38 |
+
- **Camera zoom**: Smooth zoom in/out effect (0.7x to 1.3x distance variation)
|
| 39 |
+
|
| 40 |
+
This demonstrates the full 3D reconstruction quality with both viewpoint changes and distance variations.
|
| 41 |
+
|
| 42 |
+
## π― Features Demonstrated
|
| 43 |
+
|
| 44 |
+
| Feature | Self | Cross | Rotation | Rotation+Zoom |
|
| 45 |
+
|---------|------|-------|----------|---------------|
|
| 46 |
+
| Identity preservation | β
| β
| β
| β
|
|
| 47 |
+
| Motion transfer | β
| β
| β
| β
|
|
| 48 |
+
| Novel viewpoints | β | β | β
| β
|
|
| 49 |
+
| Distance variation | β | β | β | β
|
|
| 50 |
+
|
| 51 |
+
## π Technical Details
|
| 52 |
+
|
| 53 |
+
- **Model**: GUAVA (286.98M parameters)
|
| 54 |
+
- **Input**: Tracked video with SMPL-X and FLAME parameters
|
| 55 |
+
- **Output**: 512x512 rendered frames at 30 FPS
|
| 56 |
+
- **Rendering Speed**: ~6-9 iterations/second on single GPU
|
| 57 |
+
|
| 58 |
+
## π Citation
|
| 59 |
+
|
| 60 |
+
If you find this work helpful, please cite:
|
| 61 |
+
|
| 62 |
+
```bibtex
|
| 63 |
+
@article{GUAVA,
|
| 64 |
+
title={GUAVA: Generalizable Upper Body 3D Gaussian Avatar},
|
| 65 |
+
author={Zhang, Dongbin and Liu, Yunfei and Lin, Lijian and Zhu, Ye and Li, Yang and Qin, Minghan and Li, Yu and Wang, Haoqian},
|
| 66 |
+
journal={arXiv preprint arXiv:2505.03351},
|
| 67 |
+
year={2025}
|
| 68 |
+
}
|
| 69 |
+
```
|
| 70 |
+
|
| 71 |
+
## π Links
|
| 72 |
+
|
| 73 |
+
- [Project Page](https://eastbeanzhang.github.io/GUAVA/)
|
| 74 |
+
- [Paper](https://arxiv.org/abs/2505.03351)
|
| 75 |
+
- [GitHub](https://github.com/Pixel-Talk/GUAVA)
|
| 76 |
+
- [EHM Tracker](https://github.com/Pixel-Talk/EHM-Tracker/)
|
| 77 |
+
|
| 78 |
+
## π License
|
| 79 |
+
|
| 80 |
+
MIT License
|