Add model card

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +34 -3
README.md CHANGED
@@ -1,3 +1,34 @@
1
- ---
2
- license: cc-by-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ pipeline_tag: any-to-any
4
+ ---
5
+
6
+ # ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Body
7
+
8
+ ViBES (Voice in Behavioral Expression and Synchrony) is a speech-language-behavior (SLB) model with a mixture-of-modality-experts (MoME) architecture. It is a conversational 3D agent that jointly plans language and movement and executes dialogue-conditioned body actions, enabling controllable and socially competent 3D interaction.
9
+
10
+ - **Paper:** [ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Body](https://huggingface.co/papers/2512.14234)
11
+ - **Project Page:** [https://ai.stanford.edu/~juze/ViBES/](https://ai.stanford.edu/~juze/ViBES/)
12
+ - **GitHub Repository:** [https://github.com/Juzezhang/ViBES](https://github.com/Juzezhang/ViBES)
13
+
14
+ ## Usage
15
+
16
+ To run the inference for conversational behavior of facial expressions, please follow the environment setup instructions in the [official repository](https://github.com/Juzezhang/ViBES) and then use the following command:
17
+
18
+ ```bash
19
+ python inference/inference_a2m_face.py --user_text "If you had a superpower for one day, what would you choose?"
20
+ ```
21
+
22
+ ## Citation
23
+
24
+ If you find this work useful in your research, please consider citing:
25
+
26
+ ```bibtex
27
+ @inproceedings{
28
+ zhang2026vibes,
29
+ title={ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Body},
30
+ author={Juze Zhang and Changan Chen and Xin Chen and Heng Yu and Tiange Xiang and Ali Sartaz Khan and Shrinidhi Kowshika Lakshmikanth and Ehsan Adeli},
31
+ booktitle={CVPR},
32
+ year={2026},
33
+ }
34
+ ```