Commit Β·
86a6f6f
1
Parent(s): 665b1c5
Author the PianoVAM organization card
Browse files
README.md
CHANGED
|
@@ -1,10 +1,34 @@
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
+
emoji: πΉ
|
| 4 |
+
colorFrom: indigo
|
| 5 |
+
colorTo: purple
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
<div align="center">
|
| 11 |
+
|
| 12 |
+
# PianoVAM πΉ
|
| 13 |
+
|
| 14 |
+
**A multimodal piano performance dataset, and the models built on it.**
|
| 15 |
+
|
| 16 |
+
From the [MAC Lab](https://mac.kaist.ac.kr/) at KAIST and the [Music Informatics Group](https://musicinformatics.gatech.edu/) at Georgia Tech.
|
| 17 |
+
|
| 18 |
+
</div>
|
| 19 |
+
|
| 20 |
+
PianoVAM captures piano performance across every modality at once. Each of 107 practice recordings on a Yamaha Disklavier aligns top-view video, lossless audio, ground-truth MIDI, and 21-point hand landmarks to the same take. On top of the dataset we build models that read one modality from another, starting with V2N, which transcribes piano to complete MIDI from silent video alone.
|
| 21 |
+
|
| 22 |
+
### PianoVAM: a multimodal piano dataset (ISMIR 2025)
|
| 23 |
+
- ποΈ [Dataset](https://huggingface.co/datasets/PianoVAM/PianoVAM_v1)
|
| 24 |
+
- π¬ [Live demo](https://huggingface.co/spaces/PianoVAM/PianoVAM)
|
| 25 |
+
- π [Paper](https://arxiv.org/abs/2509.08800)
|
| 26 |
+
- π» [Code](https://github.com/yonghyunk1m/PianoVAM-Code)
|
| 27 |
+
|
| 28 |
+
### V2N: visual piano transcription (ISMIR 2026)
|
| 29 |
+
- π¬ [Live demo](https://huggingface.co/spaces/PianoVAM/V2N)
|
| 30 |
+
- π [Paper](https://arxiv.org/abs/2608.03419)
|
| 31 |
+
- π» [Code](https://github.com/yonghyunk1m/V2N)
|
| 32 |
+
|
| 33 |
+
### PiaRec & ASDF: acquisition and fingering toolkits (ISMIR 2025 LBD)
|
| 34 |
+
- π [Paper](https://arxiv.org/abs/2509.15222)
|