File size: 1,589 Bytes
9bedce4
19cadc0
 
 
 
9bedce4
330aee3
 
9bedce4
 
19cadc0
 
 
 
 
2b2710b
ff9ad90
9bedce4
c66e52a
9bedce4
c66e52a
9bedce4
c66e52a
9bedce4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
---
title: Audio Difficulty Estimator
emoji: 🎹
colorFrom: purple
colorTo: pink
sdk: gradio
sdk_version: "4.26.0"
python_version: 3.10.13
app_file: app.py
pinned: false
tags:
  - music
  - audio
  - piano
  - difficulty-estimation
short_description: Estimate piano difficulty from audio
hardware: "a100-large"
---

# 🎼 Music Difficulty Estimator

This Gradio app estimates the **difficulty of piano pieces** based on uploaded audio (MP3/MP4) or YouTube links. It uses pretrained models to generate a MIDI transcription and predict difficulty from three musical perspectives:

- CQT-based representation
- Piano roll representation
- Multimodal embeddings

## πŸ›  How it works

1. You upload an audio or video file, or paste a YouTube link.
2. The audio is transcribed to MIDI using a piano transcription model.
3. Three different difficulty models analyze the audio and generate predictions.
4. You can listen to the extracted MP3 and the generated MIDI.

## πŸ“¦ Model loading

All models are stored separately in the [pramoneda/audio](https://huggingface.co/pramoneda/audio) model repository and are downloaded dynamically via `huggingface_hub`.

## πŸ“ Input formats

- MP3 audio
- MP4 video (audio extracted automatically)
- YouTube links

## ✨ Built with

- `gradio` for the interface
- `pydub` and `yt_dlp` for audio processing
- `huggingface_hub` to load model checkpoints
- `ffmpeg-python` for format conversion

## πŸ”— Related

- [Model repo: pramoneda/audio](https://huggingface.co/pramoneda/audio)
- [More projects by pramoneda](https://huggingface.co/pramoneda)

---