File size: 802 Bytes
34635ca
 
2e9992a
34635ca
 
2e9992a
f3b2a8d
34635ca
 
2e9992a
 
f3b2a8d
 
34635ca
 
2e9992a
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
title: Lyric Sync
emoji: 🎡
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: 5.29.0
app_file: app.py
pinned: false
license: mit
suggested_hardware: zero-a10g
tags:
- ml-intern
---

# 🎡 Lyric Sync

Automatic perfect song lyric acquisition and synchronization.

Upload any song and get word-level synchronized lyrics with sub-10ms precision.

## Pipeline

1. **Vocal Separation** β€” Demucs htdemucs_ft (~9.2 dB SDR)
2. **Transcription** β€” Whisper large-v3 with word-level timestamps
3. **Song Identification** β€” AcoustID fingerprinting or transcript search
4. **Lyrics Fetching** β€” LRCLIB (free, no auth, synced LRC)
5. **Alignment** β€” Sequence alignment transfers ASR timings to correct lyrics
6. **Timing Refinement** β€” Onset/offset detection via librosa (5.8ms resolution)