lyric-sync / README.md
rikhoffbauer2's picture
Update ML Intern artifact metadata
f3b2a8d verified
|
Raw
History Blame Contribute Delete
802 Bytes
---
title: Lyric Sync
emoji: 🎡
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: 5.29.0
app_file: app.py
pinned: false
license: mit
suggested_hardware: zero-a10g
tags:
- ml-intern
---
# 🎡 Lyric Sync
Automatic perfect song lyric acquisition and synchronization.
Upload any song and get word-level synchronized lyrics with sub-10ms precision.
## Pipeline
1. **Vocal Separation** β€” Demucs htdemucs_ft (~9.2 dB SDR)
2. **Transcription** β€” Whisper large-v3 with word-level timestamps
3. **Song Identification** β€” AcoustID fingerprinting or transcript search
4. **Lyrics Fetching** β€” LRCLIB (free, no auth, synced LRC)
5. **Alignment** β€” Sequence alignment transfers ASR timings to correct lyrics
6. **Timing Refinement** β€” Onset/offset detection via librosa (5.8ms resolution)