README.md

metadata

title: Lyric Sync
emoji: 🎵
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: 5.29.0
app_file: app.py
pinned: false
license: mit
suggested_hardware: zero-a10g
tags:
  - ml-intern

🎵 Lyric Sync

Automatic perfect song lyric acquisition and synchronization.

Upload any song and get word-level synchronized lyrics with sub-10ms precision.

Pipeline

1. Vocal Separation — Demucs htdemucs_ft (~9.2 dB SDR)
2. Transcription — Whisper large-v3 with word-level timestamps
3. Song Identification — AcoustID fingerprinting or transcript search
4. Lyrics Fetching — LRCLIB (free, no auth, synced LRC)
5. Alignment — Sequence alignment transfers ASR timings to correct lyrics
6. Timing Refinement — Onset/offset detection via librosa (5.8ms resolution)