File size: 1,228 Bytes
89f6edb
44e4078
 
 
 
89f6edb
 
 
44e4078
 
 
89f6edb
 
44e4078
 
ce37ff9
44e4078
 
 
 
 
 
 
d248a1f
44e4078
 
 
ce37ff9
44e4078
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
---
title: MuScriptor Music Transcription
emoji: 🎵
colorFrom: red
colorTo: blue
sdk: gradio
sdk_version: 6.20.0
app_file: app.py
short_description: Convert music audio to MIDI with MuScriptor
python_version: "3.12"
startup_duration_timeout: 30m
---

# MuScriptor Music Transcription

This Space demonstrates [MuScriptor](https://huggingface.co/MuScriptor/muscriptor-large), a ~1.3B parameter multi-instrument automatic music transcription (AMT) model developed by Mirelo x Kyutai.

Upload a music recording (any genre, multiple instruments) and the model will transcribe it into a downloadable MIDI file with per-note onset, offset, pitch, and instrument information.

## How it works

1. Upload an audio file (WAV, MP3, FLAC, etc.) or record from microphone
2. Optionally select which instruments are present to improve accuracy
3. Click "Transcribe" to play back / visualize the result and download the MIDI file

## Model details

- **Architecture**: Decoder-only Transformer (dim=1536, 24 heads, 48 layers)
- **Input**: 16 kHz mono audio → mel-spectrogram (512 mel bins)
- **Output**: MIDI-like token sequence using the MT3_FULL_PLUS taxonomy (36 instrument subgroups)
- **License**: CC-BY-NC 4.0 (weights) / MIT (code)