File size: 824 Bytes
ba11d01 ff9bd41 ba11d01 ff9bd41 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 | ---
license: mit
tags:
- symbolic-music
- music-infilling
- midi
- masked-language-model
library_name: pytorch
---
# MIDIT — Checkpoints
Pretrained weights for **MIDIT**, a BERT-style masked language model for
symbolic music infilling (REMI+ tokenization, ~42.5M parameters).
Code, usage and full results: https://github.com/SimoneZanetti00/MIDIT
| File | Phase | Description |
|---|---|---|
| `midit-phase1-epoch14.ckpt` | Phase 1 (MLM pre-training) | base / zero-shot model, val_loss 2.7254 |
| `midit-infilling-epoch05.ckpt` | Phase 1b (BarFillMasking fine-tuning) | fine-tuned infilling model |
Weights contain the Lightning `state_dict` + `hyper_parameters` only
(optimizer state removed). Load with the model class from the repository.
Trained on the Lakh MIDI Dataset; released for research purposes.
|