---
license: mit
tags:
  - symbolic-music
  - music-infilling
  - midi
  - masked-language-model
library_name: pytorch
---

# MIDIT — Checkpoints

Pretrained weights for **MIDIT**, a BERT-style masked language model for
symbolic music infilling (REMI+ tokenization, ~42.5M parameters).

Code, usage and full results: https://github.com/SimoneZanetti00/MIDIT

| File | Phase | Description |
|---|---|---|
| `midit-phase1-epoch14.ckpt` | Phase 1 (MLM pre-training) | base / zero-shot model, val_loss 2.7254 |
| `midit-infilling-epoch05.ckpt` | Phase 1b (BarFillMasking fine-tuning) | fine-tuned infilling model |

Weights contain the Lightning `state_dict` + `hyper_parameters` only
(optimizer state removed). Load with the model class from the repository.

Trained on the Lakh MIDI Dataset; released for research purposes.