MIDIT-checkpoints / README.md
SimoneZanetti00's picture
Upload README.md with huggingface_hub
ff9bd41 verified
|
Raw
History Blame Contribute Delete
824 Bytes
metadata
license: mit
tags:
  - symbolic-music
  - music-infilling
  - midi
  - masked-language-model
library_name: pytorch

MIDIT — Checkpoints

Pretrained weights for MIDIT, a BERT-style masked language model for symbolic music infilling (REMI+ tokenization, ~42.5M parameters).

Code, usage and full results: https://github.com/SimoneZanetti00/MIDIT

File Phase Description
midit-phase1-epoch14.ckpt Phase 1 (MLM pre-training) base / zero-shot model, val_loss 2.7254
midit-infilling-epoch05.ckpt Phase 1b (BarFillMasking fine-tuning) fine-tuned infilling model

Weights contain the Lightning state_dict + hyper_parameters only (optimizer state removed). Load with the model class from the repository.

Trained on the Lakh MIDI Dataset; released for research purposes.