karchkha commited on
Commit
b3e4414
·
verified ·
1 Parent(s): e6c922a

Add model card

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - music-source-separation
5
+ - diffusion
6
+ - consistency-models
7
+ - audio
8
+ ---
9
+
10
+ # DiCoSe: Improving Music Source Separation with Diffusion and Consistency Refinement
11
+
12
+ Pre-trained checkpoints for **"Improving Music Source Separation with Diffusion and Consistency Refinement"**.
13
+
14
+ - Code: [github.com/Russell-Izadi-Bose/DiCoSe](https://github.com/Russell-Izadi-Bose/DiCoSe)
15
+ - Paper: [arXiv:2412.06965](https://arxiv.org/abs/2412.06965)
16
+ - Demo: [consistency-separation.github.io](https://consistency-separation.github.io/)
17
+
18
+ This repo hosts checkpoints for two experimental tracks described in the paper:
19
+
20
+ 1. A custom **U-Net** separator trained on **Slakh2100**.
21
+ 2. A **BS-RoFormer** separator (backbone from [Music-Source-Separation-Training](https://github.com/ZFTurbo/Music-Source-Separation-Training)) trained on **MUSDB18-HQ**.
22
+
23
+ For each track, three checkpoints are provided, corresponding to the three stages of the method: a Deterministic separator, a Diffusion refinement model trained on top of it, and a Consistency-Distilled (CD) model distilled from the diffusion model for fast (1-2 step) inference.
24
+
25
+ ## Files
26
+
27
+ | File | Track | Stage | SDR (dB, avg across stems) |
28
+ |---|---|---|---|
29
+ | `Deterministic_model_unet/model.ckpt` | U-Net / Slakh2100 | Deterministic | 10.89 |
30
+ | `diffusion_model_unet/model.ckpt` | U-Net / Slakh2100 | Diffusion | 11.34 |
31
+ | `CD_unet/model.ckpt` | U-Net / Slakh2100 | Consistency-Distilled | 11.42 (T=1) → 11.95 (T=4) |
32
+ | `Deterministic_model_MSST_bs_roformer/model.ckpt` | BS-RoFormer / MUSDB18 | Deterministic | 9.84 |
33
+ | `diffusion_model_MSST_bs_roformer/model.ckpt` | BS-RoFormer / MUSDB18 | Diffusion | 10.34 |
34
+ | `CD_MSST_bs_roformer/model.ckpt` | BS-RoFormer / MUSDB18 | Consistency-Distilled | 10.41 (T=1) → 10.40 (T=2) |
35
+
36
+ SDR is the median-over-1s-chunks SDR (via `museval`), averaged across stems on the respective test set, as reported in the paper. The Consistency-Distilled (CD) checkpoints are a single model evaluated at different numbers of inference steps (T); more steps generally improve quality further.
37
+
38
+ ## Usage
39
+
40
+ See the [GitHub repo](https://github.com/Russell-Izadi-Bose/DiCoSe) for the download script, environment setup, and eval configs that load these checkpoints. Training/eval code for the BS-RoFormer track is coming soon; checkpoints are published now for reference.
41
+
42
+ ## Citation
43
+
44
+ ```bibtex
45
+ @misc{karchkhadze2024improvingsourceextractiondiffusion,
46
+ title={Improving Music Source Separation with Diffusion and Consistency Refinement},
47
+ author={Tornike Karchkhadze and Mohammad Rasool Izadi and Shuo Zhang and Shlomo Dubnov},
48
+ year={2024},
49
+ eprint={2412.06965},
50
+ archivePrefix={arXiv},
51
+ primaryClass={cs.SD},
52
+ url={https://arxiv.org/abs/2412.06965},
53
+ }
54
+ ```
55
+
56
+ ## License
57
+
58
+ MIT