DialogueSidon / README.md
lucasnewman's picture
Upload 3 files
bd2b2c9 verified
|
Raw
History Blame Contribute Delete
1.43 kB
metadata
license: cc-by-nc-4.0
library_name: mlx-audio
tags:
  - mlx
  - audio
  - audio-source-separation
base_model: sarulab-speech/DialogueSidon

DialogueSidon

Two-speaker dialogue separation and restoration, with 24 kHz mono stems. Converted from sarulab-speech/DialogueSidon for use with mlx-audio.

from mlx_audio.sts import load
from mlx_audio.audio_io import write

model = load("mlx-community/DialogueSidon")
result = model.separate("dialogue.wav", num_steps=30, seed=0)
for i, speaker in enumerate(result.speakers, 1):
    write(f"speaker_{i}.wav", speaker, result.sample_rate)

The two channels are anonymous speaker slots. Long recordings use overlapping chunks and waveform correlation to maintain channel assignment. Consistency across silence is not guaranteed. This is an offline generative model, so the stems need not sum to the mixture. The default chunk and overlap are 20 and 5 seconds; use chunk_seconds=None for whole-file inference when memory permits.

The checkpoint retains CC-BY-NC-4.0. Original model by Wataru Nakata, Yuki Saito, Kazuki Yamauchi, Emiru Tsunoo, and Hiroshi Saruwatari (SaruLab). See the original model card and Sidon implementation.