drumsep, ONNX (with the EyeLike fix)

splitzo/drumsep is an ONNX conversion of inagoy's drumsep (a Hybrid Demucs fine-tune that splits a drum track into kick, snare, cymbals and toms). This copy changes one thing so that it runs in ONNX Runtime's CPU provider, for the open-source Noodle audio workstation.

What was changed

The graph has four EyeLike nodes (in encoder.4 and encoder.5, the dconv layers) whose input is a boolean tensor; ONNX Runtime has no CPU kernel for that and refuses to load the model. The ConstantOfShape feeding each one now produces float32 zeros instead of booleans. The next node is a Cast back to boolean, so the result is the same. No weights changed.

Interface

  • inputs: waveform float32 [batch, 2, samples] and magnitude float32 [batch, 4, 2048, time_frames]; samples must be 1,764,000 (40 s at 44.1 kHz) and time_frames 1723. magnitude is the complex STFT (n_fft 4096, hop 1024) as real and imaginary channels, without the Nyquist bin.
  • outputs: freq_output [batch, 4, 4, 2048, 1723] and time_output [batch, 4, 2, 1764000]; stems in order kick, snare, cymbals, toms. Each stem is the inverse STFT of its spectrogram branch plus its time branch.
file bytes sha256
drumsep.onnx 335086863 349e911e9c9739b6328f59c13cabac8e152e07fd1a614a272206486fa176b975

Credit and licence

drumsep by inagoy (https://github.com/inagoy/drumsep), ONNX conversion by splitzo, both MIT. The licence on drumsep's training data is not stated by its author.

MIT License

Copyright (c) 2023 inagoy

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for jezza672/drumsep-onnx

Base model

inagoy/drumsep
Quantized
(1)
this model