Spaces:
Running on Zero
Great job! :)
@yalishanda Hey Alex!
Thank you for creating and sharing this model! It's very interesting and I was wondering if I can ask you a few questions?
- Why did you go with MDN? Did it show a better performance?
- Have you considered using masked encoder-based archtecture? From my experience, it performs really well usually...
- Have you considered training on more data? E (GMD) are nice and everything but IMHO they are too small to train a well performing model.
So, if you get a minute, I wanted to invite you to check out my Discover MIDI Dataset. It has ~1M+ solo drum track MIDIs which (with included filtering) can be used for large drum track model pretraining.
Also, check out my Bidi Score where I use masked encoders to inpaint individual MIDI notes elements (i.e velocities or timings)
Last but not least I wanted to suggest giving your models more context to work with. I.e drum track + lead monophonic melody so that the model can infer velocities easier.
Anyways, thank you again for your models and the demo. Its really nice otherwise :)
I would be interested to chat about all of this if you have free time :)
Let me know.
Sincerely,
Alex.