mHuBERT vs. ContentVec

#11

by Blakus - opened Jan 16, 2025

Jan 16, 2025

Hi. Is there any difference between mHubert and ContentVec in terms of quality?
Which one is more recent? I think ContentVec is not multilingual or is it?

I plan to improve the pronunciation of voice conversions through RVC, especially in multiple languages, by using mHuBERT.
RVC currently uses ContentVec.

What do you think? I think I will have to train a new pretrain base model using this mHuBERT :)

mzboito

UTTER - Unified Transcription and Translation for Extended Reality org Jan 17, 2025

Hi!

Thanks for the interest on the model. I am not familiar with ContentVec, but it seems to be an English-only model from 2022.
mHuBERT-147 is based on HuBERT, and trained on 147 languages. It was released last August, and it's a very competitive multilingual SSL block (see ML-SUPERB results).

If you train something based on mHuBERT-147, don't hesitate to let me know. :)

cmbrown

Oct 12, 2025

Hi Blakus, I am also looking at doing the same thing with RVC and mHubert. I'm curious, did you ended up trying this and what your results were like?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment