Voxtral Mini Realtime deciding to translate on its own ?
Hi,
I am a happy polyglot, we are making trials with the model and during those trials I am often switching from a language to another (e.g. a phrase in French followed by another in Spanish).
I have noticed that when I switch for example from French to Spanish, the model actually translates spoken Spanish into French text (and accurately). I also noticed this tends to happen more with a background noise in the mix.
Any explanation for that behavior ?
Yeah we noticed that behavior as well - it's pretty fun & surprising. It was not trained on it, but quite interesting that it does automatic translations out of no where before eventually switching to the new language.
Explanation for this is probably just that it's based on a strong 3B text model which is very good at translation, so it somehow "kept" this functionality and for some reason it gets triggered when swapping languages
Thanks for the explanation and indeed, it is funny !
Sinon, toutes mes félicitations à l'équipe, un très bon travail ! nos tests préliminaires nous donnent un taux de réussite supérieur à 95% en Anglais, Français et Espagnol.
... et un grand merci pour mettre le modèle dispo en open source.
Great work !
It does this even with a language not in the list ^^ It can translate some taïwanese (taigi) into mandarin. But only if I start speaking in mandarin before switching to taigi.
Is there a paper where the data used for training is described to have some idea of what to expect ?
thanks !