Spaces:
Running
Evaluating SalamandraTA-7B
Hi,
We would love it if SalamandraTA-7B (https://huggingface.co/BSC-LT/salamandraTA-7b-instruct) could be evaluated on this dataset and added to the leaderboard. Is there anything we can do to facilitate that?
Thanks!
Audrey (BSC MT Team)
Hi @AudreyVM !
We can surely add SalamandraTA-7B to the leaderboard (and we plan to update it with more languages anyway, as we have expanded the BOUQuET dataset enormously, see the Omnilingual MT paper).
I'll update this issue when it is done. And eventually, we'll probably try to make this leaderboard dynamic, like MTEB.
I just updated the leaderboard, including the extended BOUQuET set of directions (275 languages; 548 English-centric directions and 510 non-English centric ones) and added the SalamandraTA-7B model.
Closing the discussion as completed.