Training Data Annotations on MTEB
#3
by kardosdrur - opened
Dear Team,
I'm Márton, maintainer of MTEB. I'm writing to you as we have recently started annotating training data for models on our leaderboard, to be able to display a "zero-shot" score to our users, which indicates how out-of-domain MTEB can be considered for the model.
We are still lacking information on what your Solon model family has been trained on.
I would kindly like to ask you to disclose, whether, and on which datasets in the French/English/Multilingual MTEB your model has been fine-tuned.
If none of the MTEB datasets were used for training, then please state this in your reply, and I will make sure to annotate your models as Zero-shot on the leaderboard.
Thanks in advance