ILKT

/

2024-06-19_08-22-22

like 0

Follow

Inter-Lingual Knowledge Transfer 4

Evaluation results

• accuracy on MTEB MassiveIntentClassification
  test set self-reported
  0.103
• accuracy on MTEB MassiveIntentClassification
  validation set self-reported
  0.107
• accuracy on MTEB MassiveScenarioClassification
  test set self-reported
  0.176
• accuracy on MTEB MassiveScenarioClassification
  validation set self-reported
  0.176
• accuracy on MTEB CBD
  test set self-reported
  0.507
• accuracy on MTEB PolEmo2.0-IN
  test set self-reported
  0.389
• accuracy on MTEB PolEmo2.0-OUT
  test set self-reported
  0.294
• accuracy on MTEB AllegroReviews
  test set self-reported
  0.220
• accuracy on MTEB PAC
  test set self-reported
  0.551
• v_measure on MTEB EightTagsClustering
  test set self-reported
  0.098
• ap on MTEB SICK-E-PL
  test set self-reported
  0.514
• ap on MTEB CDSC-E
  test set self-reported
  0.465
• ap on MTEB PSC
  test set self-reported
  0.405
• cosine_spearman on MTEB STS22
  test set self-reported
  -0.086
• cosine_spearman on MTEB STSBenchmarkMultilingualSTS
  self-reported
  0.432
• cosine_spearman on MTEB STSBenchmarkMultilingualSTS
  test set self-reported
  0.337
• cosine_spearman on MTEB SICK-R-PL
  test set self-reported
  0.391
• cosine_spearman on MTEB CDSC-R
  test set self-reported
  0.570
• v_measure on MTEB PlscClusteringS2S
  test set self-reported
  0.241
• v_measure on MTEB PlscClusteringP2P
  test set self-reported
  0.212