ILKT

/

2024-06-17_21-37-12

like 0

Follow

Inter-Lingual Knowledge Transfer 4

Evaluation results

• accuracy on MTEB MassiveIntentClassification
  test set self-reported
  0.137
• accuracy on MTEB MassiveIntentClassification
  validation set self-reported
  0.125
• accuracy on MTEB MassiveScenarioClassification
  test set self-reported
  0.210
• accuracy on MTEB MassiveScenarioClassification
  validation set self-reported
  0.204
• accuracy on MTEB CBD
  test set self-reported
  0.542
• accuracy on MTEB PolEmo2.0-IN
  test set self-reported
  0.338
• accuracy on MTEB PolEmo2.0-OUT
  test set self-reported
  0.278
• accuracy on MTEB AllegroReviews
  test set self-reported
  0.207
• accuracy on MTEB PAC
  test set self-reported
  0.632
• v_measure on MTEB EightTagsClustering
  test set self-reported
  0.055
• ap on MTEB SICK-E-PL
  test set self-reported
  0.424
• ap on MTEB CDSC-E
  test set self-reported
  0.371
• ap on MTEB PSC
  test set self-reported
  0.381
• cosine_spearman on MTEB STS22
  test set self-reported
  -0.081
• cosine_spearman on MTEB STSBenchmarkMultilingualSTS
  self-reported
  0.357
• cosine_spearman on MTEB STSBenchmarkMultilingualSTS
  test set self-reported
  0.390
• cosine_spearman on MTEB SICK-R-PL
  test set self-reported
  0.319
• cosine_spearman on MTEB CDSC-R
  test set self-reported
  0.413
• v_measure on MTEB PlscClusteringS2S
  test set self-reported
  0.227
• v_measure on MTEB PlscClusteringP2P
  test set self-reported
  0.180