quark-llm-embedding-8B

Chinese Text Embedding Model developed by Alibaba Quark-LLM Team. Details will be published later.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Evaluation results

cosine_pearson on MTEB AFQMC (default)
validation set self-reported

52.877
cosine_spearman on MTEB AFQMC (default)
validation set self-reported

53.567
manhattan_pearson on MTEB AFQMC (default)
validation set self-reported

52.075
manhattan_spearman on MTEB AFQMC (default)
validation set self-reported

53.537
euclidean_pearson on MTEB AFQMC (default)
validation set self-reported

52.074
euclidean_spearman on MTEB AFQMC (default)
validation set self-reported

53.516
main_score on MTEB AFQMC (default)
validation set self-reported

53.567
cosine_pearson on MTEB ATEC (default)
test set self-reported

59.133
cosine_spearman on MTEB ATEC (default)
test set self-reported

53.422
manhattan_pearson on MTEB ATEC (default)
test set self-reported

60.052
manhattan_spearman on MTEB ATEC (default)
test set self-reported

53.369
euclidean_pearson on MTEB ATEC (default)
test set self-reported

60.177
euclidean_spearman on MTEB ATEC (default)
test set self-reported

53.431
main_score on MTEB ATEC (default)
test set self-reported

53.422
accuracy on MTEB AmazonReviewsClassification (zh)
test set self-reported

54.746
accuracy_stderr on MTEB AmazonReviewsClassification (zh)
test set self-reported

1.060
f1 on MTEB AmazonReviewsClassification (zh)
test set self-reported

53.498
f1_stderr on MTEB AmazonReviewsClassification (zh)
test set self-reported

1.729
main_score on MTEB AmazonReviewsClassification (zh)
test set self-reported

54.746
accuracy on MTEB AmazonReviewsClassification (zh)
validation set self-reported

53.468