DUSUNEN-Rota-270M-v3 / evaluation.json
GoktugD's picture
DUSUNEN Rota 270M v3: natural-data E5-large distillation, beats base +4.6% nDCG
73b2156 verified
Raw
History Blame Contribute Delete
458 Bytes
{
"rota-v3-natural": {
"recall@1": 0.2666,
"recall@5": 0.4346,
"recall@10": 0.4702,
"recall@100": 0.5728,
"mrr@10": 0.6618,
"ndcg@10": 0.4535
},
"harrier-base": {
"recall@1": 0.2422,
"recall@5": 0.4219,
"recall@10": 0.459,
"recall@100": 0.5352,
"mrr@10": 0.6307,
"ndcg@10": 0.434
},
"e5-base": {
"recall@1": 0.292,
"recall@5": 0.4658,
"recall@10": 0.5308,
"recall@100": 0.728,
"mrr@10": 0.6967,
"ndcg@10": 0.4993
}
}