qrel-analysis/beir_stat.md

Dataset | # Queries | # Corpus | # Judgments | (Avg) Q length | (Avg) D length | (Avg) d+/Q | (Avg) d-/Q | Judgment Levels msmarco-passage/trec-dl-2019/judged | 43 | 8841823 | 9260 | 5.40 | 56.25 | 95.40 | 119.95 | {0,1,2,3} msmarco-passage/trec-dl-2020/judged | 54 | 8841823 | 11386 | 6.04 | 56.25 | 66.78 | 144.07 | {0,1,2,3} beir/arguana | 1406 | 8674 | 1406 | 193.55 | 164.19 | 1.00 | 0.00 | {1} beir/climate-fever | 1535 | 5416593 | 4681 | 20.19 | 94.86 | 3.05 | 0.00 | {1} beir/dbpedia-entity/test | 400 | 4635922 | 43515 | 5.54 | 46.89 | 38.22 | 70.57 | {0,1,2} beir/fever/test | 6666 | 5416568 | 7937 | 8.45 | 94.86 | 1.19 | 0.00 | {1} beir/fiqa/test | 648 | 57638 | 1706 | 10.94 | 132.90 | 2.63 | 0.00 | {1} beir/hotpotqa/test | 7405 | 5233329 | 14810 | 15.72 | 43.72 | 2.00 | 0.00 | {1} beir/nfcorpus/test | 323 | 3633 | 12334 | 3.29 | 220.98 | 38.19 | 0.00 | {1,2} beir/nq | 3452 | 2681468 | 4201 | 9.16 | 76.03 | 1.22 | 0.00 | {1} beir/quora/test | 10000 | 522931 | 15675 | 9.53 | 11.46 | 1.57 | 0.00 | {1} beir/scidocs | 1000 | 25657 | 29928 | 9.44 | 167.24 | 4.93 | 25.00 | {0,1} beir/scifact/test | 300 | 5183 | 339 | 12.51 | 201.81 | 1.13 | 0.00 | {1} beir/trec-covid | 50 | 171332 | 66336 | 10.60 | 148.64 | 493.46 | 833.26 | {-1,0,1,2} beir/webis-touche2020/v2 | 49 | 382545 | 2214 | 6.55 | 286.46 | 19.02 | 26.16 | {0,1,2}