Spaces:
Running on CPU Upgrade
Running on CPU Upgrade
Commit History
-
fix: wrap mutable ColumnContent defaults in field(default_factory=...) for Python 3.13 dataclass compatibility Running
f39aac5 -
fix: use field(default_factory=pd.DataFrame) instead of mutable default in dataclass (Python 3.13)
0bf55e2
-
fix bug: skip duplicate results
cd73296
-
fix a bug: index error. Empty results list.
ac93cff
-
update citation info
ae85833 -
update citation info and latest version
5182152
-
fix: update the version
51c1651
-
feat-add-versions-to-benchmarks (#28)
Verified signature- feat: use dataclass to manage the dataframes (59fa204055748670e8c233d868c45c69efe200cb) - feat: refactor the data loading function (ebf3ceb222b424e57c7d349208c4ed4dfbd64f51) - refactor: refactor the data loading part (2508d96450b4e8d1fa91e597122bfa2161e3afcd) - refactor: move the column names to a seperated file (e2d3123b00ca5941b9256763391bc8683f1312ab) - refactor: remove the unnecessary variables (592bb629777e9935559fa6673c9df7ca9983ab3e) - refactor: move the data model (4eb64b412adff3fdb1d0ffac94650d33ef9d0cc8) - refactor: refactor the benchmarks (649e0fbb68f339bdb81d780ae9c9b3ca6cf582a3) - fix: add the missing files (2d272e25de4e66b18f4b4ebb54f234be955217dc) - refactor: refactor the column settings (a7c0332d093c93dd5f8cc1a8aa8e44fb773c996d) - refactor: refactor the envs (ba13e25c5f99b7ed76231bf031df874bcb77ad5e) - refactor: refactor the envs (4791ac52051c86c18ab5098a03e1ea6a5f4a165e) - fix: fix the format (5e03e4ade3ec0f6839717e0aabdb057c1c14bbcf) - refactor: refactor the benchma…3478401
-
revert to 24.04 version
1981c31
-
feat-add-v2405 (#26)
Verified signature- update part code for v24.05 (257f64d0bddc9d6bac7df327345dac25bebc92c8) - feat: add v2024.05 (2bce3f3b3285bf8e6b4ab0920c2c52eb43c2cd2d) Co-authored-by: Jianlyu Chen <hanhainebula@users.noreply.huggingface.co>0785fe4
-
update about.py
30f9433
-
update about.py
19e0291 -
update about.py: add leaderboard backend link
49f004b
-
feat-replace-0-with-dash-0821 (#25)
Verified signature- feat: use -1 instead of 0 for presenting missing evals (7419959eff5199a0bd9a14e050c5fb71deee3dad)716a3e3 -
fix a bug in read_evals.py
439a031 -
fix a import bug in envs.py
7d7a455
-
fix bugs - 0819
3) replace "0" with "-" for average columna807b29 -
fix bugs - 0819
1) no hyperlink for "BM25" -> add hyperlink 2) unique key of df -> set to timestamp93fda91
-
chore: update the version
394f64e -
feat-add-meta-info-after-uploading-0607 (#20)
Verified signature- feat: add extra information for submission (7e047cd5cd5f0eba173f7c1a563a255470803c8d)9d64883 -
feat-switch-to-ndcg-for-qa-0607 (#19)
Verified signature- feat: update the default metric (4aa2126070c952b9ae87eb77e3f6e03f652729a1) - fix: fix the typo (f3888bb6aba9a4aeca13aae68aa10f48c58d2e29)973bd2a
-
feat-use-recall-as-default-metric-0605 (#18)
Verified signature- feat: use recall as the default metric (93420d3d9b50001e60126298d0360b8b0b74cf9a)bbfe4c1 -
feat-add-tabs-for-noreranker-0605 (#17)
Verified signature- feat: add tabs for noreranker (cbde34683e23fb24e5aa025c36226defe3bf8ffe) - fix: fix the update_metric_qa (03a7ba81e8f1938438cc84f3bd075ed6320bae6e) - feat: add noreranker tabs to long-doc (b7deaabc6f2fbecc29c8c429540154ff1a1e9924) - chore: update the versioning (6c77182af5ac643222324724dac29d45790849f4) - chore: rollback the settings (fbcdfeb6d0292777a6dfb5a101e9673ddedd2281) - chore: clean up (7beeb691a9f0f328ee18658e5d239c1a76a52660)b80bda9 -
Merge branch 'main' of https://huggingface.co/spaces/AIR-Bench/leaderboard
c1df819 -
fix: fix the missing file
0646823 -
refactor-leaderboard-0605 (#16)
Verified signature- refactor: refactoring the dashboard codes (1ac2307dc5bc3141ed2939476d35e4858a7bfbe8) - refactor: refactor the listeners (943fef8c6b63aa3880531f366d75a6e94d65d2e5)a0387d8 -
fix-show-no-reranker-bug-0531 (#14)
Verified signature- fix: fix the bug in loading hidden df (0fdaa881c5827d5cbee703c1161677fbbb9db591) - chore: clean up (3257e92fd596dff4ab637a129df5909de0bbc9ce)dccb8fe
-
fix a bug for anonymous retrieval model submisson
Verified signature933b575
-
fix-bug-in-selecting-domain-0522 (#13)
Verified signature- fix: fix the bug in selecting domains (b516d0f59e471ea119e60510c441cbb6f378a0d7)eb0f9c5 -
fix a bug in METRIC_LIST
443f557 -
modify the default value of reranking selector
658d5a4
-
disable law-zh
Verified signature8b7258f -
feat-rename-to-retrieval-methods-0520 (#11)
Verified signature- feat: disable model card check (070111910b2f23db4848f06bd2f46a2cbfdaea41) - feat: rename retrieval models to retrieval methods (6013e065717473982257244b52943187295ee3e0)f000c74
-
Fix bug in dataset_dict: "gpt-3" -> "gpt3"
Verified signature8102fce -
Fix bug in dataset_dict: "health" -> "healthcare"
Verified signature4a44211
-
feat-improve-submission-page-0517 (#10)
Verified signature- feat: update the submission and about page (019ad238188be6cb31f63db507eef05c83a55857)e93da78 -
fix-bug-in-show-details-0517 (#9)
Verified signature- fix: fix the bug in unselecting anonymous (cbe1b0de8f493aa6d6aa87e022f682b1f3a7c252)7ca7624
-
feat-add-no-reranker-button-0515 (#5)
Verified signature- feat: implement the no reranking button (9b59e476277d9d7796ea9ade3579f3e4fac32554) - feat: implement the no reranking button (fd21bf9057f3b18249b672e2eb84269ac63a1e7f)9002757 -
feat-add-reranker-url-validator-0515 (#4)
Verified signature- feat: add validation for the reranking models (6709543893db4707357e86d7d68a1812331e30a0)240d9ce
-
Modify the evaluation steps
606d718 -
feat-add-toggle-button-for-revision-col-0514 (#3)
Verified signature- feat: add the toggle checkbox (ea7f641055b8b1920e6b13455ec5d3f48cef3a64) - feat: add toggle checkbox for qa (fff686a88e3ddf8a1c85a594b174dfa51b97725f) - feat: add toggle checkbox for long-doc (4ab9cec62b148e8ef70ac23e8205477d47d34a14)77ded94 -
fix-reranking-0514 (#2)
Verified signature- fix: fix the ranking resetting issue (0531c42eec8ad47421b5c2eae51fa325e8334eac) - chore: clean up (472ecbda7ceabfb795535aa1ce9532f1935f22ab)3bab3e9 -
Merge branch 'main' of https://huggingface.co/spaces/AIR-Bench/leaderboard
7cbfcef -
fix: fix the bug in selecting reranking models
6925231 -
Modify the submission tips
Verified signature2dca7ce -
fix: fix the mean calculation for NAN values
08fea1e -
Modify the submission tips
Verified signature51dbe36 -
Modify the commands of evaluating
Verified signatureca2a141 -
Merge branch 'main' of https://huggingface.co/spaces/AIR-Bench/leaderboard
d27648d -
fix: fix the bug in the annoymous checkbox
f03a7b5