Spaces:
Running
Running
Commit
Β·
9857531
1
Parent(s):
9560044
add sap-rpt-1-oss
Browse filesThis view is limited to 50 files because it contains too many changes. Β
See raw diff
- README.md +8 -1
- data/imputation_no/splits_all/tasks_all/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_all/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_all/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_all/website_leaderboard.csv +52 -51
- data/imputation_no/splits_all/tasks_all/datasets_all/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_medium/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_medium/website_leaderboard.csv +52 -51
- data/imputation_no/splits_all/tasks_all/datasets_medium/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_small/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_small/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_small/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_small/website_leaderboard.csv +52 -51
- data/imputation_no/splits_all/tasks_all/datasets_small/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/website_leaderboard.csv +57 -56
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_all/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_all/website_leaderboard.csv +54 -53
- data/imputation_no/splits_all/tasks_binary/datasets_all/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_medium/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_medium/website_leaderboard.csv +55 -54
- data/imputation_no/splits_all/tasks_binary/datasets_medium/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_small/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_small/website_leaderboard.csv +54 -53
- data/imputation_no/splits_all/tasks_binary/datasets_small/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/website_leaderboard.csv +60 -59
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_all/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_all/website_leaderboard.csv +54 -53
- data/imputation_no/splits_all/tasks_classification/datasets_all/winrate_matrix.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_medium/tuning-impact-elo.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_medium/website_leaderboard.csv +55 -54
README.md
CHANGED
|
@@ -27,4 +27,11 @@ Reference:
|
|
| 27 |
pip install -e ".[dev]"
|
| 28 |
# Or
|
| 29 |
uv pip install -r pyproject.toml && uv pip install pdf2image
|
| 30 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
pip install -e ".[dev]"
|
| 28 |
# Or
|
| 29 |
uv pip install -r pyproject.toml && uv pip install pdf2image
|
| 30 |
+
```
|
| 31 |
+
|
| 32 |
+
# Current Steps to get results:
|
| 33 |
+
1. Run https://github.com/autogluon/tabarena/blob/main/examples/plots/run_generate_website_artifacts.py
|
| 34 |
+
2. Run https://github.com/autogluon/tabarena/blob/main/scripts/run_generate_zip_for_website.py
|
| 35 |
+
* ake sure to update the relevant metadata for the LB in the `format_leaderboard` function and code!
|
| 36 |
+
3. Unzip the generated zip file into the `data` folder in this repo and run `data_pdfs_to_pngs.py`
|
| 37 |
+
4. Test the LB locally, otherwise you are done :)
|
data/imputation_no/splits_all/tasks_all/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:def4bff07f14c36cc14480de76d68d2b9708718c7359b64d2eb49c6c87b51bb6
|
| 3 |
+
size 446843
|
data/imputation_no/splits_all/tasks_all/datasets_all/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ea109b15e43b572c2048d230ade24248a53d6e191af98e58dccf9f04527fca0
|
| 3 |
+
size 934905
|
data/imputation_no/splits_all/tasks_all/datasets_all/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:02c6255dccd921f27823c4c120c7d34c5443506e671c4a6df959a430c1d54c97
|
| 3 |
+
size 115082
|
data/imputation_no/splits_all/tasks_all/datasets_all/website_leaderboard.csv
CHANGED
|
@@ -1,51 +1,52 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 6 |
-
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 7 |
-
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 8 |
-
6,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),
|
| 9 |
-
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 10 |
-
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 11 |
-
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),
|
| 12 |
-
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),
|
| 13 |
-
11
|
| 14 |
-
12
|
| 15 |
-
13,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),
|
| 16 |
-
14,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 17 |
-
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 18 |
-
16,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),
|
| 19 |
-
17,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 21 |
-
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),
|
| 22 |
-
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),
|
| 23 |
-
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),
|
| 24 |
-
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),
|
| 25 |
-
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),
|
| 26 |
-
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 27 |
-
25
|
| 28 |
-
26
|
| 29 |
-
27
|
| 30 |
-
28
|
| 31 |
-
29
|
| 32 |
-
30
|
| 33 |
-
31,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),
|
| 34 |
-
32
|
| 35 |
-
33,π³,Tree-based,[
|
| 36 |
-
34,π³,Tree-based,[
|
| 37 |
-
35,π³,Tree-based,[
|
| 38 |
-
36,π³,Tree-based,[
|
| 39 |
-
37
|
| 40 |
-
38
|
| 41 |
-
39
|
| 42 |
-
40
|
| 43 |
-
41
|
| 44 |
-
42
|
| 45 |
-
43
|
| 46 |
-
44
|
| 47 |
-
45
|
| 48 |
-
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),
|
| 49 |
-
47,π,Baseline,[
|
| 50 |
-
48,π,Baseline,[
|
| 51 |
-
49,π,Baseline,[
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1674.0,+64/-51,0.779,7.11,3.25,5.696,582.21,6.116,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1622.0,+87/-59,0.733,8.76,2.95,4.989,2040.22,8.92,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1576.0,+73/-54,0.675,10.47,4.04,5.962,2040.22,1.218,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1544.0,+71/-51,0.643,11.79,5.2,6.68,5.81,0.645,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1534.0,+55/-51,0.542,12.23,5.48,8.82,1735.72,2.559,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1532.0,+57/-47,0.541,12.29,7.13,8.942,2950.72,11.988,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1476.0,+64/-52,0.51,14.92,4.58,8.97,4907.64,286.652,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1462.0,+55/-42,0.415,15.58,8.43,10.369,3285.87,1.472,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1446.0,+36/-31,0.372,16.4,11.34,11.57,416.98,2.639,βοΈ,0.0,False,CPU
|
| 11 |
+
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1442.0,+47/-47,0.371,16.62,8.87,10.411,2950.72,0.663,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1429.0,+42/-42,0.351,17.3,10.3,11.136,1658.41,0.653,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1417.0,+41/-42,0.335,17.95,9.81,11.319,1658.41,0.081,βοΈ,0.0,False,CPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1416.0,+59/-58,0.418,17.96,6.14,10.351,4907.64,39.96,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1406.0,+82/-53,0.381,18.5,7.7,11.589,4621.67,8.149,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1401.0,+55/-47,0.333,18.77,9.81,11.277,3285.87,0.173,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1396.0,+30/-29,0.275,19.03,13.61,12.262,416.98,0.334,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1386.0,+34/-34,0.289,19.61,12.83,12.354,693.49,1.69,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1376.0,+41/-43,0.302,20.17,11.47,12.131,6.83,0.08,βοΈ,0.0,False,CPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1368.0,+45/-40,0.241,20.58,10.45,12.119,4621.67,0.475,βοΈ,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1363.0,+48/-40,0.259,20.89,12.21,12.749,846.88,2.552,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1361.0,+30/-32,0.233,21.0,15.22,12.678,693.49,0.308,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1336.0,+70/-59,0.335,22.37,7.33,13.017,47.62,43.739,βοΈ,0.0,False,GPU
|
| 24 |
+
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1311.0,+47/-37,0.189,23.79,14.73,14.035,846.88,0.13,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1303.0,+54/-47,0.226,24.27,14.7,13.768,10.49,0.132,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1297.0,+50/-49,0.159,24.61,16.79,13.542,2874.67,1.952,βοΈ,0.0,False,CPU
|
| 27 |
+
25,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1295.0,+58/-51,0.272,24.72,8.97,14.411,14.11,2.075,β,0.0,False,GPU
|
| 28 |
+
26,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1280.0,+42/-39,0.162,25.57,16.61,15.31,2929.85,0.422,βοΈ,0.0,False,CPU
|
| 29 |
+
27,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1256.0,+44/-42,0.119,26.94,16.39,15.671,14.87,0.308,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1241.0,+46/-44,0.11,27.77,17.92,15.99,2929.85,0.051,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1238.0,+37/-42,0.084,27.96,19.99,15.056,10.06,1.689,βοΈ,0.0,False,GPU
|
| 32 |
+
30,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1218.0,+39/-39,0.092,29.03,20.86,15.53,1.94,0.123,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1216.0,+42/-48,0.079,29.15,20.42,15.395,2874.67,0.131,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1216.0,+51/-60,0.129,29.15,17.72,16.432,593.24,4.467,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1210.0,+46/-43,0.099,29.47,19.54,17.023,183.02,0.761,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1207.0,+46/-48,0.107,29.68,20.02,17.135,7.32,0.05,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1189.0,+35/-30,0.048,30.63,26.49,16.14,1.96,0.142,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1179.0,+54/-48,0.073,31.2,20.58,17.919,373.18,0.771,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1171.0,+47/-52,0.075,31.59,19.83,17.986,183.02,0.091,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1151.0,+51/-55,0.056,32.68,21.94,17.928,593.24,0.306,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1141.0,+49/-45,0.05,33.17,21.01,18.69,373.18,0.085,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1072.0,+34/-49,0.009,36.57,29.41,19.793,9.99,0.126,βοΈ,0.0,False,CPU
|
| 43 |
+
41,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1043.0,+61/-62,0.03,37.89,30.27,23.406,3.23,0.919,βοΈ,0.0,False,GPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1004.0,+58/-60,0.01,39.56,29.17,22.789,2.86,0.373,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+45/-47,0.005,39.71,35.21,23.577,0.43,0.054,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),998.0,+62/-88,0.017,39.8,28.27,25.428,129.01,1.802,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),980.0,+58/-70,0.01,40.48,35.51,25.075,0.25,0.05,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),968.0,+65/-96,0.031,40.95,30.93,31.37,237.58,0.424,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),938.0,+71/-108,0.023,42.03,32.29,31.963,237.58,0.085,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),887.0,+67/-107,0.004,43.7,33.56,30.663,129.01,0.18,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),852.0,+77/-130,0.014,44.7,35.66,34.682,1.19,0.12,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),634.0,+89/-113,0.0,48.93,44.79,44.315,0.19,0.036,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_all/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b08addd3e815d85bed684d11a9abe993ef5c59d29a092c2ff8b71e377247b3e6
|
| 3 |
+
size 1957507
|
data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c6f2cf21459ad0b69f6902d50904f75268b00910ac1d7dcdb5b4d1efbca04e4b
|
| 3 |
+
size 416676
|
data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cc527d8877a52f15b9bd640a5538fa61cfd334e7211c78fb67a2ceec6f7f7b3d
|
| 3 |
+
size 933091
|
data/imputation_no/splits_all/tasks_all/datasets_medium/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6256b79d1e995b904310a0836d76b62e08fb2b967cdacd6fd4258ccf32f1fa6e
|
| 3 |
+
size 118151
|
data/imputation_no/splits_all/tasks_all/datasets_medium/website_leaderboard.csv
CHANGED
|
@@ -1,51 +1,52 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 5 |
-
3,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 6 |
-
4,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),
|
| 7 |
-
5,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),
|
| 8 |
-
6,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 9 |
-
7,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),
|
| 10 |
-
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 11 |
-
9,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),
|
| 12 |
-
10,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),
|
| 13 |
-
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),
|
| 14 |
-
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 15 |
-
13,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 16 |
-
14,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),
|
| 17 |
-
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 18 |
-
16,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),
|
| 19 |
-
17,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 21 |
-
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),
|
| 22 |
-
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 23 |
-
21,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 24 |
-
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),
|
| 25 |
-
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),
|
| 26 |
-
24,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),
|
| 27 |
-
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 28 |
-
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),
|
| 29 |
-
27,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),
|
| 30 |
-
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),
|
| 31 |
-
29,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),
|
| 32 |
-
30,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 33 |
-
31,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 34 |
-
32,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 35 |
-
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 36 |
-
34,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 37 |
-
35,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 38 |
-
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1206.0,+71/-
|
| 39 |
-
37
|
| 40 |
-
38
|
| 41 |
-
39,π§ π,Neural Network,[
|
| 42 |
-
40
|
| 43 |
-
41
|
| 44 |
-
42
|
| 45 |
-
43
|
| 46 |
-
44,π,Baseline,[
|
| 47 |
-
45
|
| 48 |
-
46
|
| 49 |
-
47,π,Baseline,[
|
| 50 |
-
48,π,Baseline,[
|
| 51 |
-
49,π,Baseline,[
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1821.0,+90/-48,0.837,5.84,2.86,2.566,289.53,3.187,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1801.0,+83/-48,0.811,6.35,3.08,2.669,432.35,4.085,βοΈ,0.0,False,CPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1673.0,+164/-122,0.664,10.31,3.09,5.382,735.58,11.736,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1647.0,+107/-94,0.588,11.29,6.97,5.684,1719.82,1.675,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1633.0,+127/-117,0.605,11.84,6.46,5.75,2526.28,6.013,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1618.0,+85/-62,0.545,12.41,6.65,5.585,777.59,0.25,βοΈ,0.0,False,CPU
|
| 8 |
+
6,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1617.0,+146/-113,0.596,12.45,5.04,6.097,735.58,1.386,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1608.0,+93/-67,0.547,12.84,5.68,5.783,777.59,0.052,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1600.0,+77/-58,0.498,13.18,8.89,7.351,131.56,2.639,βοΈ,0.0,False,CPU
|
| 11 |
+
9,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1564.0,+109/-97,0.531,14.73,7.15,5.97,3.24,0.031,βοΈ,0.0,False,CPU
|
| 12 |
+
10,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1558.0,+87/-61,0.454,15.0,8.92,7.478,282.13,0.563,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1546.0,+116/-94,0.414,15.53,8.77,7.016,1719.82,0.081,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1545.0,+154/-100,0.484,15.58,7.64,6.906,1.88,0.645,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1540.0,+155/-94,0.429,15.84,7.36,7.41,1993.14,0.619,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1531.0,+142/-126,0.49,16.22,4.17,7.024,4786.55,444.544,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1509.0,+82/-66,0.35,17.26,11.99,8.574,131.56,0.132,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1509.0,+69/-50,0.364,17.28,13.22,8.062,282.13,0.066,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1487.0,+151/-102,0.365,18.31,8.45,8.168,1993.14,0.061,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1479.0,+104/-92,0.33,18.69,12.57,8.151,2526.28,0.349,βοΈ,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1435.0,+111/-101,0.279,20.87,12.83,9.676,566.74,0.951,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1408.0,+123/-125,0.303,22.2,8.64,9.655,4786.55,42.641,βοΈ,0.0,False,GPU
|
| 23 |
+
21,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1386.0,+70/-70,0.186,23.3,17.02,9.424,1770.56,1.069,βοΈ,0.0,False,CPU
|
| 24 |
+
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1381.0,+96/-95,0.201,23.54,18.73,11.377,566.74,0.06,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1370.0,+100/-119,0.241,24.13,14.56,9.928,0.49,0.053,βοΈ,0.0,False,CPU
|
| 26 |
+
24,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1334.0,+129/-140,0.234,25.92,10.08,12.451,46.62,43.739,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1332.0,+119/-129,0.206,26.05,17.9,12.922,1517.65,0.134,βοΈ,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1326.0,+133/-110,0.181,26.33,17.46,11.007,5.16,0.074,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1301.0,+77/-82,0.105,27.6,23.67,11.463,8.06,0.25,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1279.0,+85/-71,0.049,28.71,25.76,12.214,6.75,0.235,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1276.0,+80/-77,0.061,28.87,24.51,11.211,1770.56,0.051,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1269.0,+109/-135,0.133,29.19,22.49,13.812,1517.65,0.015,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1257.0,+63/-75,0.056,29.79,27.46,11.863,0.29,0.045,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1250.0,+86/-78,0.04,30.14,24.3,12.418,66.0,0.341,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1218.0,+99/-139,0.097,31.62,27.07,15.399,3.12,0.016,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1217.0,+97/-88,0.042,31.71,25.66,13.131,66.0,0.024,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1211.0,+110/-138,0.072,31.96,25.22,14.369,351.94,1.658,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1206.0,+71/-84,0.024,32.18,29.89,12.542,36.48,0.329,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1205.0,+85/-93,0.047,32.27,27.42,14.333,11.44,10.416,β,0.0,False,GPU
|
| 40 |
+
38,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1158.0,+63/-75,0.01,34.39,32.69,13.771,36.48,0.037,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1117.0,+65/-74,0.0,36.16,34.61,15.534,2.18,0.039,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1099.0,+85/-109,0.021,36.91,32.77,16.646,351.94,0.114,βοΈ,0.0,False,CPU
|
| 43 |
+
41,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1046.0,+144/-192,0.018,38.96,34.13,23.683,2.49,0.145,βοΈ,0.0,False,GPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1019.0,+138/-180,0.025,39.96,35.77,20.34,1.51,0.111,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+60/-88,0.0,40.61,39.78,18.698,0.2,0.021,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),993.0,+86/-123,0.006,40.84,34.85,22.252,150.3,10.071,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),946.0,+151/-227,0.005,42.36,39.13,31.109,43.64,0.081,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),938.0,+107/-133,0.002,42.59,41.03,21.813,0.11,0.028,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),893.0,+156/-248,0.003,43.88,41.42,32.052,43.64,0.018,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),805.0,+58/-94,0.0,45.96,45.71,28.248,150.3,0.482,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),778.0,+139/-246,0.0,46.5,45.41,34.158,0.19,0.019,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),559.0,+106/-172,0.0,49.53,49.44,42.214,0.1,0.072,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_medium/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:178e1d8cd7f4413a3d0a9ad09d3ffd96ebdb0cd6baa5b2a7df91724aeeac0845
|
| 3 |
+
size 1828619
|
data/imputation_no/splits_all/tasks_all/datasets_small/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1618d16bd5c48e3e89a5a98a374d540ce9bf77ad318f3176cbf888e82de39f74
|
| 3 |
+
size 409271
|
data/imputation_no/splits_all/tasks_all/datasets_small/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:241667ceb4d651ace86ff16c9c34ea19dac4b5281de4c269a31983f7f482eab5
|
| 3 |
+
size 946630
|
data/imputation_no/splits_all/tasks_all/datasets_small/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aa66226bbb6de8b72abb536e6958317c2498758b0e35719c199258275df270cb
|
| 3 |
+
size 115405
|
data/imputation_no/splits_all/tasks_all/datasets_small/website_leaderboard.csv
CHANGED
|
@@ -1,51 +1,52 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 6 |
-
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 7 |
-
5,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),
|
| 8 |
-
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 9 |
-
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 11 |
-
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),
|
| 12 |
-
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 13 |
-
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 14 |
-
12,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),
|
| 15 |
-
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 16 |
-
14,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),
|
| 17 |
-
15
|
| 18 |
-
16
|
| 19 |
-
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 21 |
-
19,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),
|
| 22 |
-
20
|
| 23 |
-
21,π³,Tree-based,[
|
| 24 |
-
22
|
| 25 |
-
23
|
| 26 |
-
24
|
| 27 |
-
25
|
| 28 |
-
26
|
| 29 |
-
27
|
| 30 |
-
28
|
| 31 |
-
29,π§ π,Neural Network,[
|
| 32 |
-
30
|
| 33 |
-
31,π³,Tree-based,[
|
| 34 |
-
32
|
| 35 |
-
33
|
| 36 |
-
34
|
| 37 |
-
35
|
| 38 |
-
36,π³,Tree-based,[
|
| 39 |
-
37,π³,Tree-based,[
|
| 40 |
-
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 41 |
-
39
|
| 42 |
-
40
|
| 43 |
-
41
|
| 44 |
-
42
|
| 45 |
-
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),
|
| 46 |
-
44
|
| 47 |
-
45
|
| 48 |
-
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),
|
| 49 |
-
47,π,Baseline,[
|
| 50 |
-
48,π,Baseline,[
|
| 51 |
-
49,π,Baseline,[
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1635.0,+68/-53,0.755,7.64,3.45,7.001,659.63,7.444,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1620.0,+96/-63,0.762,8.11,2.89,4.825,2289.05,8.049,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1577.0,+77/-58,0.708,9.64,3.73,5.905,2289.05,1.143,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1562.0,+86/-61,0.709,10.21,4.59,6.586,6.76,0.636,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1502.0,+67/-48,0.522,12.71,7.2,10.299,3770.75,21.902,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1467.0,+83/-61,0.518,14.37,4.78,9.78,5119.36,218.711,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1460.0,+53/-47,0.431,14.68,8.1,11.383,3716.07,2.547,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1444.0,+58/-48,0.41,15.47,8.97,11.602,3553.12,1.741,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1430.0,+76/-58,0.466,16.19,5.48,10.64,5119.36,28.351,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1414.0,+54/-42,0.353,17.07,8.91,11.826,3770.75,1.778,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1401.0,+34/-36,0.319,17.75,12.81,13.328,892.41,2.574,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1378.0,+55/-51,0.32,18.97,10.51,12.572,3553.12,0.241,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1372.0,+42/-42,0.27,19.34,13.36,13.45,2476.51,0.814,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1364.0,+35/-29,0.244,19.77,14.42,13.799,892.41,0.346,βοΈ,0.0,False,CPU
|
| 16 |
+
14,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1359.0,+46/-34,0.247,20.08,14.09,13.626,2476.51,0.101,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1344.0,+72/-67,0.378,20.89,6.58,13.253,50.32,43.709,βοΈ,0.0,False,GPU
|
| 18 |
+
16,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1344.0,+47/-40,0.251,20.9,11.97,14.029,1126.71,2.941,βοΈ,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1337.0,+62/-60,0.288,21.27,8.36,14.021,6521.96,8.396,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1336.0,+45/-42,0.204,21.37,9.76,13.773,6521.96,0.506,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1333.0,+36/-38,0.22,21.53,15.7,14.385,884.18,2.368,βοΈ,0.0,False,CPU
|
| 22 |
+
20,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1332.0,+69/-59,0.366,21.57,7.0,14.443,16.22,1.278,β,0.0,False,GPU
|
| 23 |
+
21,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1317.0,+37/-40,0.207,22.43,15.33,14.699,9.64,0.128,βοΈ,0.0,False,CPU
|
| 24 |
+
22,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1315.0,+32/-36,0.178,22.55,16.24,14.601,884.18,0.393,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1300.0,+55/-47,0.245,23.41,13.79,14.918,13.18,0.17,βοΈ,0.0,False,GPU
|
| 26 |
+
24,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1292.0,+40/-43,0.185,23.9,13.52,15.143,1126.71,0.163,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1270.0,+46/-50,0.148,25.16,16.69,15.258,3865.95,2.158,βοΈ,0.0,False,CPU
|
| 28 |
+
26,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1266.0,+46/-44,0.144,25.37,16.13,16.306,3351.28,0.47,βοΈ,0.0,False,CPU
|
| 29 |
+
27,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1244.0,+48/-54,0.125,26.67,14.53,17.425,16.27,0.321,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1236.0,+47/-46,0.101,27.18,16.52,16.897,3351.28,0.056,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1227.0,+38/-42,0.098,27.64,18.29,16.24,15.69,4.691,βοΈ,0.0,False,GPU
|
| 32 |
+
30,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1222.0,+58/-63,0.153,27.98,15.77,17.292,1678.92,8.069,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1215.0,+69/-65,0.131,28.34,17.08,18.89,499.14,1.466,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1206.0,+50/-51,0.111,28.87,18.06,17.859,9.08,0.057,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1199.0,+40/-47,0.086,29.26,19.09,17.139,3865.95,0.148,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1179.0,+63/-62,0.102,30.42,17.04,19.742,499.14,0.207,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1170.0,+54/-52,0.07,30.91,19.28,18.462,1678.92,0.826,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1168.0,+40/-39,0.045,30.99,26.11,17.922,3.61,0.17,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1167.0,+35/-37,0.03,31.07,25.45,17.865,3.29,0.253,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1156.0,+58/-69,0.086,31.65,19.34,20.211,590.04,1.461,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1117.0,+54/-69,0.054,33.78,19.53,21.006,590.04,0.15,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1058.0,+45/-47,0.012,36.74,27.68,21.567,13.69,0.155,βοΈ,0.0,False,CPU
|
| 43 |
+
41,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1042.0,+67/-89,0.035,37.45,28.91,23.291,5.44,1.098,βοΈ,0.0,False,GPU
|
| 44 |
+
42,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+57/-73,0.007,39.34,33.6,25.61,0.51,0.089,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),999.0,+72/-94,0.022,39.37,26.21,26.751,111.84,1.215,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),999.0,+49/-61,0.003,39.4,27.09,23.81,5.48,0.685,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),994.0,+71/-75,0.013,39.6,33.63,26.434,0.47,0.092,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),975.0,+84/-100,0.043,40.36,28.45,31.478,520.95,0.647,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),952.0,+83/-107,0.031,41.26,29.58,31.926,520.95,0.113,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),910.0,+73/-92,0.006,42.76,30.21,31.67,111.84,0.111,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),873.0,+99/-125,0.02,43.95,32.73,34.901,2.59,0.138,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),653.0,+111/-144,0.0,48.68,43.1,45.191,0.37,0.033,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_small/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0cf778466ada9eac48b665e0deced41a66871292039f96dcf26d4a24b28bcc08
|
| 3 |
+
size 1930980
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6ac3a6e6c121da4b53f4113ad98316bb36f496148e10d689e58e842b52248677
|
| 3 |
+
size 442564
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e524c9ce9da0571d7222e7e68df51ca422c6fc30a9c5625d2120d702feb52555
|
| 3 |
+
size 1001251
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1c79dc92b06beb91d34ff5b2bc958d671472ae0d74fad73e09c977fb04bf1635
|
| 3 |
+
size 121006
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/website_leaderboard.csv
CHANGED
|
@@ -1,56 +1,57 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 6 |
-
4,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),
|
| 7 |
-
5
|
| 8 |
-
6,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 9 |
-
7
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),
|
| 11 |
-
9,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 12 |
-
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 13 |
-
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 14 |
-
12,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),
|
| 16 |
-
14,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 17 |
-
15,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),
|
| 18 |
-
16,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 19 |
-
17,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),
|
| 20 |
-
18,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),
|
| 22 |
-
20
|
| 23 |
-
21
|
| 24 |
-
22
|
| 25 |
-
23
|
| 26 |
-
24,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 27 |
-
25
|
| 28 |
-
26,π³,Tree-based,[
|
| 29 |
-
27
|
| 30 |
-
28
|
| 31 |
-
29
|
| 32 |
-
30
|
| 33 |
-
31,π§ π,Neural Network,[
|
| 34 |
-
32
|
| 35 |
-
33
|
| 36 |
-
34,π§ π,Neural Network,[
|
| 37 |
-
35
|
| 38 |
-
36,π³,Tree-based,[
|
| 39 |
-
37
|
| 40 |
-
38,π§ π,Neural Network,[
|
| 41 |
-
39
|
| 42 |
-
40,π³,Tree-based,[
|
| 43 |
-
41,π³,Tree-based,[
|
| 44 |
-
42,π³,Tree-based,[
|
| 45 |
-
43,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 46 |
-
44
|
| 47 |
-
45
|
| 48 |
-
46
|
| 49 |
-
47
|
| 50 |
-
48,π,Baseline,[
|
| 51 |
-
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),
|
| 52 |
-
50
|
| 53 |
-
51
|
| 54 |
-
52,π,Baseline,[
|
| 55 |
-
53,π,Baseline,[
|
| 56 |
-
54,π,Baseline,[
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1636.0,+92/-70,0.738,9.28,3.47,5.487,2166.18,7.945,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1633.0,+76/-53,0.712,9.4,4.29,7.843,611.55,7.01,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1599.0,+64/-62,0.714,10.78,5.44,7.146,6.14,0.586,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1594.0,+73/-62,0.686,10.99,4.31,6.585,2166.18,0.993,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),1543.0,+73/-49,0.583,13.29,5.59,9.672,3899.42,55.833,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ π,Neural Network,[Mitra (default)](https://arxiv.org/abs/2510.21204),1513.0,+73/-47,0.555,14.79,6.01,10.779,136.59,3.391,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1510.0,+54/-44,0.493,14.92,8.32,11.276,3547.04,20.963,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π§ π,Neural Network,[LimiX (default)](https://arxiv.org/abs/2509.03505),1504.0,+73/-71,0.574,15.25,5.51,13.315,4.85,0.629,β,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1466.0,+74/-61,0.471,17.34,5.5,10.795,4980.83,207.372,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1456.0,+45/-50,0.381,17.88,10.09,12.435,3376.59,2.54,βοΈ,0.0,False,CPU
|
| 12 |
+
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1444.0,+55/-50,0.364,18.6,10.4,12.664,3372.56,1.658,βοΈ,0.0,False,GPU
|
| 13 |
+
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1440.0,+79/-68,0.441,18.8,6.02,11.57,4980.83,23.583,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),1437.0,+80/-68,0.426,19.0,6.98,12.223,3899.42,0.983,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1420.0,+56/-47,0.331,19.97,10.64,12.828,3547.04,1.57,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1395.0,+36/-34,0.255,21.47,15.3,14.595,771.57,2.49,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),1388.0,+69/-67,0.388,21.92,9.49,13.784,4.22,0.554,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1381.0,+58/-50,0.278,22.34,11.97,13.664,3372.56,0.208,βοΈ,0.0,False,GPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1381.0,+42/-36,0.232,22.36,15.41,14.608,2034.85,0.805,βοΈ,0.0,False,CPU
|
| 20 |
+
18,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1367.0,+36/-33,0.213,23.25,16.61,14.804,2034.85,0.097,βοΈ,0.0,False,CPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1365.0,+89/-66,0.379,23.36,7.07,14.238,48.9,43.804,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1362.0,+65/-67,0.346,23.56,7.96,15.219,14.11,1.17,β,0.0,False,GPU
|
| 23 |
+
21,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1361.0,+36/-30,0.185,23.61,17.3,15.073,771.57,0.322,βοΈ,0.0,False,CPU
|
| 24 |
+
22,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1340.0,+50/-45,0.201,24.91,15.09,15.311,1105.59,2.552,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1336.0,+36/-36,0.175,25.15,18.83,15.668,828.74,2.312,βοΈ,0.0,False,CPU
|
| 26 |
+
24,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1336.0,+73/-67,0.249,25.17,11.47,15.327,6147.69,8.149,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1336.0,+46/-49,0.171,25.17,11.99,14.894,6147.69,0.485,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1325.0,+48/-44,0.178,25.85,17.59,15.936,8.51,0.123,βοΈ,0.0,False,CPU
|
| 29 |
+
27,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1318.0,+32/-33,0.135,26.28,18.98,15.886,828.74,0.336,βοΈ,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1312.0,+53/-53,0.219,26.71,15.44,16.015,12.24,0.154,βοΈ,0.0,False,GPU
|
| 31 |
+
29,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1294.0,+45/-40,0.149,27.83,16.61,16.438,1105.59,0.13,βοΈ,0.0,False,GPU
|
| 32 |
+
30,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1281.0,+48/-44,0.113,28.67,18.84,17.425,2929.85,0.433,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1272.0,+48/-53,0.124,29.2,20.68,16.423,3704.3,2.074,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1266.0,+48/-43,0.116,29.61,16.23,18.028,16.16,0.307,βοΈ,0.0,False,GPU
|
| 35 |
+
33,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1251.0,+52/-49,0.079,30.59,18.58,18.029,2929.85,0.054,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1243.0,+42/-38,0.082,31.04,20.45,17.117,15.48,4.535,βοΈ,0.0,False,GPU
|
| 37 |
+
35,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1234.0,+51/-62,0.14,31.61,17.15,18.454,1459.62,8.056,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1218.0,+49/-53,0.073,32.64,20.44,18.893,8.47,0.054,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1211.0,+60/-62,0.097,33.03,21.91,20.439,416.39,1.393,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1202.0,+47/-48,0.067,33.62,21.81,18.319,3704.3,0.143,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1180.0,+56/-61,0.061,34.94,21.38,19.639,1459.62,0.89,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1176.0,+57/-61,0.065,35.14,23.11,21.259,416.39,0.179,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1172.0,+38/-38,0.02,35.42,30.3,19.257,3.05,0.241,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1158.0,+33/-42,0.022,36.23,31.72,19.461,3.39,0.158,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1141.0,+56/-58,0.044,37.17,25.69,21.955,572.67,1.421,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1102.0,+48/-48,0.017,39.34,27.82,22.731,572.67,0.143,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1066.0,+50/-61,0.013,41.23,31.06,22.804,11.82,0.147,βοΈ,0.0,False,CPU
|
| 48 |
+
46,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1052.0,+72/-82,0.027,41.91,32.45,24.878,5.39,1.034,βοΈ,0.0,False,GPU
|
| 49 |
+
47,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1010.0,+54/-67,0.001,43.91,29.79,24.901,5.18,0.652,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1005.0,+72/-88,0.012,44.14,31.64,28.265,100.58,1.106,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1003.0,+81/-87,0.008,44.21,37.49,27.463,0.42,0.078,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1003.0,+72/-107,0.044,44.22,30.57,31.413,504.17,0.629,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+56/-71,0.002,44.34,38.83,26.728,0.47,0.069,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),980.0,+74/-108,0.03,45.19,32.31,31.822,504.17,0.103,βοΈ,0.0,False,CPU
|
| 55 |
+
53,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),909.0,+77/-103,0.0,47.87,34.26,33.409,100.58,0.101,βοΈ,0.0,False,CPU
|
| 56 |
+
54,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),904.0,+80/-126,0.019,48.07,35.41,34.282,2.51,0.137,βοΈ,0.0,False,CPU
|
| 57 |
+
55,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),679.0,+97/-168,0.0,53.42,46.54,45.736,0.29,0.028,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e58763ac13cff7c9cce0aaca4d2187ee8e1710234aa10560313196c7b14f377c
|
| 3 |
+
size 2394027
|
data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fac4e26f5a7e7ca288c2c57115a104635f3738f1321c1711bdfec10610a3900d
|
| 3 |
+
size 442773
|
data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:86a37085d7f67faa4342c4d9f111bf5b24f57d88ef6fe5f0631d387ed7445e8b
|
| 3 |
+
size 936941
|
data/imputation_no/splits_all/tasks_binary/datasets_all/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:520671463bfa8ac1313b8b0d0100144b6f7ffac121c3cb0ac38c752fb74174c4
|
| 3 |
+
size 118287
|
data/imputation_no/splits_all/tasks_binary/datasets_all/website_leaderboard.csv
CHANGED
|
@@ -1,53 +1,54 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1545.0,+101/-57,
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1535.0,+
|
| 6 |
-
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 7 |
-
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 8 |
-
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 9 |
-
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),
|
| 11 |
-
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 12 |
-
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1408.0,+
|
| 13 |
-
11,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1403.0,+
|
| 14 |
-
12,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),
|
| 16 |
-
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),
|
| 17 |
-
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 18 |
-
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1380.0,+68/-
|
| 19 |
-
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 22 |
-
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),
|
| 23 |
-
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),
|
| 24 |
-
22,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 25 |
-
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),
|
| 26 |
-
24,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1311.0,+
|
| 27 |
-
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1302.0,+47/-58,
|
| 28 |
-
26,π§ β‘,Foundation Model,[
|
| 29 |
-
27
|
| 30 |
-
28
|
| 31 |
-
29,π§ π,Neural Network,[
|
| 32 |
-
30
|
| 33 |
-
31
|
| 34 |
-
32,π³,Tree-based,[
|
| 35 |
-
33
|
| 36 |
-
34,π§ π,Neural Network,[
|
| 37 |
-
35
|
| 38 |
-
36,π³,Tree-based,[
|
| 39 |
-
37,π³,Tree-based,[
|
| 40 |
-
38,π³,Tree-based,[
|
| 41 |
-
39,π³,Tree-based,[
|
| 42 |
-
40
|
| 43 |
-
41,π§ π,Neural Network,[
|
| 44 |
-
42
|
| 45 |
-
43
|
| 46 |
-
44
|
| 47 |
-
45,π,Baseline,[
|
| 48 |
-
46
|
| 49 |
-
47
|
| 50 |
-
48
|
| 51 |
-
49
|
| 52 |
-
50
|
| 53 |
-
51,π,Baseline,[KNN (
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1655.0,+97/-71,0.791,7.53,3.0,5.801,442.09,6.381,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1567.0,+111/-62,0.674,10.74,3.65,6.072,1923.88,9.103,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1545.0,+101/-57,0.672,11.67,4.88,7.151,4.91,0.694,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1535.0,+100/-58,0.626,12.14,4.4,7.181,1923.88,1.329,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1513.0,+74/-64,0.552,13.16,5.3,9.088,1152.95,1.784,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1498.0,+52/-55,0.489,13.85,8.9,10.194,2775.44,8.849,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1474.0,+76/-58,0.448,15.11,7.31,10.846,2229.7,1.387,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1436.0,+56/-38,0.379,17.09,10.99,12.349,328.96,1.102,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1421.0,+72/-63,0.42,17.97,6.01,9.185,4982.66,358.753,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1414.0,+80/-59,0.366,18.34,8.71,11.761,2229.7,0.133,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1408.0,+62/-51,0.35,18.68,10.01,12.129,1055.6,0.482,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1403.0,+60/-53,0.351,18.99,9.32,12.223,1055.6,0.063,βοΈ,0.0,False,CPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1402.0,+56/-50,0.362,19.01,9.45,12.097,4.27,0.064,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1399.0,+51/-56,0.291,19.2,9.83,11.992,2775.44,0.415,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1384.0,+61/-52,0.31,20.09,11.3,13.257,472.99,0.621,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1383.0,+49/-31,0.267,20.14,13.61,13.208,328.96,0.126,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1380.0,+68/-66,0.355,20.34,9.6,14.109,250.36,1.708,β,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1366.0,+94/-94,0.372,21.13,8.49,12.927,3383.91,8.396,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1365.0,+56/-59,0.244,21.17,9.89,12.885,3383.91,0.51,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1354.0,+64/-59,0.3,21.84,7.11,10.877,4982.66,42.199,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1349.0,+48/-42,0.231,22.16,14.53,13.773,472.99,0.13,βοΈ,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1330.0,+58/-56,0.206,23.31,13.25,13.888,642.33,2.767,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1317.0,+50/-42,0.191,24.1,15.97,13.504,2241.65,2.415,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1311.0,+68/-66,0.246,24.43,13.5,14.462,8.72,0.126,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1311.0,+51/-46,0.171,24.46,15.88,15.381,1560.02,0.404,βοΈ,0.0,False,CPU
|
| 27 |
+
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1302.0,+47/-58,0.169,25.01,14.17,15.164,642.33,0.146,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1295.0,+65/-62,0.243,25.42,10.31,15.901,12.86,3.167,β,0.0,False,GPU
|
| 29 |
+
27,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1282.0,+65/-72,0.244,26.22,9.53,14.248,49.67,43.824,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1275.0,+50/-46,0.111,26.67,16.79,16.094,1560.02,0.052,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1267.0,+49/-43,0.142,27.15,14.44,15.94,13.5,0.311,βοΈ,0.0,False,GPU
|
| 32 |
+
30,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1266.0,+60/-63,0.148,27.18,16.95,15.531,559.38,4.08,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1264.0,+43/-43,0.106,27.33,18.23,14.851,9.33,1.116,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1248.0,+48/-51,0.114,28.32,17.77,17.149,4.98,0.049,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1232.0,+66/-57,0.117,29.26,18.52,16.412,1.24,0.11,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1225.0,+46/-40,0.073,29.68,20.15,15.714,2241.65,0.136,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1190.0,+56/-62,0.058,31.72,20.46,17.57,559.38,0.276,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1187.0,+51/-52,0.06,31.9,22.47,18.049,125.38,0.674,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1180.0,+50/-35,0.048,32.35,27.56,17.195,0.81,0.093,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1155.0,+51/-57,0.034,33.76,23.41,19.411,169.75,0.603,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1146.0,+50/-51,0.037,34.27,24.55,19.211,125.38,0.069,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1120.0,+42/-55,0.018,35.69,25.47,20.141,169.75,0.059,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1092.0,+64/-49,0.014,37.14,28.23,20.117,4.95,0.091,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1057.0,+64/-81,0.017,38.93,25.22,21.507,2.56,0.267,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1050.0,+83/-106,0.054,39.25,26.66,26.853,162.68,0.405,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1043.0,+108/-117,0.094,39.57,23.05,25.571,0.85,0.129,β,0.0,False,GPU
|
| 47 |
+
45,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1022.0,+60/-104,0.017,40.56,29.08,24.258,139.84,3.917,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1021.0,+91/-118,0.039,40.58,28.09,27.547,162.68,0.054,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+62/-79,0.012,41.52,35.08,24.336,0.25,0.029,βοΈ,0.0,False,CPU
|
| 50 |
+
48,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),983.0,+72/-103,0.021,42.22,34.49,26.628,2.8,0.564,βοΈ,0.0,False,GPU
|
| 51 |
+
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),958.0,+86/-118,0.024,43.22,31.03,29.49,0.84,0.094,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),956.0,+73/-90,0.01,43.3,37.32,25.807,0.2,0.037,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),915.0,+81/-134,0.001,44.8,32.2,29.37,139.84,0.193,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),601.0,+106/-200,0.0,51.34,47.51,43.9,0.15,0.023,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_all/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3c5a7a8c549d85a3455629e911869573d7c46ceff24aa614a69d6a6a2aee34d9
|
| 3 |
+
size 2255151
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e49df088101fd65ac80b606f45df307c27ee7dd0ac00fc4130cc42156ed3b008
|
| 3 |
+
size 434196
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4250d8514d25432ab0371f39c76a9f05c6674e6bc4bb9d0101da89fae4c8d2ac
|
| 3 |
+
size 904943
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:808a8dd5bbfd5d44f283ef8815b0a1a5239c73148fd7d5df8d3e1b01234fa1a9
|
| 3 |
+
size 124955
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/website_leaderboard.csv
CHANGED
|
@@ -1,54 +1,55 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 4 |
-
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),
|
| 5 |
-
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),
|
| 6 |
-
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 7 |
-
5,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),
|
| 8 |
-
6,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),
|
| 9 |
-
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 10 |
-
8,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1681.0,+192/-136,
|
| 11 |
-
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1679.0,+
|
| 12 |
-
10,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1660.0,+
|
| 13 |
-
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1652.0,+
|
| 14 |
-
12,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),
|
| 15 |
-
13,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 16 |
-
14,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 17 |
-
15,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 18 |
-
16,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1580.0,+
|
| 19 |
-
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),1564.0,+
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1552.0,+
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1536.0,+
|
| 22 |
-
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 23 |
-
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),
|
| 24 |
-
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 25 |
-
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),
|
| 26 |
-
24,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),
|
| 27 |
-
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),
|
| 28 |
-
26,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 29 |
-
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),
|
| 30 |
-
28,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),
|
| 31 |
-
29,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 32 |
-
30
|
| 33 |
-
31,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 34 |
-
32,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 35 |
-
33,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 36 |
-
34,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 37 |
-
35,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1314.0,+
|
| 38 |
-
36,π§ β‘,Foundation Model,[
|
| 39 |
-
37
|
| 40 |
-
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 41 |
-
39
|
| 42 |
-
40,π§ π,Neural Network,[
|
| 43 |
-
41
|
| 44 |
-
42
|
| 45 |
-
43
|
| 46 |
-
44,π,Baseline,[
|
| 47 |
-
45,π,Baseline,[
|
| 48 |
-
46
|
| 49 |
-
47
|
| 50 |
-
48
|
| 51 |
-
49
|
| 52 |
-
50,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),
|
| 53 |
-
51
|
| 54 |
-
52,π,Baseline,[KNN (
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1968.0,+156/-62,0.906,4.96,2.42,2.212,275.07,2.448,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1905.0,+178/-66,0.854,6.38,2.7,2.49,325.91,2.156,βοΈ,0.0,False,CPU
|
| 4 |
+
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1761.0,+143/-87,0.637,11.0,5.87,4.725,619.15,0.198,βοΈ,0.0,False,CPU
|
| 5 |
+
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1755.0,+146/-82,0.642,11.22,4.87,5.018,619.15,0.016,βοΈ,0.0,False,CPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1753.0,+113/-39,0.582,11.32,8.0,5.44,1633.8,2.053,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1738.0,+125/-77,0.636,11.91,5.47,4.763,2.21,0.025,βοΈ,0.0,False,CPU
|
| 8 |
+
6,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1720.0,+153/-91,0.549,12.65,6.95,7.508,110.13,0.386,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1703.0,+149/-82,0.529,13.35,8.51,7.923,86.85,0.668,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1681.0,+192/-136,0.518,14.32,5.6,7.27,804.65,0.71,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1679.0,+157/-141,0.551,14.42,7.11,6.907,2139.17,6.41,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1660.0,+212/-122,0.491,15.26,5.39,8.381,842.24,15.119,βοΈ,0.0,False,GPU
|
| 13 |
+
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1652.0,+126/-66,0.386,15.63,8.8,7.028,1633.8,0.088,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1642.0,+124/-79,0.427,16.1,11.52,8.376,110.13,0.061,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1626.0,+199/-159,0.465,16.9,6.3,7.978,804.65,0.063,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1611.0,+198/-117,0.424,17.63,6.84,9.033,842.24,1.465,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1584.0,+160/-128,0.421,18.93,7.96,8.63,2.3,0.896,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1580.0,+164/-90,0.331,19.15,12.14,9.74,86.85,0.078,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),1564.0,+171/-168,0.425,19.96,8.43,9.211,8.53,3.578,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1552.0,+127/-86,0.26,20.58,12.46,9.782,2139.17,0.349,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1536.0,+179/-160,0.353,21.41,7.55,9.019,4860.88,475.791,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1528.0,+96/-114,0.254,21.81,14.53,9.12,1156.69,1.558,βοΈ,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1491.0,+143/-105,0.199,23.77,15.23,10.678,572.82,1.935,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1481.0,+125/-108,0.186,24.33,18.02,12.87,270.2,0.192,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1464.0,+128/-144,0.233,25.26,13.72,10.861,0.49,0.053,βοΈ,0.0,False,CPU
|
| 26 |
+
24,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1458.0,+131/-115,0.165,25.56,19.35,12.698,572.82,0.109,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1454.0,+159/-177,0.246,25.8,14.65,10.49,5.5,0.074,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1432.0,+106/-131,0.127,26.99,20.72,11.432,371.59,2.386,βοΈ,0.0,False,CPU
|
| 29 |
+
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1431.0,+85/-63,0.083,27.06,23.85,10.923,6.41,0.247,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1418.0,+125/-137,0.143,27.73,20.28,13.96,96.61,0.754,β,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1407.0,+128/-104,0.093,28.33,24.18,13.997,270.2,0.015,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1380.0,+98/-128,0.072,29.77,23.63,11.531,1156.69,0.054,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1373.0,+134/-137,0.093,30.18,18.82,12.762,4860.88,42.641,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1363.0,+130/-112,0.056,30.7,26.58,15.831,1.07,0.018,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1344.0,+100/-140,0.076,31.68,28.34,12.461,0.29,0.033,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1321.0,+50/-60,0.002,32.85,30.95,14.148,42.95,0.226,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1314.0,+91/-87,0.009,33.16,29.98,13.953,8.34,0.25,βοΈ,0.0,False,GPU
|
| 38 |
+
36,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1306.0,+69/-110,0.012,33.6,30.5,15.989,16.41,16.24,β,0.0,False,GPU
|
| 39 |
+
37,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1283.0,+174/-189,0.046,34.7,21.0,17.019,47.03,45.876,βοΈ,0.0,False,GPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1281.0,+74/-73,0.005,34.82,30.93,15.128,42.95,0.021,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1280.0,+61/-90,0.0,34.88,32.44,13.457,40.36,0.318,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1278.0,+82/-120,0.037,34.98,29.62,15.031,371.59,0.102,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1224.0,+69/-95,0.0,37.47,35.73,15.173,1.86,0.046,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1217.0,+64/-77,0.0,37.8,36.02,15.174,40.36,0.028,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1205.0,+135/-218,0.043,38.31,32.73,18.046,1.52,0.115,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1159.0,+148/-233,0.008,40.24,36.0,24.034,43.64,0.085,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1136.0,+102/-192,0.011,41.16,32.1,20.729,513.06,78.02,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1110.0,+167/-222,0.005,42.18,38.76,25.027,43.64,0.022,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+90/-206,0.0,45.8,45.01,22.275,0.12,0.014,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),978.0,+135/-218,0.0,46.42,44.9,26.73,0.22,0.024,βοΈ,0.0,False,CPU
|
| 51 |
+
49,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),974.0,+201/-459,0.025,46.53,40.56,28.513,2.62,0.186,βοΈ,0.0,False,GPU
|
| 52 |
+
50,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),917.0,+105/-246,0.0,47.96,47.47,24.142,0.1,0.021,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),915.0,+91/-188,0.0,48.01,47.21,30.352,0.24,0.036,β,0.0,False,GPU
|
| 54 |
+
52,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),878.0,+76/-122,0.0,48.81,48.49,27.794,513.06,2.568,βοΈ,0.0,False,CPU
|
| 55 |
+
53,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),511.0,+107/-401,0.0,53.27,53.24,45.591,0.11,0.087,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:38b9ee06f92035e8fc665f627f37d91e94c5834aed5261937efb6cdcd3402c95
|
| 3 |
+
size 2292501
|
data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:60bf147936485bc9dbcd719634c64f9be1b0a8ff291f4d5460c8fc264fc3d789
|
| 3 |
+
size 444040
|
data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eb4a0d2bb4bef977ed289b9d286e4630091a23bdd9f2dbf55674aeb360896b5a
|
| 3 |
+
size 939014
|
data/imputation_no/splits_all/tasks_binary/datasets_small/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d40c8835529c9fbf2450789660d93de66a7652095b93103d90725a0fa8a46c90
|
| 3 |
+
size 128439
|
data/imputation_no/splits_all/tasks_binary/datasets_small/website_leaderboard.csv
CHANGED
|
@@ -1,53 +1,54 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 6 |
-
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 7 |
-
5,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 8 |
-
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 9 |
-
7,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1402.0,+
|
| 10 |
-
8,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),
|
| 11 |
-
9,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 12 |
-
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 13 |
-
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 14 |
-
12,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),
|
| 16 |
-
14,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 17 |
-
15,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1310.0,+52/-43,
|
| 18 |
-
16,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),
|
| 19 |
-
17
|
| 20 |
-
18
|
| 21 |
-
19
|
| 22 |
-
20
|
| 23 |
-
21
|
| 24 |
-
22,π§ π,Neural Network,[
|
| 25 |
-
23
|
| 26 |
-
24
|
| 27 |
-
25
|
| 28 |
-
26
|
| 29 |
-
27
|
| 30 |
-
28
|
| 31 |
-
29
|
| 32 |
-
30
|
| 33 |
-
31
|
| 34 |
-
32,π§ π,Neural Network,[
|
| 35 |
-
33,π§ π,Neural Network,[
|
| 36 |
-
34
|
| 37 |
-
35,π³,Tree-based,[
|
| 38 |
-
36,π³,Tree-based,[
|
| 39 |
-
37,π³,Tree-based,[
|
| 40 |
-
38,π³,Tree-based,[
|
| 41 |
-
39
|
| 42 |
-
40
|
| 43 |
-
41
|
| 44 |
-
42
|
| 45 |
-
43
|
| 46 |
-
44
|
| 47 |
-
45
|
| 48 |
-
46,π,Baseline,[
|
| 49 |
-
47
|
| 50 |
-
48
|
| 51 |
-
49
|
| 52 |
-
50,π,Baseline,[
|
| 53 |
-
51,π,Baseline,[KNN (
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1579.0,+110/-76,0.73,8.69,3.35,7.361,593.57,8.084,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1578.0,+97/-57,0.767,8.74,4.21,6.542,5.96,0.554,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1572.0,+145/-68,0.741,8.94,3.22,5.104,2052.28,8.252,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1545.0,+131/-56,0.703,9.95,3.82,6.409,2052.28,1.266,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1433.0,+79/-50,0.441,15.09,9.43,12.254,2950.72,15.595,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1423.0,+84/-57,0.412,15.62,8.49,12.402,2457.54,1.658,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1412.0,+87/-69,0.411,16.17,9.22,11.938,1921.63,1.718,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1402.0,+83/-72,0.441,16.75,5.56,9.277,5351.68,268.579,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1389.0,+81/-66,0.442,17.46,7.88,14.196,317.91,1.983,β,0.0,False,GPU
|
| 11 |
+
9,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1368.0,+83/-73,0.383,18.62,5.64,10.087,5351.68,37.621,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1364.0,+49/-38,0.304,18.85,12.83,14.268,512.57,1.18,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1359.0,+84/-59,0.317,19.15,10.56,13.405,2457.54,0.178,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1332.0,+44/-34,0.233,20.79,14.54,14.714,512.57,0.243,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1329.0,+78/-60,0.246,20.93,10.42,14.141,2950.72,1.225,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1318.0,+88/-70,0.235,21.62,9.19,14.237,4806.04,0.512,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1310.0,+52/-43,0.217,22.11,15.1,15.327,1096.5,0.584,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1308.0,+62/-46,0.233,22.19,14.15,15.265,4.81,0.08,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1308.0,+70/-72,0.341,22.23,8.05,15.885,9.05,1.763,β,0.0,False,GPU
|
| 20 |
+
18,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1304.0,+53/-43,0.216,22.45,15.42,15.334,1096.5,0.074,βοΈ,0.0,False,CPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1295.0,+88/-75,0.322,22.98,7.75,13.079,51.83,43.615,βοΈ,0.0,False,GPU
|
| 22 |
+
20,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1289.0,+50/-68,0.207,23.38,12.61,15.283,711.84,2.983,βοΈ,0.0,False,GPU
|
| 23 |
+
21,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1287.0,+46/-42,0.195,23.47,15.89,15.743,693.49,1.398,βοΈ,0.0,False,CPU
|
| 24 |
+
22,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1277.0,+68/-60,0.243,24.1,13.14,16.187,10.08,0.152,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1276.0,+112/-108,0.286,24.17,9.59,15.532,4806.04,8.461,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1266.0,+47/-48,0.158,24.82,15.22,16.479,1634.54,0.422,βοΈ,0.0,False,CPU
|
| 27 |
+
25,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1264.0,+60/-64,0.198,24.94,11.88,16.81,14.37,0.334,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1263.0,+41/-34,0.139,24.97,16.55,16.108,693.49,0.194,βοΈ,0.0,False,CPU
|
| 29 |
+
27,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1262.0,+52/-62,0.169,25.06,12.79,16.239,711.84,0.162,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1257.0,+81/-56,0.157,25.34,16.93,15.403,2665.36,2.619,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1242.0,+49/-49,0.118,26.26,14.95,17.014,1634.54,0.054,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1222.0,+60/-72,0.156,27.55,15.83,17.306,644.55,5.974,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1221.0,+51/-54,0.137,27.6,15.68,17.733,7.32,0.054,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1219.0,+55/-50,0.114,27.71,16.67,16.552,10.89,2.249,βοΈ,0.0,False,GPU
|
| 35 |
+
33,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1184.0,+72/-49,0.073,29.91,19.12,17.523,2665.36,0.143,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1172.0,+63/-77,0.066,30.61,18.16,18.673,644.55,0.398,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1166.0,+64/-81,0.086,30.96,19.99,20.037,203.15,0.968,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1162.0,+59/-57,0.056,31.26,23.37,18.81,1.94,0.121,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1132.0,+45/-52,0.032,33.0,27.65,19.243,2.44,0.121,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1131.0,+60/-76,0.054,33.09,21.73,20.959,203.15,0.091,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1107.0,+53/-85,0.048,34.49,21.37,21.684,484.22,1.025,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1073.0,+108/-128,0.134,36.37,18.98,23.536,1.3,0.15,β,0.0,False,GPU
|
| 43 |
+
41,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1073.0,+51/-83,0.024,36.4,23.97,22.305,484.22,0.086,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1055.0,+60/-79,0.02,37.33,26.07,22.252,9.39,0.13,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1020.0,+89/-134,0.073,39.13,24.1,28.077,278.97,0.873,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1012.0,+77/-84,0.005,39.52,23.1,23.004,2.97,0.388,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+56/-111,0.018,40.12,32.28,25.235,0.42,0.041,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),998.0,+96/-137,0.053,40.21,25.22,28.642,278.97,0.103,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),988.0,+75/-112,0.019,40.66,28.13,25.787,90.71,1.623,βοΈ,0.0,False,CPU
|
| 50 |
+
48,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),986.0,+81/-107,0.02,40.77,32.62,25.835,3.71,0.919,βοΈ,0.0,False,GPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),965.0,+80/-126,0.015,41.74,34.42,26.537,0.33,0.043,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),953.0,+88/-165,0.034,42.25,27.54,30.687,1.48,0.139,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),922.0,+80/-143,0.001,43.51,28.3,30.058,90.71,0.125,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),616.0,+110/-170,0.0,50.94,45.74,43.18,0.22,0.02,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_small/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:451fa68829f359020f611702c326ebe2f21cf475567b036577ffc70af6482870
|
| 3 |
+
size 2288454
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20a32305ccc350545c5ed1bf9dcde1c8d723f8fc80d906fc92a8400e246d28cb
|
| 3 |
+
size 498546
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b3e0bdeb7a5748cf52834d6acbaa62422d0b71fcf1b0fe36b98e283cbc1c3921
|
| 3 |
+
size 1017812
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e9e00a3632dacd90463b03673a6a80a2d206a91aa959e9bee41c007fa269a533
|
| 3 |
+
size 136669
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/website_leaderboard.csv
CHANGED
|
@@ -1,59 +1,60 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 4 |
-
2,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 6 |
-
4
|
| 7 |
-
5,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),
|
| 8 |
-
6
|
| 9 |
-
7,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),
|
| 10 |
-
8,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 11 |
-
9,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 12 |
-
10,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),
|
| 13 |
-
11
|
| 14 |
-
12
|
| 15 |
-
13,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),
|
| 16 |
-
14,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 17 |
-
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 18 |
-
16,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 19 |
-
17,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),
|
| 20 |
-
18,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),
|
| 21 |
-
19,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 22 |
-
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 23 |
-
21
|
| 24 |
-
22
|
| 25 |
-
23
|
| 26 |
-
24,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),
|
| 27 |
-
25
|
| 28 |
-
26
|
| 29 |
-
27
|
| 30 |
-
28
|
| 31 |
-
29
|
| 32 |
-
30
|
| 33 |
-
31,π§ π,Neural Network,[
|
| 34 |
-
32
|
| 35 |
-
33
|
| 36 |
-
34,π³,Tree-based,[
|
| 37 |
-
35,π³,Tree-based,[EBM (
|
| 38 |
-
36
|
| 39 |
-
37,π§ π,Neural Network,[
|
| 40 |
-
38,π§ π,Neural Network,[
|
| 41 |
-
39,π§ π,Neural Network,[
|
| 42 |
-
40
|
| 43 |
-
41,π³,Tree-based,[
|
| 44 |
-
42,π³,Tree-based,[
|
| 45 |
-
43,π³,Tree-based,[
|
| 46 |
-
44
|
| 47 |
-
45
|
| 48 |
-
46
|
| 49 |
-
47
|
| 50 |
-
48
|
| 51 |
-
49
|
| 52 |
-
50
|
| 53 |
-
51,π,Baseline,[
|
| 54 |
-
52
|
| 55 |
-
53
|
| 56 |
-
54
|
| 57 |
-
55
|
| 58 |
-
56
|
| 59 |
-
57,π,Baseline,[KNN (
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1599.0,+90/-55,0.723,10.53,5.5,7.231,5.52,0.529,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1587.0,+114/-70,0.683,11.08,4.49,5.873,2046.25,8.114,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1583.0,+88/-56,0.658,11.25,4.69,8.229,592.15,8.082,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1567.0,+106/-65,0.656,11.95,4.83,7.134,2046.25,1.254,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[Mitra (default)](https://arxiv.org/abs/2510.21204),1509.0,+91/-59,0.583,14.91,5.98,10.778,144.27,3.772,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),1495.0,+80/-55,0.508,15.65,6.32,10.726,3445.6,51.274,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[LimiX (default)](https://arxiv.org/abs/2509.03505),1486.0,+98/-78,0.555,16.17,5.79,11.342,3.76,0.527,β,0.0,False,GPU
|
| 9 |
+
7,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),1478.0,+80/-66,0.489,16.63,6.0,10.261,8.06,1.714,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1441.0,+65/-51,0.377,18.88,11.78,13.189,2879.46,14.626,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1436.0,+74/-57,0.355,19.16,10.11,13.231,2379.18,1.595,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1429.0,+70/-59,0.403,19.6,9.45,14.468,316.0,1.931,β,0.0,False,GPU
|
| 13 |
+
11,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1418.0,+85/-67,0.384,20.3,6.67,10.056,5319.2,249.314,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1417.0,+77/-58,0.341,20.36,12.1,12.945,1828.68,1.648,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),1414.0,+107/-75,0.401,20.53,6.55,13.459,3445.6,0.995,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1398.0,+105/-70,0.362,21.58,6.73,10.683,5319.2,29.488,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1379.0,+86/-58,0.269,22.84,12.52,14.209,2379.18,0.176,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1374.0,+44/-43,0.233,23.14,15.56,15.267,449.53,1.149,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),1371.0,+97/-83,0.393,23.35,8.81,15.549,3.73,0.488,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1351.0,+65/-52,0.22,24.7,12.84,14.939,2879.46,0.944,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1346.0,+63/-58,0.227,25.06,10.58,14.868,4575.49,0.51,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1345.0,+38/-37,0.172,25.11,17.55,15.693,449.53,0.215,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1326.0,+61/-49,0.187,26.43,16.97,16.201,4.7,0.08,βοΈ,0.0,False,CPU
|
| 24 |
+
22,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1325.0,+106/-80,0.304,26.47,9.08,13.696,51.44,43.709,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1323.0,+83/-71,0.282,26.63,10.3,16.884,8.81,1.55,β,0.0,False,GPU
|
| 26 |
+
24,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1322.0,+56/-53,0.151,26.66,18.33,16.332,1081.93,0.556,βοΈ,0.0,False,CPU
|
| 27 |
+
25,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1316.0,+55/-43,0.16,27.12,19.39,16.356,1081.93,0.074,βοΈ,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1307.0,+67/-67,0.213,27.72,15.01,16.834,9.81,0.146,βοΈ,0.0,False,GPU
|
| 29 |
+
27,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1301.0,+53/-58,0.161,28.16,16.07,16.289,592.34,2.767,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1297.0,+51/-52,0.139,28.42,19.99,16.823,645.57,1.032,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1294.0,+66/-71,0.17,28.61,13.79,17.396,14.36,0.311,βοΈ,0.0,False,GPU
|
| 32 |
+
30,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1291.0,+49/-50,0.126,28.86,17.91,17.251,1618.46,0.415,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1290.0,+95/-103,0.256,28.89,11.23,16.525,4575.49,8.396,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1285.0,+69/-59,0.142,29.28,19.96,16.034,2576.18,2.415,βοΈ,0.0,False,CPU
|
| 35 |
+
33,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1278.0,+55/-57,0.128,29.72,15.38,17.23,592.34,0.146,βοΈ,0.0,False,GPU
|
| 36 |
+
34,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1273.0,+40/-43,0.083,30.07,19.91,17.181,645.57,0.172,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1270.0,+51/-55,0.097,30.3,17.07,17.754,1618.46,0.054,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1253.0,+54/-58,0.107,31.5,17.3,18.291,6.86,0.052,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1251.0,+67/-78,0.143,31.58,17.4,17.932,618.9,5.468,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1248.0,+55/-56,0.088,31.83,18.75,17.14,10.47,1.987,βοΈ,0.0,False,GPU
|
| 41 |
+
39,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1212.0,+63/-51,0.064,34.26,21.93,18.039,2576.18,0.136,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1204.0,+67/-73,0.058,34.79,20.06,19.257,618.9,0.352,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1182.0,+84/-72,0.065,36.24,23.51,21.134,199.83,0.865,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1172.0,+64/-62,0.028,36.89,29.5,19.93,1.77,0.119,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1150.0,+78/-74,0.038,38.3,25.55,21.978,199.83,0.086,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1144.0,+40/-44,0.019,38.69,32.62,20.337,2.2,0.12,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1109.0,+94/-132,0.115,40.84,21.9,23.577,1.24,0.143,β,0.0,False,GPU
|
| 48 |
+
46,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1108.0,+65/-83,0.021,40.89,26.68,23.012,440.56,0.933,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1085.0,+76/-74,0.02,42.24,29.74,22.701,8.39,0.127,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1078.0,+52/-80,0.004,42.65,27.65,23.562,440.56,0.085,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1056.0,+97/-122,0.071,43.86,26.41,28.155,273.27,0.715,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1043.0,+79/-88,0.0,44.57,25.84,23.586,2.84,0.381,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1034.0,+95/-124,0.048,45.02,28.26,28.625,273.27,0.098,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1020.0,+84/-108,0.02,45.71,31.07,26.372,89.68,1.55,βοΈ,0.0,False,CPU
|
| 55 |
+
53,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1002.0,+98/-114,0.008,46.63,37.26,26.979,2.96,0.796,βοΈ,0.0,False,GPU
|
| 56 |
+
54,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+63/-102,0.004,46.71,39.28,26.621,0.42,0.04,βοΈ,0.0,False,CPU
|
| 57 |
+
55,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),989.0,+101/-141,0.03,47.23,30.44,30.443,1.44,0.138,βοΈ,0.0,False,CPU
|
| 58 |
+
56,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),977.0,+92/-114,0.012,47.78,39.45,27.771,0.31,0.042,βοΈ,0.0,False,CPU
|
| 59 |
+
57,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),954.0,+87/-138,0.001,48.79,31.12,30.638,89.68,0.12,βοΈ,0.0,False,CPU
|
| 60 |
+
58,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),640.0,+129/-216,0.0,56.88,50.58,43.946,0.21,0.019,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8640c9c709b634cf85846d074101e4a5112dd521ad730aaeebafa8aa51ed138c
|
| 3 |
+
size 2706479
|
data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bef075960a412db7d54869057aa3071e0e1b2acd9e87da68f6776bd1e52d863c
|
| 3 |
+
size 452817
|
data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c2b6794c6e4b8a37d717193e09e45332c79ba5e2042aceb406b06c1e51597ce7
|
| 3 |
+
size 934561
|
data/imputation_no/splits_all/tasks_classification/datasets_all/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8635c9734b4820b42f3cf14274f9d82e2f62466995adc7fb2e409d29327ed29f
|
| 3 |
+
size 129422
|
data/imputation_no/splits_all/tasks_classification/datasets_all/website_leaderboard.csv
CHANGED
|
@@ -1,53 +1,54 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 6 |
-
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 7 |
-
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 8 |
-
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 9 |
-
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),
|
| 11 |
-
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 12 |
-
10
|
| 13 |
-
11
|
| 14 |
-
12,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),
|
| 15 |
-
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 16 |
-
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),
|
| 17 |
-
15,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),
|
| 18 |
-
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),
|
| 19 |
-
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 21 |
-
19,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),
|
| 22 |
-
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),
|
| 23 |
-
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),
|
| 24 |
-
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 25 |
-
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),
|
| 26 |
-
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 27 |
-
25
|
| 28 |
-
26
|
| 29 |
-
27
|
| 30 |
-
28
|
| 31 |
-
29
|
| 32 |
-
30
|
| 33 |
-
31,π§ π,Neural Network,[
|
| 34 |
-
32
|
| 35 |
-
33
|
| 36 |
-
34
|
| 37 |
-
35
|
| 38 |
-
36
|
| 39 |
-
37,π³,Tree-based,[
|
| 40 |
-
38,π³,Tree-based,[
|
| 41 |
-
39,π³,Tree-based,[
|
| 42 |
-
40
|
| 43 |
-
41
|
| 44 |
-
42
|
| 45 |
-
43
|
| 46 |
-
44
|
| 47 |
-
45
|
| 48 |
-
46
|
| 49 |
-
47
|
| 50 |
-
48,π³,Tree-based,[
|
| 51 |
-
49
|
| 52 |
-
50,π,Baseline,[
|
| 53 |
-
51,π,Baseline,[KNN (
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1669.0,+76/-62,0.799,7.22,3.13,6.694,545.23,6.469,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1590.0,+84/-75,0.702,9.93,3.23,6.231,2046.25,8.976,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1564.0,+79/-69,0.665,10.99,4.06,7.277,2046.25,1.329,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1549.0,+70/-69,0.668,11.64,4.83,7.723,5.76,0.794,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1512.0,+75/-57,0.529,13.34,5.33,10.293,1684.49,1.97,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1497.0,+62/-53,0.491,14.04,8.47,10.95,2879.46,12.49,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1470.0,+74/-48,0.438,15.44,7.76,12.209,2466.21,1.502,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1438.0,+49/-36,0.371,17.15,11.3,13.284,382.05,1.488,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1419.0,+76/-55,0.412,18.2,6.28,11.26,4940.61,307.751,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1414.0,+71/-57,0.362,18.46,8.99,13.099,2466.21,0.176,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1414.0,+54/-46,0.342,18.49,10.72,12.859,1372.94,0.556,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1414.0,+58/-47,0.32,18.5,9.62,12.585,2879.46,0.598,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1404.0,+58/-44,0.331,19.02,10.17,13.063,1372.94,0.074,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1393.0,+41/-34,0.277,19.66,13.6,14.01,382.05,0.254,βοΈ,0.0,False,CPU
|
| 16 |
+
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1384.0,+52/-46,0.299,20.21,12.02,14.152,685.87,1.455,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1382.0,+50/-46,0.314,20.34,10.74,13.612,5.72,0.076,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1374.0,+56/-53,0.341,20.8,10.53,15.45,282.72,1.886,β,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1370.0,+87/-81,0.341,21.05,9.2,13.701,4879.89,8.744,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1368.0,+61/-42,0.234,21.16,10.12,13.731,4879.89,0.525,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1357.0,+47/-43,0.238,21.77,14.81,14.536,685.87,0.205,βοΈ,0.0,False,CPU
|
| 22 |
+
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1356.0,+67/-57,0.307,21.86,7.42,12.959,4940.61,41.606,βοΈ,0.0,False,GPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1335.0,+44/-45,0.218,23.1,13.49,15.198,934.1,3.063,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1317.0,+44/-35,0.175,24.18,16.09,16.189,2686.11,0.47,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1313.0,+59/-53,0.246,24.44,13.9,15.854,10.21,0.138,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1312.0,+46/-43,0.176,24.47,16.54,15.04,2389.22,2.158,βοΈ,0.0,False,CPU
|
| 27 |
+
25,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1302.0,+58/-72,0.276,25.08,8.55,16.27,13.7,2.033,β,0.0,False,GPU
|
| 28 |
+
26,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1293.0,+51/-54,0.167,25.65,14.59,16.694,934.1,0.169,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1279.0,+45/-38,0.117,26.47,17.19,16.916,2686.11,0.054,βοΈ,0.0,False,CPU
|
| 30 |
+
28,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1275.0,+67/-65,0.239,26.72,9.22,16.216,49.21,43.824,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1264.0,+60/-59,0.164,27.4,15.69,17.391,618.9,4.766,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1251.0,+44/-45,0.121,28.17,18.5,18.133,6.86,0.057,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1251.0,+46/-45,0.119,28.17,15.89,17.971,14.78,0.346,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1241.0,+40/-36,0.084,28.81,20.01,17.234,10.47,1.707,βοΈ,0.0,False,GPU
|
| 35 |
+
33,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1232.0,+48/-52,0.106,29.32,19.69,17.334,1.77,0.117,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1226.0,+47/-39,0.08,29.66,20.33,17.256,2389.22,0.152,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1213.0,+52/-51,0.098,30.45,19.47,18.91,189.76,0.743,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1194.0,+53/-57,0.071,31.59,19.73,19.231,618.9,0.298,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1188.0,+64/-56,0.087,31.93,18.98,19.848,323.74,0.743,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1187.0,+48/-39,0.066,31.94,26.71,18.379,1.79,0.12,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1171.0,+54/-53,0.072,32.9,20.18,20.13,189.76,0.079,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1150.0,+60/-57,0.061,34.08,19.24,20.715,323.74,0.076,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1084.0,+45/-56,0.011,37.55,28.82,21.982,6.83,0.147,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1039.0,+85/-86,0.042,39.73,28.62,29.688,252.58,0.528,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1037.0,+64/-66,0.013,39.83,27.44,24.295,2.91,0.368,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1019.0,+66/-94,0.022,40.65,27.31,27.469,139.84,3.615,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1012.0,+85/-101,0.074,40.95,25.75,28.567,1.11,0.189,β,0.0,False,GPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1010.0,+86/-88,0.03,41.07,30.05,30.426,252.58,0.089,βοΈ,0.0,False,CPU
|
| 49 |
+
47,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1006.0,+72/-84,0.027,41.24,33.86,27.299,3.61,0.939,βοΈ,0.0,False,GPU
|
| 50 |
+
48,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+59/-60,0.01,41.48,35.59,26.755,0.38,0.037,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),948.0,+69/-70,0.008,43.55,38.13,28.978,0.25,0.041,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),926.0,+93/-110,0.019,44.32,33.53,33.241,1.29,0.131,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),900.0,+84/-113,0.006,45.19,33.06,33.665,139.84,0.193,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),563.0,+112/-114,0.0,51.64,48.53,49.526,0.18,0.029,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_classification/datasets_all/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:db72e662f286b00c2c3cb7219cee77ea31d7942f2cdda891ac3a5d1b44d251f7
|
| 3 |
+
size 2232084
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:302b07241d8634309bb8ef8846b09f68fda276904b6eb1a7d767235508e81849
|
| 3 |
+
size 436728
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:23dd51cebaaa9b90df0c413fa46de62cf211c8149ca4982b3704042bbe79c0b4
|
| 3 |
+
size 918132
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:04662e06d0bdc8f825e73a086c5524e5e651d5a0c1ce3c72c6eab3549ac3dbbc
|
| 3 |
+
size 122715
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/website_leaderboard.csv
CHANGED
|
@@ -1,54 +1,55 @@
|
|
| 1 |
-
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",
|
| 4 |
-
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),
|
| 5 |
-
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),
|
| 6 |
-
4,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),
|
| 7 |
-
5,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),
|
| 8 |
-
6,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 9 |
-
7,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),
|
| 10 |
-
8,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1646.0,+
|
| 11 |
-
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1626.0,+
|
| 12 |
-
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),
|
| 13 |
-
11,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),
|
| 14 |
-
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1567.0,+
|
| 16 |
-
14,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),
|
| 17 |
-
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),
|
| 18 |
-
16,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),
|
| 19 |
-
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1486.0,+
|
| 22 |
-
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 23 |
-
21,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 24 |
-
22,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),
|
| 25 |
-
23,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),
|
| 26 |
-
24,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 27 |
-
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),
|
| 28 |
-
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1385.0,+
|
| 29 |
-
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),
|
| 30 |
-
28,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),
|
| 31 |
-
29,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),
|
| 32 |
-
30,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),
|
| 33 |
-
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),
|
| 34 |
-
32,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1329.0,+
|
| 35 |
-
33,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 36 |
-
34,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1294.0,+
|
| 37 |
-
35,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),
|
| 38 |
-
36,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),
|
| 39 |
-
37
|
| 40 |
-
38
|
| 41 |
-
39
|
| 42 |
-
40
|
| 43 |
-
41
|
| 44 |
-
42,π§ π,Neural Network,[
|
| 45 |
-
43
|
| 46 |
-
44,π,Baseline,[
|
| 47 |
-
45,π,Baseline,[
|
| 48 |
-
46
|
| 49 |
-
47
|
| 50 |
-
48
|
| 51 |
-
49
|
| 52 |
-
50
|
| 53 |
-
51
|
| 54 |
-
52,π,Baseline,[KNN (
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1931.0,+144/-62,0.908,4.77,2.46,2.178,275.97,2.818,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1875.0,+174/-67,0.862,6.0,2.64,2.411,314.17,2.249,βοΈ,0.0,False,CPU
|
| 4 |
+
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1710.0,+130/-66,0.624,11.2,6.2,5.406,697.8,0.199,βοΈ,0.0,False,CPU
|
| 5 |
+
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1708.0,+141/-72,0.629,11.28,5.16,5.651,697.8,0.023,βοΈ,0.0,False,CPU
|
| 6 |
+
4,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1679.0,+124/-63,0.615,12.45,5.87,5.593,2.44,0.027,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1675.0,+138/-94,0.546,12.59,7.25,7.874,207.65,0.398,βοΈ,0.0,False,CPU
|
| 8 |
+
6,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1672.0,+146/-74,0.534,12.74,8.35,8.132,93.21,0.758,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1653.0,+122/-92,0.523,13.57,8.66,7.253,1624.54,1.763,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1646.0,+220/-128,0.542,13.84,3.83,7.545,783.29,13.79,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1626.0,+150/-134,0.537,14.73,7.56,7.556,2338.19,14.248,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1605.0,+182/-118,0.466,15.72,6.09,8.633,1398.9,0.645,βοΈ,0.0,False,GPU
|
| 13 |
+
11,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1602.0,+112/-76,0.435,15.88,11.71,8.689,207.65,0.056,βοΈ,0.0,False,CPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1595.0,+205/-121,0.472,16.2,6.06,8.372,783.29,1.924,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1567.0,+131/-91,0.347,17.56,9.51,8.727,1624.54,0.083,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1555.0,+169/-78,0.353,18.14,11.67,9.811,93.21,0.087,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1555.0,+193/-149,0.418,18.16,6.83,9.345,1398.9,0.062,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1544.0,+156/-120,0.419,18.73,8.38,9.121,2.3,0.82,βοΈ,0.0,False,GPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),1519.0,+166/-148,0.418,19.98,8.94,9.743,7.51,3.146,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1509.0,+117/-85,0.27,20.49,12.93,10.245,2338.19,0.54,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1486.0,+157/-142,0.331,21.69,8.1,9.963,4805.66,461.797,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1479.0,+89/-75,0.241,22.09,15.15,10.081,1169.3,1.442,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1469.0,+146/-106,0.227,22.59,15.28,12.538,893.93,0.205,βοΈ,0.0,False,CPU
|
| 24 |
+
22,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1442.0,+155/-130,0.26,24.09,13.69,10.925,0.47,0.052,βοΈ,0.0,False,CPU
|
| 25 |
+
23,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1423.0,+130/-132,0.179,25.1,16.19,12.437,709.85,2.929,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1401.0,+160/-106,0.141,26.32,19.93,13.588,893.93,0.016,βοΈ,0.0,False,CPU
|
| 27 |
+
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1391.0,+131/-130,0.149,26.86,20.37,14.508,709.85,0.19,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1385.0,+153/-156,0.221,27.19,15.63,12.673,5.67,0.081,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1360.0,+88/-84,0.075,28.56,24.93,13.533,6.98,0.233,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1358.0,+96/-144,0.114,28.68,21.87,14.453,389.62,2.114,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1351.0,+137/-132,0.129,29.04,21.35,15.914,84.36,0.919,β,0.0,False,GPU
|
| 32 |
+
30,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1347.0,+82/-85,0.076,29.26,23.72,12.262,1169.3,0.053,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1344.0,+128/-104,0.09,29.43,25.34,15.622,2.09,0.019,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1329.0,+118/-122,0.084,30.23,19.57,13.696,4805.66,43.211,βοΈ,0.0,False,GPU
|
| 35 |
+
33,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1329.0,+119/-102,0.062,30.24,22.25,13.691,52.45,0.219,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1294.0,+96/-114,0.068,32.03,28.9,13.707,0.28,0.033,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1291.0,+125/-116,0.063,32.21,23.96,14.607,52.45,0.021,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1284.0,+81/-75,0.009,32.59,29.7,14.625,10.5,0.606,βοΈ,0.0,False,GPU
|
| 39 |
+
37,π§ β‘,Foundation Model,[SAP-RPT-OSS (default)](https://arxiv.org/abs/2506.10707),1267.0,+66/-87,0.011,33.4,30.6,16.633,14.85,13.554,β,0.0,False,GPU
|
| 40 |
+
38,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1263.0,+73/-89,0.026,33.6,30.99,13.747,38.42,0.32,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1249.0,+123/-152,0.042,34.33,21.7,17.564,46.9,45.623,βοΈ,0.0,False,GPU
|
| 42 |
+
40,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1218.0,+81/-145,0.033,35.79,30.58,17.632,389.62,0.112,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1204.0,+79/-87,0.012,36.48,34.41,15.534,38.42,0.028,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1179.0,+64/-71,0.0,37.6,36.01,16.733,1.87,0.046,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1145.0,+111/-217,0.038,39.1,33.72,21.37,1.61,0.112,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1101.0,+144/-226,0.007,40.89,36.85,26.799,43.46,0.087,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1066.0,+95/-196,0.009,42.2,33.36,24.389,331.68,44.947,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1050.0,+152/-240,0.004,42.81,39.55,28.022,43.46,0.021,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+102/-176,0.0,44.47,43.32,22.382,0.12,0.013,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),923.0,+140/-230,0.0,46.71,45.3,29.594,0.2,0.023,βοΈ,0.0,False,CPU
|
| 51 |
+
49,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),918.0,+204/-476,0.022,46.86,41.32,31.186,2.8,0.224,βοΈ,0.0,False,GPU
|
| 52 |
+
50,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),884.0,+94/-216,0.0,47.68,47.22,26.748,0.09,0.019,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),858.0,+107/-172,0.0,48.29,47.55,32.966,0.2,0.033,β,0.0,False,GPU
|
| 54 |
+
52,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),811.0,+63/-148,0.0,49.23,48.91,32.095,331.68,1.626,βοΈ,0.0,False,CPU
|
| 55 |
+
53,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),448.0,+130/-396,0.0,53.34,53.31,49.299,0.12,0.101,βοΈ,0.0,False,CPU
|