Hugging Face's logo

Spaces:
multabench
/
leaderboard
Running

App Files Community
leaderboard
File size: 9,690 Bytes
b4a0516
129a067
8e02462
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
129a067
8e02462
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
entry,model,encoding,train_s_per_1k,inference_s_per_1k,finetune_s_per_1k,text_encode_s_per_1k,image_encode_s_per_1k,gpu,cpu
ConTextTab,ConTextTab,end-to-end,0.03,4.368,0.0,0.0,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5-Fast (TAR-S),TabPFN-3.5-Fast,tar,0.2132,0.5061,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3 (Frozen-S),TabPFN-3,frozen,0.2146,0.7959,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
LightGBM (TAR-S),LightGBM,tar,0.2232,0.0219,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabPFN-3 (TAR-S),TabPFN-3,tar,0.2292,0.8196,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
LightGBM (Frozen-S),LightGBM,frozen,0.2412,0.0195,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabPFN-3.5 (TAR-S),TabPFN-3.5,tar,0.2456,0.8896,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT-1.3 (TAR-S),TabDPT-1.3,tar,0.2456,0.225,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT (TAR-S),TabDPT,tar,0.2547,37.017,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabICLv2 (TAR-S),TabICLv2,tar,0.2589,0.4671,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT (Frozen-S),TabDPT,frozen,0.2684,28.2161,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabICLv2 (Frozen-S),TabICLv2,frozen,0.2721,0.4655,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT-1.3 (Frozen-S),TabDPT-1.3,frozen,0.2954,0.2259,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5-Fast (Frozen-S),TabPFN-3.5-Fast,frozen,0.3162,0.526,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Causilo (TAR-S),Causilo,tar,0.3228,0.5502,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Causilo (Frozen-S),Causilo,frozen,0.3241,0.5342,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5 (Frozen-S),TabPFN-3.5,frozen,0.3451,0.9,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-S (TAR-S),Kumo-Tabular-S,tar,0.3672,0.1174,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
EXAONE-Tabular (Frozen-S),EXAONE-Tabular,frozen,0.3868,2.6965,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2.5 (TAR-S),TabPFN-v2.5,tar,0.4266,1.5225,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
EXAONE-Tabular (TAR-S),EXAONE-Tabular,tar,0.4305,2.7526,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5-Fast (Frozen-L),TabPFN-3.5-Fast,large,0.4353,0.5406,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2.5 (Frozen-S),TabPFN-v2.5,frozen,0.4474,1.5497,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-S (Frozen-S),Kumo-Tabular-S,frozen,0.4476,0.1167,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Xiaomi-TabLDM (TAR-S),Xiaomi-TabLDM,tar,0.4742,0.5767,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3 (Frozen-L),TabPFN-3,large,0.475,0.8762,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabICLv2 (Frozen-L),TabICLv2,large,0.4813,0.5015,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT-1.3 (Frozen-L),TabDPT-1.3,large,0.4835,0.2579,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
XGBoost (TAR-S),XGBoost,tar,0.4845,0.0214,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
LightGBM (Frozen-L),LightGBM,large,0.5055,0.0305,0.0,2.6638,12.7492,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
XGBoost (Frozen-S),XGBoost,frozen,0.5107,0.02,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabPFN-3.5 (Frozen-L),TabPFN-3.5,large,0.5251,0.947,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-M (TAR-S),Kumo-Tabular-M,tar,0.5263,0.2165,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Xiaomi-TabLDM (Frozen-S),Xiaomi-TabLDM,frozen,0.5376,0.5599,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RandomForest (Frozen-S),RandomForest,frozen,0.5538,0.0344,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
Causilo (Frozen-L),Causilo,large,0.566,0.577,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-M (Frozen-S),Kumo-Tabular-M,frozen,0.5777,0.2157,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
LimiX-2 (TAR-S),LimiX-2,tar,0.5789,16.6645,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2.5 (Frozen-L),TabPFN-v2.5,large,0.5825,1.5711,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RandomForest (TAR-S),RandomForest,tar,0.5832,0.038,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
LimiX-2 (Frozen-S),LimiX-2,frozen,0.6124,17.1138,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-S (Frozen-L),Kumo-Tabular-S,large,0.6354,0.14,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
EXAONE-Tabular (Frozen-L),EXAONE-Tabular,large,0.6392,2.7964,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabM (TAR-S),TabM,tar,0.6497,0.0574,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT (Frozen-L),TabDPT,large,0.6539,33.9658,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2 (TAR-S),TabPFN-v2,tar,0.7171,1.8662,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2 (Frozen-S),TabPFN-v2,frozen,0.7738,1.9153,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Xiaomi-TabLDM (Frozen-L),Xiaomi-TabLDM,large,0.7884,0.6002,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
XGBoost (Frozen-L),XGBoost,large,0.7894,0.0327,0.0,2.6638,12.7492,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
Kumo-Tabular-M (Frozen-L),Kumo-Tabular-M,large,0.7947,0.2335,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular (TAR-S),Kumo-Tabular,tar,0.7969,0.4124,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RandomForest (Frozen-L),RandomForest,large,0.7982,0.0478,0.0,2.6638,12.7492,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabM (Frozen-S),TabM,frozen,0.8277,0.0614,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular (Frozen-S),Kumo-Tabular,frozen,0.8484,0.4142,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabM (Frozen-L),TabM,large,0.9126,0.076,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2 (Frozen-L),TabPFN-v2,large,0.9467,1.9355,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular (Frozen-L),Kumo-Tabular,large,1.1058,0.4387,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
CatBoost (TAR-S),CatBoost,tar,1.2119,0.017,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
LimiX-2 (Frozen-L),LimiX-2,large,1.2764,19.4354,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
CatBoost (Frozen-S),CatBoost,frozen,1.3414,0.016,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabFM (TAR-S),TabFM,tar,1.6469,11.9643,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabFM (Frozen-S),TabFM,frozen,1.6851,12.0363,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
CatBoost (Frozen-L),CatBoost,large,1.7632,0.0246,0.0,2.6638,12.7492,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabFM (Frozen-L),TabFM,large,2.5296,12.7902,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RealMLP (Frozen-S),RealMLP,frozen,5.4823,0.1356,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RealMLP (TAR-S),RealMLP,tar,5.4987,0.1267,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RealMLP (Frozen-L),RealMLP,large,6.3379,0.0747,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabSTAR-v1.1,TabSTAR-v1.1,end-to-end,16.3359,1.4243,0.0,0.0,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Mitra-v2 (Frozen-S),Mitra-v2,frozen,141.5132,4.4095,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Mitra-v2 (TAR-S),Mitra-v2,tar,141.8251,4.3729,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Mitra-v2 (Frozen-L),Mitra-v2,large,143.1145,4.0632,0.0,2.6638,12.7492,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz