Spaces:

multabench
/

leaderboard

Running

Kumo-Tabular-M/-S, one Encode column (#248, #249)

ecf2096 verified about 4 hours ago

6.49 kB

entry,model,encoding,train_s_per_1k,inference_s_per_1k,finetune_s_per_1k,text_encode_s_per_1k,image_encode_s_per_1k,gpu,cpu
ConTextTab,ConTextTab,end-to-end,0.0321,4.3638,0.0,0.0,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5-Fast (TAR),TabPFN-3.5-Fast,tar,0.2132,0.5061,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
LightGBM (TAR),LightGBM,tar,0.2232,0.0219,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabPFN-3.5-Fast (Frozen),TabPFN-3.5-Fast,frozen,0.2249,0.4954,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3 (TAR),TabPFN-3,tar,0.2292,0.8196,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5 (Frozen),TabPFN-3.5,frozen,0.239,0.8666,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5 (TAR),TabPFN-3.5,tar,0.2456,0.8896,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT-1.3 (TAR),TabDPT-1.3,tar,0.2456,0.225,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3 (Frozen),TabPFN-3,frozen,0.2493,0.7986,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT (TAR),TabDPT,tar,0.2547,37.017,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabICLv2 (TAR),TabICLv2,tar,0.2589,0.4671,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT (Frozen),TabDPT,frozen,0.2619,25.8213,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabICLv2 (Frozen),TabICLv2,frozen,0.2718,0.4714,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
LightGBM (Frozen),LightGBM,frozen,0.2751,0.0197,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabDPT-1.3 (Frozen),TabDPT-1.3,frozen,0.2847,0.2223,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Causilo (Frozen),Causilo,frozen,0.3145,0.5456,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Causilo (TAR),Causilo,tar,0.3228,0.5502,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-S (TAR),Kumo-Tabular-S,tar,0.3672,0.1174,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
EXAONE-Tabular (Frozen),EXAONE-Tabular,frozen,0.4243,2.7887,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
EXAONE-Tabular (TAR),EXAONE-Tabular,tar,0.4305,2.7526,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2p5 (TAR),TabPFN-v2p5,tar,0.4337,1.3744,100.6949,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Xiaomi-TabLDM (TAR),Xiaomi-TabLDM,tar,0.4742,0.5767,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
XGBoost (TAR),XGBoost,tar,0.4845,0.0214,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
Kumo-Tabular-S (Frozen),Kumo-Tabular-S,frozen,0.4932,0.1156,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2p5 (Frozen),TabPFN-v2p5,frozen,0.501,1.3786,0.0,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Xiaomi-TabLDM (Frozen),Xiaomi-TabLDM,frozen,0.521,0.5792,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-M (TAR),Kumo-Tabular-M,tar,0.5263,0.2165,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
XGBoost (Frozen),XGBoost,frozen,0.5454,0.0254,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
LimiX-2 (TAR),LimiX-2,tar,0.5789,16.6645,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RandomForest (TAR),RandomForest,tar,0.5832,0.038,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
LimiX-2 (Frozen),LimiX-2,frozen,0.5883,17.6665,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabM (Frozen),TabM,frozen,0.6253,0.0519,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RandomForest (Frozen),RandomForest,frozen,0.6489,0.0348,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabM (TAR),TabM,tar,0.6497,0.0574,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-M (Frozen),Kumo-Tabular-M,frozen,0.6741,0.2237,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2 (TAR),TabPFN-v2,tar,0.738,1.7376,100.6949,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular (TAR),Kumo-Tabular,tar,0.7969,0.4124,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2 (Frozen),TabPFN-v2,frozen,0.8065,1.6817,0.0,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular (Frozen),Kumo-Tabular,frozen,1.0881,0.4179,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
CatBoost (TAR),CatBoost,tar,1.2119,0.017,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
CatBoost (Frozen),CatBoost,frozen,1.4845,0.0137,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabFM (TAR),TabFM,tar,1.6469,11.9643,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabFM (Frozen),TabFM,frozen,1.6532,12.0212,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RealMLP (Frozen),RealMLP,frozen,4.4161,0.096,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RealMLP (TAR),RealMLP,tar,5.4987,0.1267,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabSTAR-v1.1,TabSTAR-v1.1,end-to-end,16.0753,1.3799,0.0,0.0,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Mitra-v2 (Frozen),Mitra-v2,frozen,152.0977,4.1145,0.0,0.6839,7.0091,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Mitra-v2 (TAR),Mitra-v2,tar,152.7409,4.1459,95.4327,0.6839,7.0091,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz

	entry,model,encoding,train_s_per_1k,inference_s_per_1k,finetune_s_per_1k,text_encode_s_per_1k,image_encode_s_per_1k,gpu,cpu
	ConTextTab,ConTextTab,end-to-end,0.0321,4.3638,0.0,0.0,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-3.5-Fast (TAR),TabPFN-3.5-Fast,tar,0.2132,0.5061,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	LightGBM (TAR),LightGBM,tar,0.2232,0.0219,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	TabPFN-3.5-Fast (Frozen),TabPFN-3.5-Fast,frozen,0.2249,0.4954,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-3 (TAR),TabPFN-3,tar,0.2292,0.8196,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-3.5 (Frozen),TabPFN-3.5,frozen,0.239,0.8666,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-3.5 (TAR),TabPFN-3.5,tar,0.2456,0.8896,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabDPT-1.3 (TAR),TabDPT-1.3,tar,0.2456,0.225,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-3 (Frozen),TabPFN-3,frozen,0.2493,0.7986,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabDPT (TAR),TabDPT,tar,0.2547,37.017,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabICLv2 (TAR),TabICLv2,tar,0.2589,0.4671,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabDPT (Frozen),TabDPT,frozen,0.2619,25.8213,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabICLv2 (Frozen),TabICLv2,frozen,0.2718,0.4714,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	LightGBM (Frozen),LightGBM,frozen,0.2751,0.0197,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	TabDPT-1.3 (Frozen),TabDPT-1.3,frozen,0.2847,0.2223,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Causilo (Frozen),Causilo,frozen,0.3145,0.5456,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Causilo (TAR),Causilo,tar,0.3228,0.5502,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Kumo-Tabular-S (TAR),Kumo-Tabular-S,tar,0.3672,0.1174,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	EXAONE-Tabular (Frozen),EXAONE-Tabular,frozen,0.4243,2.7887,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	EXAONE-Tabular (TAR),EXAONE-Tabular,tar,0.4305,2.7526,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-v2p5 (TAR),TabPFN-v2p5,tar,0.4337,1.3744,100.6949,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Xiaomi-TabLDM (TAR),Xiaomi-TabLDM,tar,0.4742,0.5767,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	XGBoost (TAR),XGBoost,tar,0.4845,0.0214,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	Kumo-Tabular-S (Frozen),Kumo-Tabular-S,frozen,0.4932,0.1156,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-v2p5 (Frozen),TabPFN-v2p5,frozen,0.501,1.3786,0.0,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Xiaomi-TabLDM (Frozen),Xiaomi-TabLDM,frozen,0.521,0.5792,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Kumo-Tabular-M (TAR),Kumo-Tabular-M,tar,0.5263,0.2165,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	XGBoost (Frozen),XGBoost,frozen,0.5454,0.0254,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	LimiX-2 (TAR),LimiX-2,tar,0.5789,16.6645,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	RandomForest (TAR),RandomForest,tar,0.5832,0.038,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	LimiX-2 (Frozen),LimiX-2,frozen,0.5883,17.6665,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabM (Frozen),TabM,frozen,0.6253,0.0519,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	RandomForest (Frozen),RandomForest,frozen,0.6489,0.0348,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	TabM (TAR),TabM,tar,0.6497,0.0574,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Kumo-Tabular-M (Frozen),Kumo-Tabular-M,frozen,0.6741,0.2237,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-v2 (TAR),TabPFN-v2,tar,0.738,1.7376,100.6949,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Kumo-Tabular (TAR),Kumo-Tabular,tar,0.7969,0.4124,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabPFN-v2 (Frozen),TabPFN-v2,frozen,0.8065,1.6817,0.0,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Kumo-Tabular (Frozen),Kumo-Tabular,frozen,1.0881,0.4179,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	CatBoost (TAR),CatBoost,tar,1.2119,0.017,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	CatBoost (Frozen),CatBoost,frozen,1.4845,0.0137,0.0,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
	TabFM (TAR),TabFM,tar,1.6469,11.9643,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabFM (Frozen),TabFM,frozen,1.6532,12.0212,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	RealMLP (Frozen),RealMLP,frozen,4.4161,0.096,0.0,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	RealMLP (TAR),RealMLP,tar,5.4987,0.1267,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	TabSTAR-v1.1,TabSTAR-v1.1,end-to-end,16.0753,1.3799,0.0,0.0,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Mitra-v2 (Frozen),Mitra-v2,frozen,152.0977,4.1145,0.0,0.6839,7.0091,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
	Mitra-v2 (TAR),Mitra-v2,tar,152.7409,4.1459,95.4327,0.6839,7.0091,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz