Spaces:
Running
Running
Commit
Β·
ffca6e7
1
Parent(s):
a3979f4
maint: new LB
Browse filesThis view is limited to 50 files because it contains too many changes. Β
See raw diff
- .gitignore +2 -0
- data/imputation_no/splits_all/tasks_all/datasets_all/n_datasets_51 +0 -0
- data/imputation_no/splits_all/tasks_all/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_all/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_all/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_all/website_leaderboard.csv +51 -0
- data/imputation_no/splits_all/tasks_all/datasets_all/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_medium/n_datasets_15 +0 -0
- data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_medium/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_medium/website_leaderboard.csv +51 -0
- data/imputation_no/splits_all/tasks_all/datasets_medium/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_small/n_datasets_36 +0 -0
- data/imputation_no/splits_all/tasks_all/datasets_small/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_small/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_small/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_small/website_leaderboard.csv +51 -0
- data/imputation_no/splits_all/tasks_all/datasets_small/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/n_datasets_33 +0 -0
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/website_leaderboard.csv +56 -0
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_all/n_datasets_30 +0 -0
- data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_all/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_all/website_leaderboard.csv +53 -0
- data/imputation_no/splits_all/tasks_binary/datasets_all/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_medium/n_datasets_9 +0 -0
- data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_medium/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_medium/website_leaderboard.csv +54 -0
- data/imputation_no/splits_all/tasks_binary/datasets_medium/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_small/n_datasets_21 +0 -0
- data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_small/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_small/website_leaderboard.csv +53 -0
- data/imputation_no/splits_all/tasks_binary/datasets_small/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/n_datasets_20 +0 -0
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_n_configs_imp.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/tuning-impact-elo.png.zip +3 -0
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/website_leaderboard.csv +59 -0
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/winrate_matrix.png.zip +3 -0
- data/imputation_no/splits_all/tasks_classification/datasets_all/n_datasets_38 +0 -0
.gitignore
CHANGED
|
@@ -8,3 +8,5 @@ wheels/
|
|
| 8 |
|
| 9 |
# Virtual environments
|
| 10 |
.venv
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
# Virtual environments
|
| 10 |
.venv
|
| 11 |
+
|
| 12 |
+
*.png
|
data/imputation_no/splits_all/tasks_all/datasets_all/n_datasets_51
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_all/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3ab74bcd98d52b0516d8ece16fba2bf62d17355c3709f92d1176997deec7bdf9
|
| 3 |
+
size 434350
|
data/imputation_no/splits_all/tasks_all/datasets_all/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dc338f509a3342554992e0ce9ba450fe38ef5b4c0434287cf6aff23593584051
|
| 3 |
+
size 987831
|
data/imputation_no/splits_all/tasks_all/datasets_all/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b282bc5c113ba1ae79f044a2ce90c306ab0900f5301b949d50b532750fb4930b
|
| 3 |
+
size 108478
|
data/imputation_no/splits_all/tasks_all/datasets_all/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1679.0,+64/-51,0.789,6.94,3.2,5.507,582.21,6.116,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1626.0,+89/-60,0.739,8.58,2.9,4.753,2040.22,8.92,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1580.0,+73/-54,0.68,10.27,3.97,5.726,2040.22,1.218,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1546.0,+72/-52,0.654,11.6,4.97,6.429,5.81,0.645,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1539.0,+55/-51,0.549,11.93,5.37,8.693,1735.72,2.559,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1536.0,+57/-48,0.556,12.03,6.93,8.739,2950.72,11.988,0.0,False,GPU
|
| 8 |
+
6,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1479.0,+65/-53,0.523,14.61,4.53,8.827,4907.64,286.652,0.0,False,GPU
|
| 9 |
+
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1466.0,+56/-43,0.428,15.26,8.29,10.223,3285.87,1.472,0.0,False,GPU
|
| 10 |
+
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1450.0,+36/-31,0.378,16.06,11.15,11.452,416.98,2.639,0.0,False,CPU
|
| 11 |
+
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1445.0,+46/-48,0.379,16.28,8.65,10.227,2950.72,0.663,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1432.0,+44/-43,0.36,16.98,10.14,10.958,1658.41,0.653,0.0,False,CPU
|
| 13 |
+
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1420.0,+60/-58,0.419,17.58,6.04,10.229,4907.64,39.96,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1419.0,+42/-44,0.345,17.6,9.69,11.142,1658.41,0.081,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1409.0,+82/-54,0.385,18.12,7.61,11.442,4621.67,8.149,0.0,False,GPU
|
| 16 |
+
14,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1404.0,+56/-47,0.341,18.38,9.66,11.14,3285.87,0.173,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1400.0,+31/-30,0.28,18.63,13.38,12.143,416.98,0.334,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1389.0,+35/-36,0.296,19.21,12.62,12.22,693.49,1.69,0.0,False,CPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1378.0,+41/-42,0.315,19.76,11.31,12.023,6.83,0.08,0.0,False,CPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1371.0,+45/-40,0.243,20.17,10.17,11.984,4621.67,0.475,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1366.0,+49/-41,0.267,20.45,11.91,12.584,846.88,2.552,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1363.0,+31/-33,0.241,20.59,14.97,12.54,693.49,0.308,0.0,False,CPU
|
| 23 |
+
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1339.0,+70/-60,0.336,21.91,7.2,12.933,47.62,43.739,0.0,False,GPU
|
| 24 |
+
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1313.0,+46/-38,0.198,23.35,14.43,13.883,846.88,0.13,0.0,False,GPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1305.0,+54/-47,0.236,23.79,14.16,13.655,10.49,0.132,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1299.0,+50/-50,0.164,24.11,16.52,13.439,2874.67,1.952,0.0,False,CPU
|
| 27 |
+
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1282.0,+43/-40,0.171,25.07,16.13,15.191,2929.85,0.422,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1257.0,+44/-44,0.123,26.41,15.77,15.566,14.87,0.308,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1243.0,+47/-43,0.121,27.22,17.59,15.868,2929.85,0.051,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1240.0,+36/-41,0.086,27.36,19.31,14.957,10.06,1.689,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1219.0,+39/-38,0.091,28.49,20.6,15.422,1.94,0.123,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1219.0,+52/-61,0.134,28.51,17.29,16.343,593.24,4.467,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1218.0,+41/-47,0.078,28.58,20.1,15.309,2874.67,0.131,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1212.0,+46/-42,0.101,28.89,19.17,16.88,183.02,0.761,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1208.0,+46/-48,0.115,29.06,19.52,17.03,7.32,0.05,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1190.0,+35/-29,0.048,30.03,26.04,16.049,1.96,0.142,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1179.0,+55/-48,0.076,30.61,20.12,17.756,373.18,0.771,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1172.0,+47/-52,0.076,30.96,19.36,17.853,183.02,0.091,0.0,False,CPU
|
| 39 |
+
37,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1153.0,+52/-55,0.057,31.96,21.29,17.842,593.24,0.306,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1141.0,+49/-46,0.052,32.55,19.95,18.528,373.18,0.085,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1073.0,+35/-48,0.012,35.84,28.74,19.694,9.99,0.126,0.0,False,CPU
|
| 42 |
+
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,1043.0,+62/-61,0.036,37.16,29.18,23.269,3.23,0.919,0.0,False,GPU
|
| 43 |
+
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1005.0,+59/-60,0.013,38.74,28.39,22.719,2.86,0.373,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+45/-50,0.006,38.93,34.17,23.485,0.43,0.054,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,998.0,+63/-88,0.016,39.0,27.81,25.352,129.01,1.802,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,980.0,+59/-71,0.011,39.69,34.68,24.998,0.25,0.05,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,970.0,+64/-97,0.032,40.07,30.33,31.269,237.58,0.424,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,940.0,+71/-111,0.023,41.15,31.63,31.88,237.58,0.085,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,888.0,+68/-108,0.003,42.8,32.9,30.599,129.01,0.18,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,853.0,+76/-133,0.014,43.79,34.99,34.618,1.19,0.12,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,636.0,+89/-113,0.0,47.95,43.9,44.269,0.19,0.036,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_all/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:348dfb8ae7ee428690bd12aed9771b32bcb4dfee97c8fc80db5696433d7b0ff4
|
| 3 |
+
size 1739374
|
data/imputation_no/splits_all/tasks_all/datasets_medium/n_datasets_15
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fd03f6dff15fd9fcda1d0dbc2cc3f5bcc08cb41a0600762210985e0171c15373
|
| 3 |
+
size 399354
|
data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b97ad68cbfd79a48e72703bb4d4b7d080493f752b2c1774faf646dac00a7c0d9
|
| 3 |
+
size 981194
|
data/imputation_no/splits_all/tasks_all/datasets_medium/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:701c5872555086215e2e04852b6a4f27bc9b7004114bf8d52735f904a99e98a6
|
| 3 |
+
size 112567
|
data/imputation_no/splits_all/tasks_all/datasets_medium/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1825.0,+86/-46,0.836,5.78,2.85,2.566,289.53,3.187,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1804.0,+82/-49,0.808,6.29,3.08,2.669,432.35,4.085,0.0,False,CPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1676.0,+164/-124,0.66,10.21,3.09,5.382,735.58,11.736,0.0,False,GPU
|
| 5 |
+
3,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1649.0,+109/-94,0.581,11.21,6.96,5.684,1719.82,1.675,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1635.0,+125/-116,0.598,11.74,6.46,5.75,2526.28,6.013,0.0,False,GPU
|
| 7 |
+
5,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1621.0,+86/-63,0.539,12.33,6.64,5.585,777.59,0.25,0.0,False,CPU
|
| 8 |
+
6,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1620.0,+145/-112,0.591,12.34,5.04,6.097,735.58,1.386,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1610.0,+94/-69,0.541,12.74,5.67,5.783,777.59,0.052,0.0,False,CPU
|
| 10 |
+
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1602.0,+76/-56,0.493,13.08,8.87,7.351,131.56,2.639,0.0,False,CPU
|
| 11 |
+
9,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1567.0,+105/-96,0.524,14.58,7.14,5.97,3.24,0.031,0.0,False,CPU
|
| 12 |
+
10,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1560.0,+87/-61,0.447,14.9,8.9,7.478,282.13,0.563,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1549.0,+116/-94,0.405,15.39,8.76,7.016,1719.82,0.081,0.0,False,GPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1546.0,+155/-99,0.478,15.51,7.63,6.906,1.88,0.645,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1542.0,+155/-95,0.426,15.7,7.33,7.41,1993.14,0.619,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1534.0,+141/-125,0.48,16.05,4.17,7.024,4786.55,444.544,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1512.0,+80/-65,0.342,17.07,11.95,8.574,131.56,0.132,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1510.0,+69/-51,0.356,17.18,13.18,8.062,282.13,0.066,0.0,False,CPU
|
| 19 |
+
17,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1490.0,+152/-101,0.36,18.13,8.42,8.168,1993.14,0.061,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1481.0,+107/-91,0.32,18.51,12.5,8.151,2526.28,0.349,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1438.0,+108/-100,0.271,20.59,12.75,9.676,566.74,0.951,0.0,False,GPU
|
| 22 |
+
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1412.0,+122/-124,0.296,21.86,8.61,9.655,4786.55,42.641,0.0,False,GPU
|
| 23 |
+
21,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1387.0,+71/-71,0.179,23.12,16.95,9.424,1770.56,1.069,0.0,False,CPU
|
| 24 |
+
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1382.0,+97/-96,0.191,23.34,18.62,11.377,566.74,0.06,0.0,False,GPU
|
| 25 |
+
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1371.0,+104/-120,0.234,23.89,14.51,9.928,0.49,0.053,0.0,False,CPU
|
| 26 |
+
24,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1339.0,+130/-140,0.221,25.48,10.01,12.451,46.62,43.739,0.0,False,GPU
|
| 27 |
+
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1334.0,+119/-133,0.194,25.72,17.81,12.922,1517.65,0.134,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1328.0,+132/-111,0.177,26.01,17.36,11.007,5.16,0.074,0.0,False,GPU
|
| 29 |
+
27,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1302.0,+77/-82,0.096,27.27,23.36,11.463,8.06,0.25,0.0,False,GPU
|
| 30 |
+
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1280.0,+84/-70,0.046,28.34,25.52,12.214,6.75,0.235,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1275.0,+78/-77,0.055,28.58,24.36,11.211,1770.56,0.051,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1271.0,+110/-134,0.125,28.79,22.32,13.812,1517.65,0.015,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1258.0,+62/-73,0.051,29.37,27.19,11.863,0.29,0.045,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1249.0,+86/-79,0.039,29.81,24.11,12.418,66.0,0.341,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1220.0,+97/-140,0.085,31.14,26.84,15.399,3.12,0.016,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1216.0,+97/-87,0.04,31.35,25.48,13.131,66.0,0.024,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1214.0,+108/-138,0.071,31.42,25.0,14.369,351.94,1.658,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1206.0,+71/-86,0.021,31.77,29.62,12.542,36.48,0.329,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1158.0,+63/-76,0.006,33.91,32.33,13.771,36.48,0.037,0.0,False,CPU
|
| 40 |
+
38,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1118.0,+67/-72,0.0,35.56,34.12,15.534,2.18,0.039,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1102.0,+85/-108,0.021,36.21,32.28,16.646,351.94,0.114,0.0,False,CPU
|
| 42 |
+
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,1046.0,+145/-191,0.018,38.34,33.71,23.683,2.49,0.145,0.0,False,GPU
|
| 43 |
+
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1022.0,+138/-176,0.024,39.18,35.21,20.34,1.51,0.111,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+60/-87,0.0,39.92,39.15,18.698,0.2,0.021,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,998.0,+87/-126,0.006,39.99,34.2,22.252,150.3,10.071,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,950.0,+152/-228,0.005,41.48,38.36,31.109,43.64,0.081,0.0,False,CPU
|
| 47 |
+
45,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,940.0,+106/-141,0.002,41.8,40.36,21.813,0.11,0.028,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,897.0,+156/-249,0.003,42.99,40.6,32.052,43.64,0.018,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,813.0,+58/-95,0.0,44.96,44.7,28.248,150.3,0.482,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,785.0,+139/-247,0.0,45.52,44.41,34.158,0.19,0.019,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,566.0,+107/-159,0.0,48.53,48.44,42.214,0.1,0.072,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_medium/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4b456446d2244486892edc8aadc235111c5ebd909560b2395fecbcc0dfc26278
|
| 3 |
+
size 1634342
|
data/imputation_no/splits_all/tasks_all/datasets_small/n_datasets_36
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_all/datasets_small/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fc2daec9ff7c8fec95e11c76a7892200ba5b61fea726f612cf992675ade9ff04
|
| 3 |
+
size 397284
|
data/imputation_no/splits_all/tasks_all/datasets_small/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:de7549430fdf91e2226031fe4d67a85f0153bc784a52430fd298040c8d6f8136
|
| 3 |
+
size 981954
|
data/imputation_no/splits_all/tasks_all/datasets_small/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f30a940c53f43045c7a16b6bf14ce9c528cef2529410f3e61744ae4b604fdaf
|
| 3 |
+
size 107979
|
data/imputation_no/splits_all/tasks_all/datasets_small/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1640.0,+68/-54,0.769,7.42,3.38,6.733,659.63,7.444,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1625.0,+97/-63,0.772,7.9,2.83,4.491,2289.05,8.049,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1580.0,+79/-58,0.717,9.4,3.65,5.571,2289.05,1.143,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1565.0,+86/-62,0.728,9.98,4.34,6.23,6.76,0.636,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1506.0,+68/-49,0.546,12.38,6.91,10.012,3770.75,21.902,0.0,False,GPU
|
| 7 |
+
5,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1470.0,+83/-61,0.54,14.01,4.71,9.579,5119.36,218.711,0.0,False,GPU
|
| 8 |
+
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1464.0,+54/-48,0.441,14.28,7.78,11.203,3716.07,2.547,0.0,False,CPU
|
| 9 |
+
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1448.0,+59/-48,0.429,15.08,8.77,11.395,3553.12,1.741,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1433.0,+76/-59,0.471,15.79,5.38,10.468,5119.36,28.351,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1416.0,+56/-42,0.369,16.66,8.6,11.565,3770.75,1.778,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1404.0,+35/-36,0.33,17.29,12.49,13.16,892.41,2.574,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1381.0,+56/-51,0.333,18.49,10.3,12.378,3553.12,0.241,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1374.0,+43/-44,0.286,18.91,13.0,13.197,2476.51,0.814,0.0,False,CPU
|
| 15 |
+
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1367.0,+35/-28,0.254,19.29,14.08,13.63,892.41,0.346,0.0,False,CPU
|
| 16 |
+
14,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1360.0,+46/-36,0.263,19.62,13.76,13.375,2476.51,0.101,0.0,False,CPU
|
| 17 |
+
15,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1347.0,+47/-42,0.265,20.39,11.59,13.796,1126.71,2.941,0.0,False,GPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1346.0,+72/-67,0.384,20.43,6.44,13.133,50.32,43.709,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1340.0,+64/-61,0.296,20.78,8.22,13.813,6521.96,8.396,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1338.0,+46/-42,0.211,20.86,9.44,13.58,6521.96,0.506,0.0,False,GPU
|
| 21 |
+
19,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1335.0,+36/-38,0.233,21.01,15.28,14.196,884.18,2.368,0.0,False,CPU
|
| 22 |
+
20,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1319.0,+37/-41,0.227,21.92,14.94,14.545,9.64,0.128,0.0,False,CPU
|
| 23 |
+
21,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1317.0,+34/-37,0.193,22.02,15.86,14.406,884.18,0.393,0.0,False,CPU
|
| 24 |
+
22,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1302.0,+56/-46,0.261,22.86,13.15,14.758,13.18,0.17,0.0,False,GPU
|
| 25 |
+
23,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1294.0,+40/-44,0.201,23.35,13.19,14.927,1126.71,0.163,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1273.0,+47/-50,0.158,24.52,16.34,15.112,3865.95,2.158,0.0,False,CPU
|
| 27 |
+
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1268.0,+47/-45,0.162,24.79,15.52,16.137,3351.28,0.47,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1246.0,+48/-54,0.135,26.05,13.88,17.276,16.27,0.321,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1237.0,+48/-47,0.119,26.56,16.17,16.725,3351.28,0.056,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1230.0,+39/-42,0.103,26.95,17.53,16.1,15.69,4.691,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1224.0,+58/-62,0.16,27.29,15.32,17.165,1678.92,8.069,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1217.0,+70/-64,0.135,27.68,16.72,18.687,499.14,1.466,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1208.0,+51/-51,0.128,28.2,17.53,17.71,9.08,0.057,0.0,False,CPU
|
| 34 |
+
32,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1201.0,+40/-47,0.087,28.58,18.73,17.016,3865.95,0.148,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1180.0,+64/-62,0.105,29.74,16.59,19.553,499.14,0.207,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1172.0,+54/-51,0.072,30.18,18.64,18.34,1678.92,0.826,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1169.0,+40/-39,0.046,30.3,25.59,17.793,3.61,0.17,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1168.0,+34/-37,0.031,30.4,24.97,17.712,3.29,0.253,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1158.0,+58/-70,0.091,30.94,18.82,19.98,590.04,1.461,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1117.0,+56/-70,0.057,33.05,18.3,20.776,590.04,0.15,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1058.0,+48/-47,0.017,35.95,26.97,21.427,13.69,0.155,0.0,False,CPU
|
| 42 |
+
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,1042.0,+69/-90,0.043,36.67,27.64,23.096,5.44,1.098,0.0,False,GPU
|
| 43 |
+
41,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+56/-75,0.008,38.52,32.45,25.48,0.51,0.089,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,999.0,+50/-60,0.008,38.56,26.27,23.71,5.48,0.685,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,998.0,+73/-96,0.019,38.58,25.8,26.644,111.84,1.215,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,993.0,+72/-72,0.015,38.81,32.76,26.326,0.47,0.092,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,976.0,+86/-100,0.043,39.48,27.89,31.336,520.95,0.647,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,953.0,+84/-107,0.031,40.38,28.96,31.808,520.95,0.113,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,910.0,+73/-92,0.004,41.9,29.64,31.579,111.84,0.111,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,872.0,+99/-124,0.02,43.07,32.15,34.809,2.59,0.138,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,654.0,+110/-151,0.0,47.7,42.25,45.125,0.37,0.033,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_small/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd4f3b83906d55fa12c1647af4573b7c9816fc5a608ab11bfe4d0a5d5f10f5ce
|
| 3 |
+
size 1729917
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/n_datasets_33
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7745b6b4051e6c121203dddf9d74d5c8fd9f0f919e6eb82d895e1d89c25ab899
|
| 3 |
+
size 428426
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:12fc29ef59fbcd6e44a02905d150fd9379bd71a8c220b77a16e800c257acf463
|
| 3 |
+
size 1048964
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:98d67d02c424a2064c561b33cd726834309a1e67f88ff45806d70266bb4fef6b
|
| 3 |
+
size 115758
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1640.0,+95/-71,0.744,9.05,3.4,5.186,2166.18,7.945,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1637.0,+78/-54,0.72,9.17,4.23,7.606,611.55,7.01,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1602.0,+66/-63,0.723,10.54,5.18,6.822,6.14,0.586,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1597.0,+72/-62,0.693,10.73,4.24,6.284,2166.18,0.993,0.0,False,GPU
|
| 6 |
+
4,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),βοΈ,1546.0,+74/-50,0.591,12.97,5.42,9.458,3899.42,55.833,0.0,False,GPU
|
| 7 |
+
5,π§ π,Neural Network,[Mitra (default)](https://arxiv.org/abs/2510.21204),βοΈ,1516.0,+74/-47,0.559,14.46,5.84,10.623,136.59,3.391,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1514.0,+54/-45,0.504,14.56,8.05,11.014,3547.04,20.963,0.0,False,GPU
|
| 9 |
+
7,π§ π,Neural Network,[LimiX (default)](https://arxiv.org/abs/2509.03505),β,1506.0,+74/-71,0.586,14.97,5.38,13.034,4.85,0.629,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1468.0,+75/-61,0.481,16.95,5.43,10.616,4980.83,207.372,0.0,False,GPU
|
| 11 |
+
9,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1459.0,+46/-52,0.384,17.46,9.83,12.287,3376.59,2.54,0.0,False,CPU
|
| 12 |
+
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1446.0,+55/-50,0.373,18.19,10.24,12.487,3372.56,1.658,0.0,False,GPU
|
| 13 |
+
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1442.0,+80/-69,0.445,18.39,5.94,11.415,4980.83,23.583,0.0,False,GPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),βοΈ,1439.0,+82/-69,0.434,18.6,6.82,12.024,3899.42,0.983,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1422.0,+56/-47,0.337,19.55,10.33,12.593,3547.04,1.57,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1398.0,+36/-36,0.258,20.98,15.0,14.456,771.57,2.49,0.0,False,CPU
|
| 17 |
+
15,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),βοΈ,1390.0,+71/-69,0.399,21.43,9.2,13.505,4.22,0.554,0.0,False,GPU
|
| 18 |
+
16,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1384.0,+58/-51,0.284,21.83,11.77,13.499,3372.56,0.208,0.0,False,GPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1382.0,+42/-37,0.24,21.91,15.08,14.384,2034.85,0.805,0.0,False,CPU
|
| 20 |
+
18,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1368.0,+37/-33,0.219,22.76,16.26,14.581,2034.85,0.097,0.0,False,CPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1366.0,+90/-66,0.381,22.88,6.96,14.141,48.9,43.804,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1363.0,+36/-30,0.189,23.09,16.97,14.932,771.57,0.322,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1342.0,+50/-45,0.205,24.36,14.6,15.104,1105.59,2.552,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1338.0,+36/-36,0.181,24.6,18.37,15.506,828.74,2.312,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1338.0,+73/-67,0.25,24.64,11.28,15.155,6147.69,8.149,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1338.0,+46/-49,0.17,24.64,11.71,14.737,6147.69,0.485,0.0,False,GPU
|
| 27 |
+
25,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1327.0,+48/-45,0.184,25.31,17.24,15.809,8.51,0.123,0.0,False,CPU
|
| 28 |
+
26,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1320.0,+32/-34,0.142,25.71,18.6,15.718,828.74,0.336,0.0,False,CPU
|
| 29 |
+
27,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1313.0,+54/-53,0.226,26.15,14.69,15.881,12.24,0.154,0.0,False,GPU
|
| 30 |
+
28,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1296.0,+45/-40,0.151,27.25,16.29,16.243,1105.59,0.13,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1282.0,+48/-45,0.12,28.07,18.33,17.283,2929.85,0.433,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1275.0,+48/-54,0.124,28.54,20.3,16.303,3704.3,2.074,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1267.0,+47/-42,0.118,28.99,15.86,17.906,16.16,0.307,0.0,False,GPU
|
| 34 |
+
32,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1252.0,+52/-49,0.084,29.95,18.24,17.885,2929.85,0.054,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1245.0,+42/-38,0.082,30.35,19.8,17.002,15.48,4.535,0.0,False,GPU
|
| 36 |
+
34,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1236.0,+51/-62,0.142,30.9,16.77,18.355,1459.62,8.056,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1219.0,+49/-53,0.078,31.95,19.88,18.772,8.47,0.054,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1213.0,+60/-60,0.101,32.33,21.51,20.26,416.39,1.393,0.0,False,CPU
|
| 39 |
+
37,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1203.0,+47/-48,0.065,32.91,21.43,18.22,3704.3,0.143,0.0,False,CPU
|
| 40 |
+
38,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1181.0,+56/-61,0.063,34.18,20.76,19.544,1459.62,0.89,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1177.0,+57/-61,0.069,34.43,22.54,21.094,416.39,0.179,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1172.0,+37/-38,0.017,34.71,29.77,19.131,3.05,0.241,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1158.0,+33/-41,0.021,35.5,31.12,19.359,3.39,0.158,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1142.0,+56/-58,0.047,36.41,24.9,21.744,572.67,1.421,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1103.0,+47/-48,0.019,38.56,25.42,22.52,572.67,0.143,0.0,False,CPU
|
| 46 |
+
44,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1067.0,+50/-60,0.012,40.39,30.45,22.688,11.82,0.147,0.0,False,CPU
|
| 47 |
+
45,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,1053.0,+71/-83,0.03,41.1,31.46,24.705,5.39,1.034,0.0,False,GPU
|
| 48 |
+
46,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1010.0,+55/-66,0.0,43.07,28.88,24.827,5.18,0.652,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,1004.0,+72/-90,0.012,43.34,31.16,28.179,100.58,1.106,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1003.0,+71/-108,0.044,43.36,30.05,31.292,504.17,0.629,0.0,False,CPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1002.0,+83/-87,0.008,43.4,36.68,27.374,0.42,0.078,0.0,False,CPU
|
| 52 |
+
50,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+55/-70,0.002,43.49,37.64,26.617,0.47,0.069,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,980.0,+74/-108,0.03,44.33,31.71,31.725,504.17,0.103,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,908.0,+78/-103,0.0,47.0,33.68,33.337,100.58,0.101,0.0,False,CPU
|
| 55 |
+
53,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,903.0,+82/-129,0.019,47.19,34.88,34.211,2.51,0.137,0.0,False,CPU
|
| 56 |
+
54,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,680.0,+97/-169,0.0,52.44,45.72,45.686,0.29,0.028,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4eb4cf5b22ffe61c7126a39e9142cefcf53241d59bc19a5ba0daef6274f7377
|
| 3 |
+
size 2212024
|
data/imputation_no/splits_all/tasks_binary/datasets_all/n_datasets_30
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8979e608672d5a0f32a339d07ff373d69dc10b01e1d2fa5cdbc9808720dd16c2
|
| 3 |
+
size 429276
|
data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:92fb1048a148173627e64602c7e3334ab49dcdc5eda005fd84595d81d8f26a17
|
| 3 |
+
size 985265
|
data/imputation_no/splits_all/tasks_binary/datasets_all/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2185545f1af5db251cf8b3acfd34ea001ca9e9e4c816eaf000981ccf7b09a8c0
|
| 3 |
+
size 113807
|
data/imputation_no/splits_all/tasks_binary/datasets_all/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1657.0,+98/-71,0.803,7.38,2.99,5.749,442.09,6.381,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1568.0,+110/-63,0.681,10.55,3.6,6.02,1923.88,9.103,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1545.0,+101/-57,0.687,11.52,4.71,7.098,4.91,0.694,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1535.0,+101/-59,0.632,11.94,4.35,7.13,1923.88,1.329,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1515.0,+73/-65,0.555,12.85,5.23,9.038,1152.95,1.784,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1500.0,+53/-56,0.508,13.58,8.76,10.144,2775.44,8.849,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1475.0,+76/-57,0.463,14.8,7.23,10.795,2229.7,1.387,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1438.0,+55/-38,0.382,16.76,10.85,12.3,328.96,1.102,0.0,False,CPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1422.0,+72/-62,0.436,17.64,5.97,9.134,4982.66,358.753,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1416.0,+81/-59,0.371,17.95,8.6,11.711,2229.7,0.133,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1408.0,+61/-52,0.353,18.37,9.9,12.08,1055.6,0.482,0.0,False,CPU
|
| 13 |
+
11,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1403.0,+59/-53,0.353,18.64,9.24,12.174,1055.6,0.063,0.0,False,CPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1403.0,+56/-50,0.374,18.67,9.35,12.048,4.27,0.064,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1400.0,+52/-56,0.298,18.83,9.7,11.944,2775.44,0.415,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1385.0,+62/-53,0.314,19.7,11.17,13.208,472.99,0.621,0.0,False,CPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1384.0,+49/-31,0.268,19.73,13.42,13.159,328.96,0.126,0.0,False,CPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),β,1380.0,+68/-68,0.371,19.99,9.43,14.06,250.36,1.708,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1367.0,+94/-94,0.374,20.73,8.42,12.88,3383.91,8.396,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1366.0,+58/-59,0.248,20.75,9.56,12.838,3383.91,0.51,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1355.0,+65/-58,0.301,21.39,7.03,10.825,4982.66,42.199,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1350.0,+49/-43,0.236,21.73,14.36,13.724,472.99,0.13,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1331.0,+58/-56,0.21,22.85,12.96,13.837,642.33,2.767,0.0,False,GPU
|
| 24 |
+
22,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1318.0,+49/-41,0.197,23.61,15.72,13.457,2241.65,2.415,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1312.0,+69/-65,0.259,23.95,12.93,14.413,8.72,0.126,0.0,False,GPU
|
| 26 |
+
24,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1311.0,+52/-48,0.18,24.03,15.4,15.332,1560.02,0.404,0.0,False,CPU
|
| 27 |
+
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1302.0,+47/-58,0.178,24.57,13.95,15.116,642.33,0.146,0.0,False,GPU
|
| 28 |
+
26,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1283.0,+64/-72,0.243,25.68,9.36,14.197,49.67,43.824,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1274.0,+51/-46,0.121,26.2,16.49,16.045,1560.02,0.052,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1267.0,+50/-42,0.15,26.62,13.82,15.891,13.5,0.311,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1267.0,+60/-64,0.152,26.62,16.59,15.482,559.38,4.08,0.0,False,CPU
|
| 32 |
+
30,π§ οΏ½οΏ½οΏ½,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1265.0,+44/-44,0.11,26.75,17.68,14.803,9.33,1.116,0.0,False,GPU
|
| 33 |
+
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1248.0,+49/-52,0.123,27.77,17.29,17.1,4.98,0.049,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1231.0,+66/-56,0.117,28.74,18.33,16.365,1.24,0.11,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1226.0,+46/-39,0.077,29.08,19.82,15.668,2241.65,0.136,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1191.0,+57/-63,0.061,31.05,19.79,17.521,559.38,0.276,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1188.0,+51/-53,0.061,31.26,22.1,18.0,125.38,0.674,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1179.0,+49/-34,0.047,31.73,27.14,17.148,0.81,0.093,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1154.0,+51/-57,0.035,33.12,22.93,19.362,169.75,0.603,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1146.0,+50/-53,0.038,33.56,23.89,19.162,125.38,0.069,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1119.0,+43/-54,0.018,35.01,23.64,20.091,169.75,0.059,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1093.0,+65/-48,0.019,36.39,27.59,20.071,4.95,0.091,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1057.0,+64/-82,0.021,38.16,24.5,21.46,2.56,0.267,0.0,False,CPU
|
| 44 |
+
42,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1051.0,+84/-107,0.054,38.43,26.2,26.808,162.68,0.405,0.0,False,CPU
|
| 45 |
+
43,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),β,1045.0,+109/-116,0.099,38.71,22.36,25.52,0.85,0.129,0.0,False,GPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,1022.0,+61/-103,0.017,39.74,28.61,24.212,139.84,3.917,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1022.0,+91/-118,0.039,39.75,27.56,27.502,162.68,0.054,0.0,False,CPU
|
| 48 |
+
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+62/-79,0.013,40.7,33.84,24.287,0.25,0.029,0.0,False,CPU
|
| 49 |
+
47,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,983.0,+73/-101,0.026,41.38,33.73,26.581,2.8,0.564,0.0,False,GPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,959.0,+86/-119,0.024,42.33,30.48,29.448,0.84,0.094,0.0,False,CPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,955.0,+75/-92,0.01,42.47,36.5,25.759,0.2,0.037,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,915.0,+82/-136,0.0,43.91,31.65,29.325,139.84,0.193,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,602.0,+105/-199,0.0,50.36,46.66,43.863,0.15,0.023,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_all/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:783344ba6c5f6c1d3bc94e50769f5330bbc21fb45bec22d445dd7f76d69ede86
|
| 3 |
+
size 2071274
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/n_datasets_9
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7db63d502490ea6f171e4158f07599e360bcbf896034b80539013dc4cf2669f8
|
| 3 |
+
size 419894
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:44ee0506dd2e7e004d3ad5fe55a48e72879dc48b4002bceb5592b4ebd3c996f5
|
| 3 |
+
size 990457
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0b85edce9fc6e7fed4af0e845e4a7252b0e0c96601efb601290a81220d792ec
|
| 3 |
+
size 118425
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1966.0,+155/-60,0.904,4.95,2.42,2.212,275.07,2.448,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1904.0,+176/-64,0.851,6.35,2.7,2.49,325.91,2.156,0.0,False,CPU
|
| 4 |
+
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1759.0,+141/-88,0.631,10.98,5.87,4.725,619.15,0.198,0.0,False,CPU
|
| 5 |
+
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1754.0,+144/-81,0.636,11.17,4.87,5.018,619.15,0.016,0.0,False,CPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1751.0,+113/-38,0.575,11.28,8.0,5.44,1633.8,2.053,0.0,False,GPU
|
| 7 |
+
5,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1736.0,+126/-79,0.63,11.87,5.47,4.763,2.21,0.025,0.0,False,CPU
|
| 8 |
+
6,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1718.0,+152/-92,0.545,12.6,6.95,7.508,110.13,0.386,0.0,False,CPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1701.0,+149/-83,0.524,13.3,8.51,7.923,86.85,0.668,0.0,False,CPU
|
| 10 |
+
8,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1681.0,+192/-136,0.513,14.19,5.59,7.27,804.65,0.71,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1679.0,+154/-138,0.544,14.26,7.1,6.907,2139.17,6.41,0.0,False,GPU
|
| 12 |
+
10,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1660.0,+210/-122,0.489,15.1,5.39,8.381,842.24,15.119,0.0,False,GPU
|
| 13 |
+
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1652.0,+124/-66,0.376,15.51,8.78,7.028,1633.8,0.088,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1640.0,+124/-80,0.421,16.04,11.5,8.376,110.13,0.061,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1625.0,+197/-156,0.458,16.73,6.29,7.978,804.65,0.063,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1610.0,+194/-117,0.419,17.44,6.83,9.033,842.24,1.465,0.0,False,GPU
|
| 17 |
+
15,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1582.0,+158/-128,0.416,18.81,7.95,8.63,2.3,0.896,0.0,False,GPU
|
| 18 |
+
16,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1580.0,+163/-89,0.323,18.95,12.1,9.74,86.85,0.078,0.0,False,CPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),βοΈ,1564.0,+170/-166,0.42,19.72,8.41,9.211,8.53,3.578,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1552.0,+126/-84,0.253,20.35,12.42,9.782,2139.17,0.349,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1536.0,+178/-158,0.347,21.12,7.53,9.019,4860.88,475.791,0.0,False,GPU
|
| 22 |
+
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1527.0,+95/-112,0.248,21.62,14.48,9.12,1156.69,1.558,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1490.0,+141/-106,0.196,23.53,15.19,10.678,572.82,1.935,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1478.0,+124/-111,0.174,24.2,17.96,12.87,270.2,0.192,0.0,False,CPU
|
| 25 |
+
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1461.0,+126/-146,0.228,25.07,13.69,10.861,0.49,0.053,0.0,False,CPU
|
| 26 |
+
24,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1454.0,+132/-118,0.163,25.44,19.32,12.698,572.82,0.109,0.0,False,GPU
|
| 27 |
+
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1453.0,+156/-178,0.241,25.48,14.6,10.49,5.5,0.074,0.0,False,GPU
|
| 28 |
+
26,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1431.0,+105/-129,0.123,26.67,20.62,11.432,371.59,2.386,0.0,False,CPU
|
| 29 |
+
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1430.0,+81/-65,0.077,26.75,23.68,10.923,6.41,0.247,0.0,False,GPU
|
| 30 |
+
28,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),β,1417.0,+121/-138,0.136,27.44,20.16,13.96,96.61,0.754,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1404.0,+129/-107,0.091,28.11,24.03,13.997,270.2,0.015,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1380.0,+97/-126,0.069,29.38,23.47,11.531,1156.69,0.054,0.0,False,CPU
|
| 33 |
+
31,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1374.0,+134/-137,0.087,29.67,18.69,12.762,4860.88,42.641,0.0,False,GPU
|
| 34 |
+
32,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1361.0,+129/-110,0.05,30.35,26.41,15.831,1.07,0.018,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1343.0,+98/-137,0.069,31.22,28.09,12.461,0.29,0.033,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1319.0,+52/-59,0.002,32.42,30.58,14.148,42.95,0.226,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1314.0,+88/-85,0.008,32.69,29.68,13.953,8.34,0.25,0.0,False,GPU
|
| 38 |
+
36,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1284.0,+174/-186,0.035,34.12,20.85,17.019,47.03,45.876,0.0,False,GPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1280.0,+61/-90,0.0,34.32,32.02,13.457,40.36,0.318,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1279.0,+74/-74,0.005,34.35,30.6,15.128,42.95,0.021,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1278.0,+84/-119,0.036,34.41,29.27,15.031,371.59,0.102,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1224.0,+66/-92,0.0,36.86,35.23,15.173,1.86,0.046,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1218.0,+64/-73,0.0,37.12,35.45,15.174,40.36,0.028,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1206.0,+134/-218,0.042,37.63,32.31,18.046,1.52,0.115,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1162.0,+147/-233,0.009,39.45,35.34,24.034,43.64,0.085,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,1140.0,+101/-190,0.011,40.28,31.54,20.729,513.06,78.02,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1112.0,+166/-225,0.005,41.35,38.03,25.027,43.64,0.022,0.0,False,CPU
|
| 48 |
+
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+88/-208,0.0,44.96,44.23,22.275,0.12,0.014,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,982.0,+135/-219,0.0,45.44,43.9,26.73,0.22,0.024,0.0,False,CPU
|
| 50 |
+
48,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,972.0,+202/-455,0.025,45.72,39.86,28.513,2.62,0.186,0.0,False,GPU
|
| 51 |
+
49,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),β,918.0,+91/-188,0.0,47.05,46.26,30.352,0.24,0.036,0.0,False,GPU
|
| 52 |
+
50,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,916.0,+100/-247,0.0,47.09,46.63,24.142,0.1,0.021,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,883.0,+76/-126,0.0,47.81,47.49,27.794,513.06,2.568,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,514.0,+107/-398,0.0,52.27,52.24,45.591,0.11,0.087,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0179b2e0997e900c319a3a5cf43b29f396a61a3a97b23e2d07c337dce82192e3
|
| 3 |
+
size 2102015
|
data/imputation_no/splits_all/tasks_binary/datasets_small/n_datasets_21
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09d6cd5b871ef3135cbae865a4a9965b387a85614651c1074b1a453df0ea4cbe
|
| 3 |
+
size 430099
|
data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:58ec2732e734b0b9acc52e0f938e161f18521a103ec56468d54f0d93292b6060
|
| 3 |
+
size 957912
|
data/imputation_no/splits_all/tasks_binary/datasets_small/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c86e4d19ab70052c9bb6456343c526867fef05756fefd94833876c5013162365
|
| 3 |
+
size 124173
|
data/imputation_no/splits_all/tasks_binary/datasets_small/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1582.0,+110/-77,0.748,8.48,3.33,7.287,593.57,8.084,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1579.0,+98/-56,0.789,8.57,4.04,6.466,5.96,0.554,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1574.0,+142/-69,0.753,8.74,3.16,5.03,2052.28,8.252,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1547.0,+128/-57,0.713,9.74,3.78,6.337,2052.28,1.266,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1435.0,+81/-50,0.471,14.72,9.21,12.183,2950.72,15.595,0.0,False,GPU
|
| 7 |
+
5,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1425.0,+85/-56,0.434,15.23,8.35,12.33,2457.54,1.658,0.0,False,GPU
|
| 8 |
+
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1415.0,+90/-69,0.417,15.75,8.92,11.866,1921.63,1.718,0.0,False,CPU
|
| 9 |
+
7,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1402.0,+82/-72,0.465,16.4,5.52,9.204,5351.68,268.579,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),β,1390.0,+81/-66,0.467,17.07,7.72,14.126,317.91,1.983,0.0,False,GPU
|
| 11 |
+
9,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1370.0,+83/-73,0.385,18.2,5.58,10.014,5351.68,37.621,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1366.0,+49/-38,0.31,18.4,12.57,14.198,512.57,1.18,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1361.0,+85/-59,0.327,18.67,10.34,13.333,2457.54,0.178,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1333.0,+44/-34,0.237,20.3,14.26,14.644,512.57,0.243,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1330.0,+80/-60,0.259,20.46,10.21,14.072,2950.72,1.225,0.0,False,GPU
|
| 16 |
+
14,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1319.0,+88/-68,0.243,21.12,8.79,14.168,4806.04,0.512,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1310.0,+52/-43,0.224,21.68,14.73,15.257,1096.5,0.584,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1309.0,+64/-47,0.253,21.73,13.86,15.195,4.81,0.08,0.0,False,CPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1305.0,+53/-43,0.222,21.97,15.14,15.264,1096.5,0.074,0.0,False,CPU
|
| 20 |
+
18,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1297.0,+88/-76,0.324,22.45,7.6,13.006,51.83,43.615,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1290.0,+51/-68,0.214,22.82,12.25,15.211,711.84,2.983,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1289.0,+47/-43,0.203,22.93,15.54,15.673,693.49,1.398,0.0,False,CPU
|
| 23 |
+
21,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1278.0,+68/-61,0.262,23.55,12.39,16.117,10.08,0.152,0.0,False,GPU
|
| 24 |
+
22,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1276.0,+114/-107,0.292,23.67,9.47,15.466,4806.04,8.461,0.0,False,GPU
|
| 25 |
+
23,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1267.0,+48/-48,0.176,24.26,14.62,16.409,1634.54,0.422,0.0,False,CPU
|
| 26 |
+
24,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1265.0,+62/-65,0.21,24.38,11.3,16.741,14.37,0.334,0.0,False,GPU
|
| 27 |
+
25,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1264.0,+42/-33,0.149,24.39,16.25,16.038,693.49,0.194,0.0,False,CPU
|
| 28 |
+
26,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1263.0,+53/-61,0.182,24.48,12.54,16.17,711.84,0.162,0.0,False,GPU
|
| 29 |
+
27,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1259.0,+81/-56,0.167,24.72,16.57,15.336,2665.36,2.619,0.0,False,CPU
|
| 30 |
+
28,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1243.0,+49/-50,0.134,25.68,14.64,16.945,1634.54,0.054,0.0,False,CPU
|
| 31 |
+
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1224.0,+62/-72,0.163,26.88,15.4,17.235,644.55,5.974,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1222.0,+52/-53,0.153,26.97,15.18,17.663,7.32,0.054,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1221.0,+56/-50,0.123,27.02,16.05,16.483,10.89,2.249,0.0,False,GPU
|
| 34 |
+
32,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1185.0,+72/-49,0.08,29.23,18.73,17.457,2665.36,0.143,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1174.0,+64/-77,0.071,29.9,17.46,18.602,644.55,0.398,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1167.0,+63/-83,0.087,30.28,19.64,19.966,203.15,0.968,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1162.0,+61/-59,0.058,30.6,22.99,18.743,1.94,0.121,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1132.0,+45/-51,0.033,32.32,27.15,19.177,2.44,0.121,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1131.0,+59/-76,0.054,32.38,21.08,20.887,203.15,0.091,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1107.0,+54/-85,0.049,33.76,20.87,21.614,484.22,1.025,0.0,False,CPU
|
| 41 |
+
39,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),β,1074.0,+108/-127,0.142,35.56,18.38,23.463,1.3,0.15,0.0,False,GPU
|
| 42 |
+
40,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1073.0,+51/-82,0.024,35.64,21.78,22.235,484.22,0.086,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1056.0,+61/-76,0.028,36.52,25.42,22.185,9.39,0.13,0.0,False,CPU
|
| 44 |
+
42,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1021.0,+89/-132,0.073,38.3,23.69,28.012,278.97,0.873,0.0,False,CPU
|
| 45 |
+
43,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1012.0,+76/-85,0.012,38.71,22.33,22.938,2.97,0.388,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+58/-111,0.018,39.3,30.97,25.166,0.42,0.041,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,998.0,+96/-137,0.053,39.38,24.75,28.578,278.97,0.103,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,988.0,+75/-112,0.019,39.87,27.69,25.72,90.71,1.623,0.0,False,CPU
|
| 49 |
+
47,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,986.0,+81/-105,0.027,39.92,31.85,25.768,3.71,0.919,0.0,False,GPU
|
| 50 |
+
48,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,964.0,+79/-130,0.015,40.92,33.63,26.469,0.33,0.043,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,952.0,+88/-162,0.034,41.4,27.1,30.627,1.48,0.139,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,921.0,+80/-144,0.001,42.66,27.85,29.993,90.71,0.125,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,616.0,+109/-176,0.0,49.97,44.93,43.126,0.22,0.02,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_small/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:78172565bb2582fdac1b2d466832f1a9afe26356d22bc415349ffaf92aca2f6f
|
| 3 |
+
size 2084457
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/n_datasets_20
ADDED
|
File without changes
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:33786548e598a47b40a21281a191ef04bfcbc56650372b56c5483527bb4cced6
|
| 3 |
+
size 483576
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_n_configs_imp.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:607718a2189859c597b085474b19b7604dd69b9214b9368fe8b78d4767e0c1e8
|
| 3 |
+
size 1038997
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/tuning-impact-elo.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a98a00b37dd6733cac15b4511aff08f6d130dc899b4406659209decbb2889a1c
|
| 3 |
+
size 131179
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/website_leaderboard.csv
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Verified,Elo [β¬οΈ],Elo 95% CI,Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Improvability (%) [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),βοΈ,1600.0,+91/-54,0.729,10.36,5.33,7.184,5.52,0.529,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),βοΈ,1588.0,+113/-69,0.685,10.87,4.46,5.826,2046.25,8.114,0.0,False,GPU
|
| 4 |
+
2,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1584.0,+88/-56,0.662,11.04,4.67,8.183,592.15,8.082,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),βοΈ,1569.0,+104/-64,0.657,11.74,4.79,7.089,2046.25,1.254,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[Mitra (default)](https://arxiv.org/abs/2510.21204),βοΈ,1510.0,+92/-60,0.585,14.67,5.88,10.733,144.27,3.772,0.0,False,GPU
|
| 7 |
+
5,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),βοΈ,1497.0,+79/-54,0.512,15.33,6.23,10.68,3445.6,51.274,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[LimiX (default)](https://arxiv.org/abs/2509.03505),β,1486.0,+98/-79,0.565,15.96,5.68,11.297,3.76,0.527,0.0,False,GPU
|
| 9 |
+
7,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),βοΈ,1479.0,+79/-67,0.493,16.35,5.93,10.213,8.06,1.714,0.0,False,GPU
|
| 10 |
+
8,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),βοΈ,1442.0,+65/-50,0.385,18.49,11.6,13.145,2879.46,14.626,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),βοΈ,1438.0,+75/-59,0.362,18.78,9.99,13.186,2379.18,1.595,0.0,False,GPU
|
| 12 |
+
10,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),β,1430.0,+69/-59,0.406,19.25,9.32,14.423,316.0,1.931,0.0,False,GPU
|
| 13 |
+
11,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",βοΈ,1419.0,+76/-58,0.339,19.93,11.82,12.9,1828.68,1.648,0.0,False,CPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),βοΈ,1419.0,+84/-68,0.391,19.94,6.64,10.011,5319.2,249.314,0.0,False,GPU
|
| 15 |
+
13,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),βοΈ,1415.0,+108/-75,0.407,20.2,6.42,13.416,3445.6,0.995,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),βοΈ,1399.0,+104/-71,0.361,21.18,6.68,10.637,5319.2,29.488,0.0,False,GPU
|
| 17 |
+
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),βοΈ,1381.0,+86/-58,0.273,22.36,12.32,14.163,2379.18,0.176,0.0,False,GPU
|
| 18 |
+
16,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1376.0,+45/-44,0.233,22.67,15.32,15.222,449.53,1.149,0.0,False,CPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),βοΈ,1372.0,+96/-85,0.405,22.91,8.63,15.503,3.73,0.488,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),βοΈ,1352.0,+65/-52,0.22,24.25,12.67,14.896,2879.46,0.944,0.0,False,GPU
|
| 21 |
+
19,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),βοΈ,1347.0,+63/-58,0.225,24.59,10.35,14.824,4575.49,0.51,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1347.0,+38/-37,0.17,24.6,17.27,15.649,449.53,0.215,0.0,False,CPU
|
| 23 |
+
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),βοΈ,1326.0,+105/-79,0.303,25.96,8.98,13.65,51.44,43.709,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),βοΈ,1326.0,+61/-49,0.189,25.97,16.69,16.157,4.7,0.08,0.0,False,CPU
|
| 25 |
+
23,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),βοΈ,1323.0,+56/-53,0.151,26.23,17.99,16.287,1081.93,0.556,0.0,False,CPU
|
| 26 |
+
24,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),βοΈ,1316.0,+56/-45,0.159,26.64,19.09,16.312,1081.93,0.074,0.0,False,CPU
|
| 27 |
+
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),βοΈ,1308.0,+67/-67,0.219,27.19,14.07,16.789,9.81,0.146,0.0,False,GPU
|
| 28 |
+
26,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),βοΈ,1302.0,+53/-58,0.162,27.58,15.63,16.244,592.34,2.767,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),βοΈ,1298.0,+52/-52,0.138,27.86,19.56,16.778,645.57,1.032,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),βοΈ,1295.0,+66/-71,0.174,28.07,13.53,17.352,14.36,0.311,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1292.0,+50/-50,0.129,28.32,17.46,17.207,1618.46,0.415,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),βοΈ,1290.0,+97/-103,0.254,28.39,11.16,16.484,4575.49,8.396,0.0,False,GPU
|
| 33 |
+
31,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1286.0,+69/-58,0.14,28.68,19.64,15.992,2576.18,2.415,0.0,False,CPU
|
| 34 |
+
32,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),βοΈ,1280.0,+54/-58,0.127,29.14,15.16,17.188,592.34,0.146,0.0,False,GPU
|
| 35 |
+
33,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),βοΈ,1275.0,+42/-42,0.084,29.47,19.6,17.137,645.57,0.172,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1271.0,+52/-55,0.1,29.74,16.79,17.71,1618.46,0.054,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),βοΈ,1254.0,+54/-58,0.115,30.88,16.81,18.247,6.86,0.052,0.0,False,CPU
|
| 38 |
+
36,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),βοΈ,1253.0,+67/-78,0.143,30.93,17.0,17.887,618.9,5.468,0.0,False,CPU
|
| 39 |
+
37,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),βοΈ,1250.0,+55/-56,0.088,31.15,18.15,17.097,10.47,1.987,0.0,False,GPU
|
| 40 |
+
38,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1213.0,+63/-50,0.062,33.59,21.56,17.997,2576.18,0.136,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),βοΈ,1206.0,+67/-74,0.058,34.09,19.4,19.212,618.9,0.352,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1183.0,+84/-72,0.067,35.56,23.19,21.088,199.83,0.865,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),βοΈ,1172.0,+64/-60,0.025,36.23,29.08,19.888,1.77,0.119,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,1150.0,+78/-78,0.04,37.6,25.09,21.933,199.83,0.086,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),βοΈ,1144.0,+40/-43,0.018,38.0,32.13,20.296,2.2,0.12,0.0,False,CPU
|
| 46 |
+
44,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),β,1110.0,+95/-131,0.115,40.03,21.41,23.531,1.24,0.143,0.0,False,GPU
|
| 47 |
+
45,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1108.0,+65/-85,0.02,40.14,26.17,22.968,440.56,0.933,0.0,False,CPU
|
| 48 |
+
46,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1086.0,+75/-74,0.018,41.44,29.26,22.66,8.39,0.127,0.0,False,CPU
|
| 49 |
+
47,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1078.0,+52/-79,0.004,41.88,24.91,23.518,440.56,0.085,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1057.0,+98/-123,0.071,43.04,26.02,28.113,273.27,0.715,0.0,False,CPU
|
| 51 |
+
49,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),βοΈ,1043.0,+78/-87,0.0,43.76,24.97,23.546,2.84,0.381,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,1034.0,+94/-126,0.047,44.19,27.79,28.584,273.27,0.098,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,1020.0,+83/-108,0.02,44.93,30.67,26.329,89.68,1.55,0.0,False,CPU
|
| 54 |
+
52,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),βοΈ,1002.0,+98/-112,0.011,45.79,36.55,26.937,2.96,0.796,0.0,False,GPU
|
| 55 |
+
53,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),βοΈ,1000.0,+63/-105,0.003,45.87,37.86,26.578,0.42,0.04,0.0,False,CPU
|
| 56 |
+
54,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),βοΈ,989.0,+102/-139,0.03,46.39,30.04,30.404,1.44,0.138,0.0,False,CPU
|
| 57 |
+
55,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),βοΈ,976.0,+93/-114,0.012,46.96,38.72,27.729,0.31,0.042,0.0,False,CPU
|
| 58 |
+
56,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,953.0,+86/-138,0.001,47.95,30.7,30.595,89.68,0.12,0.0,False,CPU
|
| 59 |
+
57,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),βοΈ,639.0,+130/-215,0.0,55.9,49.79,43.912,0.21,0.019,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/winrate_matrix.png.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f936028ebc0edda40cbeaa24cd8fa98995ab66cc1da7cc7a583e2ba79c96a503
|
| 3 |
+
size 2690375
|
data/imputation_no/splits_all/tasks_classification/datasets_all/n_datasets_38
ADDED
|
File without changes
|