Spaces:
Running
Running
Commit
Β·
9560044
1
Parent(s):
e6fcd81
update: fixed plots
Browse filesThis view is limited to 50 files because it contains too many changes. Β
See raw diff
- data/imputation_no/splits_all/tasks_all/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_all/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_all/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_all/website_leaderboard.csv +51 -51
- data/imputation_no/splits_all/tasks_all/datasets_all/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_medium/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_medium/website_leaderboard.csv +51 -51
- data/imputation_no/splits_all/tasks_all/datasets_medium/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_small/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_small/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_small/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_small/website_leaderboard.csv +51 -51
- data/imputation_no/splits_all/tasks_all/datasets_small/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/website_leaderboard.csv +56 -56
- data/imputation_no/splits_all/tasks_all/datasets_tabpfn/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_all/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_all/website_leaderboard.csv +53 -53
- data/imputation_no/splits_all/tasks_binary/datasets_all/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_medium/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_medium/website_leaderboard.csv +54 -54
- data/imputation_no/splits_all/tasks_binary/datasets_medium/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_small/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_small/website_leaderboard.csv +53 -53
- data/imputation_no/splits_all/tasks_binary/datasets_small/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/website_leaderboard.csv +59 -59
- data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_all/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_classification/datasets_all/website_leaderboard.csv +53 -53
- data/imputation_no/splits_all/tasks_classification/datasets_all/winrate_matrix.png.zip +1 -1
- data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip +1 -1
- data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_n_configs_imp.png.zip +2 -2
- data/imputation_no/splits_all/tasks_classification/datasets_medium/tuning-impact-elo.png.zip +1 -1
- data/imputation_no/splits_all/tasks_classification/datasets_medium/website_leaderboard.csv +54 -54
- data/imputation_no/splits_all/tasks_classification/datasets_medium/winrate_matrix.png.zip +1 -1
data/imputation_no/splits_all/tasks_all/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 434350
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1dd9ea2c826175640f8d2397b1335e732569371bbcb838c21696add572fef528
|
| 3 |
size 434350
|
data/imputation_no/splits_all/tasks_all/datasets_all/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bad65cc0285c1450996cf99e3a2cb903a9c18154770b93e76067fe7afc3c6ef9
|
| 3 |
+
size 968055
|
data/imputation_no/splits_all/tasks_all/datasets_all/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 108478
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c2789a139f2ed0e703246604cd3517c8cad11d2f18e5e058a6195ec2b4603eb3
|
| 3 |
size 108478
|
data/imputation_no/splits_all/tasks_all/datasets_all/website_leaderboard.csv
CHANGED
|
@@ -1,51 +1,51 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 6 |
-
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 7 |
-
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 8 |
-
6,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 9 |
-
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 10 |
-
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 11 |
-
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 12 |
-
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 13 |
-
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 14 |
-
12,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 15 |
-
13,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 16 |
-
14,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 17 |
-
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 18 |
-
16,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 19 |
-
17,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 21 |
-
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 22 |
-
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 23 |
-
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 24 |
-
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 25 |
-
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 26 |
-
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 27 |
-
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 28 |
-
26,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 29 |
-
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 30 |
-
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 31 |
-
29,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 32 |
-
30,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 33 |
-
31,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 34 |
-
32,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 35 |
-
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 36 |
-
34,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 37 |
-
35,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 38 |
-
36,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 39 |
-
37,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 40 |
-
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 41 |
-
39,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 42 |
-
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 43 |
-
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 44 |
-
42,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 45 |
-
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 46 |
-
44,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 47 |
-
45,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 48 |
-
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 49 |
-
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 50 |
-
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 51 |
-
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1679.0,+64/-51,5.507,0.789,6.94,3.2,582.21,6.116,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1626.0,+89/-60,4.753,0.739,8.58,2.9,2040.22,8.92,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1580.0,+73/-54,5.726,0.68,10.27,3.97,2040.22,1.218,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1546.0,+72/-52,6.429,0.654,11.6,4.97,5.81,0.645,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1539.0,+55/-51,8.693,0.549,11.93,5.37,1735.72,2.559,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1536.0,+57/-48,8.739,0.556,12.03,6.93,2950.72,11.988,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1479.0,+65/-53,8.827,0.523,14.61,4.53,4907.64,286.652,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1466.0,+56/-43,10.223,0.428,15.26,8.29,3285.87,1.472,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1450.0,+36/-31,11.452,0.378,16.06,11.15,416.98,2.639,βοΈ,0.0,False,CPU
|
| 11 |
+
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1445.0,+46/-48,10.227,0.379,16.28,8.65,2950.72,0.663,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1432.0,+44/-43,10.958,0.36,16.98,10.14,1658.41,0.653,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1420.0,+60/-58,10.229,0.419,17.58,6.04,4907.64,39.96,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1419.0,+42/-44,11.142,0.345,17.6,9.69,1658.41,0.081,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1409.0,+82/-54,11.442,0.385,18.12,7.61,4621.67,8.149,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1404.0,+56/-47,11.14,0.341,18.38,9.66,3285.87,0.173,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1400.0,+31/-30,12.143,0.28,18.63,13.38,416.98,0.334,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1389.0,+35/-36,12.22,0.296,19.21,12.62,693.49,1.69,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1378.0,+41/-42,12.023,0.315,19.76,11.31,6.83,0.08,βοΈ,0.0,False,CPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1371.0,+45/-40,11.984,0.243,20.17,10.17,4621.67,0.475,βοΈ,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1366.0,+49/-41,12.584,0.267,20.45,11.91,846.88,2.552,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1363.0,+31/-33,12.54,0.241,20.59,14.97,693.49,0.308,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1339.0,+70/-60,12.933,0.336,21.91,7.2,47.62,43.739,βοΈ,0.0,False,GPU
|
| 24 |
+
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1313.0,+46/-38,13.883,0.198,23.35,14.43,846.88,0.13,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1305.0,+54/-47,13.655,0.236,23.79,14.16,10.49,0.132,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1299.0,+50/-50,13.439,0.164,24.11,16.52,2874.67,1.952,βοΈ,0.0,False,CPU
|
| 27 |
+
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1282.0,+43/-40,15.191,0.171,25.07,16.13,2929.85,0.422,βοΈ,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1257.0,+44/-44,15.566,0.123,26.41,15.77,14.87,0.308,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1243.0,+47/-43,15.868,0.121,27.22,17.59,2929.85,0.051,βοΈ,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1240.0,+36/-41,14.957,0.086,27.36,19.31,10.06,1.689,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1219.0,+39/-38,15.422,0.091,28.49,20.6,1.94,0.123,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1219.0,+52/-61,16.343,0.134,28.51,17.29,593.24,4.467,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1218.0,+41/-47,15.309,0.078,28.58,20.1,2874.67,0.131,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1212.0,+46/-42,16.88,0.101,28.89,19.17,183.02,0.761,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1208.0,+46/-48,17.03,0.115,29.06,19.52,7.32,0.05,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1190.0,+35/-29,16.049,0.048,30.03,26.04,1.96,0.142,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1179.0,+55/-48,17.756,0.076,30.61,20.12,373.18,0.771,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1172.0,+47/-52,17.853,0.076,30.96,19.36,183.02,0.091,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1153.0,+52/-55,17.842,0.057,31.96,21.29,593.24,0.306,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1141.0,+49/-46,18.528,0.052,32.55,19.95,373.18,0.085,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1073.0,+35/-48,19.694,0.012,35.84,28.74,9.99,0.126,βοΈ,0.0,False,CPU
|
| 42 |
+
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1043.0,+62/-61,23.269,0.036,37.16,29.18,3.23,0.919,βοΈ,0.0,False,GPU
|
| 43 |
+
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1005.0,+59/-60,22.719,0.013,38.74,28.39,2.86,0.373,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+45/-50,23.485,0.006,38.93,34.17,0.43,0.054,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),998.0,+63/-88,25.352,0.016,39.0,27.81,129.01,1.802,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),980.0,+59/-71,24.998,0.011,39.69,34.68,0.25,0.05,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),970.0,+64/-97,31.269,0.032,40.07,30.33,237.58,0.424,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),940.0,+71/-111,31.88,0.023,41.15,31.63,237.58,0.085,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),888.0,+68/-108,30.599,0.003,42.8,32.9,129.01,0.18,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),853.0,+76/-133,34.618,0.014,43.79,34.99,1.19,0.12,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),636.0,+89/-113,44.269,0.0,47.95,43.9,0.19,0.036,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_all/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1739374
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d7f0256cccbc9d360e60c248ee0d2afee7b3fbb0eb13ce8ded31b2f523126680
|
| 3 |
size 1739374
|
data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 399354
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2e82722ede5d45ca41b062fa94c487123bbf01997c66b06cd2cf06e4281142c5
|
| 3 |
size 399354
|
data/imputation_no/splits_all/tasks_all/datasets_medium/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b819ee8c30207b57868a68efcc7ec9b1d27ef0ff5aeeda722d05d4d59568bac1
|
| 3 |
+
size 989200
|
data/imputation_no/splits_all/tasks_all/datasets_medium/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 112567
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:84be5741ee4ed6304624f803d704de577234f3a7a9827a3673a42bee30f83d2f
|
| 3 |
size 112567
|
data/imputation_no/splits_all/tasks_all/datasets_medium/website_leaderboard.csv
CHANGED
|
@@ -1,51 +1,51 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 5 |
-
3,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 6 |
-
4,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 7 |
-
5,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 8 |
-
6,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 9 |
-
7,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 10 |
-
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 11 |
-
9,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 12 |
-
10,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 13 |
-
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 14 |
-
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 15 |
-
13,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 16 |
-
14,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 17 |
-
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 18 |
-
16,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 19 |
-
17,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 21 |
-
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 22 |
-
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 23 |
-
21,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 24 |
-
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 25 |
-
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 26 |
-
24,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 27 |
-
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 28 |
-
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 29 |
-
27,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 30 |
-
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 31 |
-
29,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 32 |
-
30,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 33 |
-
31,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 34 |
-
32,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 35 |
-
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 36 |
-
34,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 37 |
-
35,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 38 |
-
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 39 |
-
37,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 40 |
-
38,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 41 |
-
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 42 |
-
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 43 |
-
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 44 |
-
42,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 45 |
-
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 46 |
-
44,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 47 |
-
45,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 48 |
-
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 49 |
-
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 50 |
-
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 51 |
-
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1825.0,+86/-46,2.566,0.836,5.78,2.85,289.53,3.187,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1804.0,+82/-49,2.669,0.808,6.29,3.08,432.35,4.085,βοΈ,0.0,False,CPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1676.0,+164/-124,5.382,0.66,10.21,3.09,735.58,11.736,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1649.0,+109/-94,5.684,0.581,11.21,6.96,1719.82,1.675,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1635.0,+125/-116,5.75,0.598,11.74,6.46,2526.28,6.013,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1621.0,+86/-63,5.585,0.539,12.33,6.64,777.59,0.25,βοΈ,0.0,False,CPU
|
| 8 |
+
6,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1620.0,+145/-112,6.097,0.591,12.34,5.04,735.58,1.386,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1610.0,+94/-69,5.783,0.541,12.74,5.67,777.59,0.052,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1602.0,+76/-56,7.351,0.493,13.08,8.87,131.56,2.639,βοΈ,0.0,False,CPU
|
| 11 |
+
9,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1567.0,+105/-96,5.97,0.524,14.58,7.14,3.24,0.031,βοΈ,0.0,False,CPU
|
| 12 |
+
10,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1560.0,+87/-61,7.478,0.447,14.9,8.9,282.13,0.563,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1549.0,+116/-94,7.016,0.405,15.39,8.76,1719.82,0.081,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1546.0,+155/-99,6.906,0.478,15.51,7.63,1.88,0.645,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1542.0,+155/-95,7.41,0.426,15.7,7.33,1993.14,0.619,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1534.0,+141/-125,7.024,0.48,16.05,4.17,4786.55,444.544,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1512.0,+80/-65,8.574,0.342,17.07,11.95,131.56,0.132,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1510.0,+69/-51,8.062,0.356,17.18,13.18,282.13,0.066,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1490.0,+152/-101,8.168,0.36,18.13,8.42,1993.14,0.061,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1481.0,+107/-91,8.151,0.32,18.51,12.5,2526.28,0.349,βοΈ,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1438.0,+108/-100,9.676,0.271,20.59,12.75,566.74,0.951,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1412.0,+122/-124,9.655,0.296,21.86,8.61,4786.55,42.641,βοΈ,0.0,False,GPU
|
| 23 |
+
21,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1387.0,+71/-71,9.424,0.179,23.12,16.95,1770.56,1.069,βοΈ,0.0,False,CPU
|
| 24 |
+
22,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1382.0,+97/-96,11.377,0.191,23.34,18.62,566.74,0.06,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1371.0,+104/-120,9.928,0.234,23.89,14.51,0.49,0.053,βοΈ,0.0,False,CPU
|
| 26 |
+
24,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1339.0,+130/-140,12.451,0.221,25.48,10.01,46.62,43.739,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1334.0,+119/-133,12.922,0.194,25.72,17.81,1517.65,0.134,βοΈ,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1328.0,+132/-111,11.007,0.177,26.01,17.36,5.16,0.074,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1302.0,+77/-82,11.463,0.096,27.27,23.36,8.06,0.25,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1280.0,+84/-70,12.214,0.046,28.34,25.52,6.75,0.235,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1275.0,+78/-77,11.211,0.055,28.58,24.36,1770.56,0.051,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1271.0,+110/-134,13.812,0.125,28.79,22.32,1517.65,0.015,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1258.0,+62/-73,11.863,0.051,29.37,27.19,0.29,0.045,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1249.0,+86/-79,12.418,0.039,29.81,24.11,66.0,0.341,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1220.0,+97/-140,15.399,0.085,31.14,26.84,3.12,0.016,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1216.0,+97/-87,13.131,0.04,31.35,25.48,66.0,0.024,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1214.0,+108/-138,14.369,0.071,31.42,25.0,351.94,1.658,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1206.0,+71/-86,12.542,0.021,31.77,29.62,36.48,0.329,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1158.0,+63/-76,13.771,0.006,33.91,32.33,36.48,0.037,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1118.0,+67/-72,15.534,0.0,35.56,34.12,2.18,0.039,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1102.0,+85/-108,16.646,0.021,36.21,32.28,351.94,0.114,βοΈ,0.0,False,CPU
|
| 42 |
+
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1046.0,+145/-191,23.683,0.018,38.34,33.71,2.49,0.145,βοΈ,0.0,False,GPU
|
| 43 |
+
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1022.0,+138/-176,20.34,0.024,39.18,35.21,1.51,0.111,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+60/-87,18.698,0.0,39.92,39.15,0.2,0.021,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),998.0,+87/-126,22.252,0.006,39.99,34.2,150.3,10.071,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),950.0,+152/-228,31.109,0.005,41.48,38.36,43.64,0.081,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),940.0,+106/-141,21.813,0.002,41.8,40.36,0.11,0.028,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),897.0,+156/-249,32.052,0.003,42.99,40.6,43.64,0.018,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),813.0,+58/-95,28.248,0.0,44.96,44.7,150.3,0.482,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),785.0,+139/-247,34.158,0.0,45.52,44.41,0.19,0.019,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),566.0,+107/-159,42.214,0.0,48.53,48.44,0.1,0.072,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_medium/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1634342
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:36be9d3ce0af98477238f9519e6a9a06ec46e0c5afe2bc615cc08bf456fb64a5
|
| 3 |
size 1634342
|
data/imputation_no/splits_all/tasks_all/datasets_small/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 397284
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a47eadc792672c3f41eff8c373824e252e6928b11cfe2a8e6324a4c6f55ef05b
|
| 3 |
size 397284
|
data/imputation_no/splits_all/tasks_all/datasets_small/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b9e72f35f0f94d4d7734e2cce25b19ad20f0e57b566c38b06c41176826f7e12c
|
| 3 |
+
size 955425
|
data/imputation_no/splits_all/tasks_all/datasets_small/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 107979
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:23200a9c9d5f32d204e821ebd0df849df50e338db30ee7af5a4ecd319eecdaf2
|
| 3 |
size 107979
|
data/imputation_no/splits_all/tasks_all/datasets_small/website_leaderboard.csv
CHANGED
|
@@ -1,51 +1,51 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 6 |
-
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 7 |
-
5,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 8 |
-
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 9 |
-
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 11 |
-
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 12 |
-
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 13 |
-
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 14 |
-
12,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 15 |
-
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 16 |
-
14,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 17 |
-
15,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 18 |
-
16,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 19 |
-
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 21 |
-
19,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 22 |
-
20,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 23 |
-
21,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 24 |
-
22,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 25 |
-
23,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 26 |
-
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 27 |
-
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 28 |
-
26,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 29 |
-
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 30 |
-
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 31 |
-
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 32 |
-
30,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 33 |
-
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 34 |
-
32,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 35 |
-
33,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 36 |
-
34,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 37 |
-
35,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 38 |
-
36,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 39 |
-
37,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 40 |
-
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 41 |
-
39,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 42 |
-
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 43 |
-
41,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 44 |
-
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 45 |
-
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 46 |
-
44,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 47 |
-
45,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 48 |
-
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 49 |
-
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 50 |
-
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 51 |
-
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1640.0,+68/-54,6.733,0.769,7.42,3.38,659.63,7.444,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1625.0,+97/-63,4.491,0.772,7.9,2.83,2289.05,8.049,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1580.0,+79/-58,5.571,0.717,9.4,3.65,2289.05,1.143,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1565.0,+86/-62,6.23,0.728,9.98,4.34,6.76,0.636,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1506.0,+68/-49,10.012,0.546,12.38,6.91,3770.75,21.902,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1470.0,+83/-61,9.579,0.54,14.01,4.71,5119.36,218.711,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1464.0,+54/-48,11.203,0.441,14.28,7.78,3716.07,2.547,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1448.0,+59/-48,11.395,0.429,15.08,8.77,3553.12,1.741,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1433.0,+76/-59,10.468,0.471,15.79,5.38,5119.36,28.351,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1416.0,+56/-42,11.565,0.369,16.66,8.6,3770.75,1.778,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1404.0,+35/-36,13.16,0.33,17.29,12.49,892.41,2.574,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1381.0,+56/-51,12.378,0.333,18.49,10.3,3553.12,0.241,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1374.0,+43/-44,13.197,0.286,18.91,13.0,2476.51,0.814,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1367.0,+35/-28,13.63,0.254,19.29,14.08,892.41,0.346,βοΈ,0.0,False,CPU
|
| 16 |
+
14,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1360.0,+46/-36,13.375,0.263,19.62,13.76,2476.51,0.101,βοΈ,0.0,False,CPU
|
| 17 |
+
15,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1347.0,+47/-42,13.796,0.265,20.39,11.59,1126.71,2.941,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1346.0,+72/-67,13.133,0.384,20.43,6.44,50.32,43.709,βοΈ,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1340.0,+64/-61,13.813,0.296,20.78,8.22,6521.96,8.396,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1338.0,+46/-42,13.58,0.211,20.86,9.44,6521.96,0.506,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1335.0,+36/-38,14.196,0.233,21.01,15.28,884.18,2.368,βοΈ,0.0,False,CPU
|
| 22 |
+
20,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1319.0,+37/-41,14.545,0.227,21.92,14.94,9.64,0.128,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1317.0,+34/-37,14.406,0.193,22.02,15.86,884.18,0.393,βοΈ,0.0,False,CPU
|
| 24 |
+
22,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1302.0,+56/-46,14.758,0.261,22.86,13.15,13.18,0.17,βοΈ,0.0,False,GPU
|
| 25 |
+
23,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1294.0,+40/-44,14.927,0.201,23.35,13.19,1126.71,0.163,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1273.0,+47/-50,15.112,0.158,24.52,16.34,3865.95,2.158,βοΈ,0.0,False,CPU
|
| 27 |
+
25,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1268.0,+47/-45,16.137,0.162,24.79,15.52,3351.28,0.47,βοΈ,0.0,False,CPU
|
| 28 |
+
26,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1246.0,+48/-54,17.276,0.135,26.05,13.88,16.27,0.321,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1237.0,+48/-47,16.725,0.119,26.56,16.17,3351.28,0.056,βοΈ,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1230.0,+39/-42,16.1,0.103,26.95,17.53,15.69,4.691,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1224.0,+58/-62,17.165,0.16,27.29,15.32,1678.92,8.069,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1217.0,+70/-64,18.687,0.135,27.68,16.72,499.14,1.466,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1208.0,+51/-51,17.71,0.128,28.2,17.53,9.08,0.057,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1201.0,+40/-47,17.016,0.087,28.58,18.73,3865.95,0.148,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1180.0,+64/-62,19.553,0.105,29.74,16.59,499.14,0.207,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1172.0,+54/-51,18.34,0.072,30.18,18.64,1678.92,0.826,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1169.0,+40/-39,17.793,0.046,30.3,25.59,3.61,0.17,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1168.0,+34/-37,17.712,0.031,30.4,24.97,3.29,0.253,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1158.0,+58/-70,19.98,0.091,30.94,18.82,590.04,1.461,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1117.0,+56/-70,20.776,0.057,33.05,18.3,590.04,0.15,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1058.0,+48/-47,21.427,0.017,35.95,26.97,13.69,0.155,βοΈ,0.0,False,CPU
|
| 42 |
+
40,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1042.0,+69/-90,23.096,0.043,36.67,27.64,5.44,1.098,βοΈ,0.0,False,GPU
|
| 43 |
+
41,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+56/-75,25.48,0.008,38.52,32.45,0.51,0.089,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),999.0,+50/-60,23.71,0.008,38.56,26.27,5.48,0.685,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),998.0,+73/-96,26.644,0.019,38.58,25.8,111.84,1.215,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),993.0,+72/-72,26.326,0.015,38.81,32.76,0.47,0.092,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),976.0,+86/-100,31.336,0.043,39.48,27.89,520.95,0.647,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),953.0,+84/-107,31.808,0.031,40.38,28.96,520.95,0.113,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),910.0,+73/-92,31.579,0.004,41.9,29.64,111.84,0.111,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),872.0,+99/-124,34.809,0.02,43.07,32.15,2.59,0.138,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),654.0,+110/-151,45.125,0.0,47.7,42.25,0.37,0.033,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_small/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1729917
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:10c40e7138ab23aa1e2ad6038a50adbe7e3c7f7cfe5d376584fb9fd5f401f89c
|
| 3 |
size 1729917
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 428426
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:814976a6f141963f3c1e07b42ce6e6474b20be3bdcaa25fde5755f544f3c8152
|
| 3 |
size 428426
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a80d25054695934b924850f798a7d9b8ccfe0122e6b6c7279ac9107116285c62
|
| 3 |
+
size 1031798
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 115758
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:10a5b863795e2f720c603c8ebd1977e82aa7685b1d9e4d6a96453a5aea59f906
|
| 3 |
size 115758
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/website_leaderboard.csv
CHANGED
|
@@ -1,56 +1,56 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 6 |
-
4,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6)
|
| 7 |
-
5
|
| 8 |
-
6,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 9 |
-
7
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 11 |
-
9,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 12 |
-
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 13 |
-
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 14 |
-
12,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6)
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 16 |
-
14,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 17 |
-
15,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6)
|
| 18 |
-
16,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 19 |
-
17,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 20 |
-
18,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 22 |
-
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 23 |
-
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 24 |
-
22,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 25 |
-
23,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 26 |
-
24,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 27 |
-
25,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 28 |
-
26,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 29 |
-
27,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 30 |
-
28,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 31 |
-
29,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 32 |
-
30,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 33 |
-
31,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 34 |
-
32,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 35 |
-
33,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 36 |
-
34,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 37 |
-
35,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 38 |
-
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 39 |
-
37,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 40 |
-
38,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 41 |
-
39,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 42 |
-
40,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 43 |
-
41,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 44 |
-
42,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 45 |
-
43,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 46 |
-
44,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 47 |
-
45,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 48 |
-
46,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 49 |
-
47,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 50 |
-
48,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 51 |
-
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 52 |
-
50,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 53 |
-
51,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 54 |
-
52,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 55 |
-
53,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 56 |
-
54,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1640.0,+95/-71,5.186,0.744,9.05,3.4,2166.18,7.945,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1637.0,+78/-54,7.606,0.72,9.17,4.23,611.55,7.01,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1602.0,+66/-63,6.822,0.723,10.54,5.18,6.14,0.586,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1597.0,+72/-62,6.284,0.693,10.73,4.24,2166.18,0.993,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),1546.0,+74/-50,9.458,0.591,12.97,5.42,3899.42,55.833,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ β‘,Foundation Model,[Mitra (default)](https://arxiv.org/abs/2510.21204),1516.0,+74/-47,10.623,0.559,14.46,5.84,136.59,3.391,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1514.0,+54/-45,11.014,0.504,14.56,8.05,3547.04,20.963,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π§ β‘,Foundation Model,[LimiX (default)](https://arxiv.org/abs/2509.03505),1506.0,+74/-71,13.034,0.586,14.97,5.38,4.85,0.629,β,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1468.0,+75/-61,10.616,0.481,16.95,5.43,4980.83,207.372,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1459.0,+46/-52,12.287,0.384,17.46,9.83,3376.59,2.54,βοΈ,0.0,False,CPU
|
| 12 |
+
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1446.0,+55/-50,12.487,0.373,18.19,10.24,3372.56,1.658,βοΈ,0.0,False,GPU
|
| 13 |
+
11,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1442.0,+80/-69,11.415,0.445,18.39,5.94,4980.83,23.583,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),1439.0,+82/-69,12.024,0.434,18.6,6.82,3899.42,0.983,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1422.0,+56/-47,12.593,0.337,19.55,10.33,3547.04,1.57,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1398.0,+36/-36,14.456,0.258,20.98,15.0,771.57,2.49,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),1390.0,+71/-69,13.505,0.399,21.43,9.2,4.22,0.554,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1384.0,+58/-51,13.499,0.284,21.83,11.77,3372.56,0.208,βοΈ,0.0,False,GPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1382.0,+42/-37,14.384,0.24,21.91,15.08,2034.85,0.805,βοΈ,0.0,False,CPU
|
| 20 |
+
18,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1368.0,+37/-33,14.581,0.219,22.76,16.26,2034.85,0.097,βοΈ,0.0,False,CPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1366.0,+90/-66,14.141,0.381,22.88,6.96,48.9,43.804,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1363.0,+36/-30,14.932,0.189,23.09,16.97,771.57,0.322,βοΈ,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1342.0,+50/-45,15.104,0.205,24.36,14.6,1105.59,2.552,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1338.0,+36/-36,15.506,0.181,24.6,18.37,828.74,2.312,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1338.0,+73/-67,15.155,0.25,24.64,11.28,6147.69,8.149,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1338.0,+46/-49,14.737,0.17,24.64,11.71,6147.69,0.485,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1327.0,+48/-45,15.809,0.184,25.31,17.24,8.51,0.123,βοΈ,0.0,False,CPU
|
| 28 |
+
26,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1320.0,+32/-34,15.718,0.142,25.71,18.6,828.74,0.336,βοΈ,0.0,False,CPU
|
| 29 |
+
27,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1313.0,+54/-53,15.881,0.226,26.15,14.69,12.24,0.154,βοΈ,0.0,False,GPU
|
| 30 |
+
28,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1296.0,+45/-40,16.243,0.151,27.25,16.29,1105.59,0.13,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1282.0,+48/-45,17.283,0.12,28.07,18.33,2929.85,0.433,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1275.0,+48/-54,16.303,0.124,28.54,20.3,3704.3,2.074,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1267.0,+47/-42,17.906,0.118,28.99,15.86,16.16,0.307,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1252.0,+52/-49,17.885,0.084,29.95,18.24,2929.85,0.054,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1245.0,+42/-38,17.002,0.082,30.35,19.8,15.48,4.535,βοΈ,0.0,False,GPU
|
| 36 |
+
34,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1236.0,+51/-62,18.355,0.142,30.9,16.77,1459.62,8.056,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1219.0,+49/-53,18.772,0.078,31.95,19.88,8.47,0.054,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1213.0,+60/-60,20.26,0.101,32.33,21.51,416.39,1.393,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1203.0,+47/-48,18.22,0.065,32.91,21.43,3704.3,0.143,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1181.0,+56/-61,19.544,0.063,34.18,20.76,1459.62,0.89,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1177.0,+57/-61,21.094,0.069,34.43,22.54,416.39,0.179,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1172.0,+37/-38,19.131,0.017,34.71,29.77,3.05,0.241,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1158.0,+33/-41,19.359,0.021,35.5,31.12,3.39,0.158,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1142.0,+56/-58,21.744,0.047,36.41,24.9,572.67,1.421,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1103.0,+47/-48,22.52,0.019,38.56,25.42,572.67,0.143,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1067.0,+50/-60,22.688,0.012,40.39,30.45,11.82,0.147,βοΈ,0.0,False,CPU
|
| 47 |
+
45,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1053.0,+71/-83,24.705,0.03,41.1,31.46,5.39,1.034,βοΈ,0.0,False,GPU
|
| 48 |
+
46,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1010.0,+55/-66,24.827,0.0,43.07,28.88,5.18,0.652,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1004.0,+72/-90,28.179,0.012,43.34,31.16,100.58,1.106,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1003.0,+71/-108,31.292,0.044,43.36,30.05,504.17,0.629,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1002.0,+83/-87,27.374,0.008,43.4,36.68,0.42,0.078,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+55/-70,26.617,0.002,43.49,37.64,0.47,0.069,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),980.0,+74/-108,31.725,0.03,44.33,31.71,504.17,0.103,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),908.0,+78/-103,33.337,0.0,47.0,33.68,100.58,0.101,βοΈ,0.0,False,CPU
|
| 55 |
+
53,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),903.0,+82/-129,34.211,0.019,47.19,34.88,2.51,0.137,βοΈ,0.0,False,CPU
|
| 56 |
+
54,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),680.0,+97/-169,45.686,0.0,52.44,45.72,0.29,0.028,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_all/datasets_tabpfn/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2212024
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6f6d351346ebb8ff8cb6cdd49a2cb2fa092dddbf6561bbaaaecbbbe2af43173a
|
| 3 |
size 2212024
|
data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 429276
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1e3a277f7edcdee89d89e95d1b5480b0d72b7271e7a90bbfa3944f443df0c9e
|
| 3 |
size 429276
|
data/imputation_no/splits_all/tasks_binary/datasets_all/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e34bbe80e56bc3cda9aa62b92aeab5758bd1ddb6d7c51a51d9c3f1f753eb6f0c
|
| 3 |
+
size 958750
|
data/imputation_no/splits_all/tasks_binary/datasets_all/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 113807
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:71fd051104b26359c822debf594b3a093680f7a2d753ec01e6f2dd257bdcc831
|
| 3 |
size 113807
|
data/imputation_no/splits_all/tasks_binary/datasets_all/website_leaderboard.csv
CHANGED
|
@@ -1,53 +1,53 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 6 |
-
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 7 |
-
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 8 |
-
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 9 |
-
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 11 |
-
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 12 |
-
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 13 |
-
11,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 14 |
-
12,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 16 |
-
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 17 |
-
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 18 |
-
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527)
|
| 19 |
-
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 22 |
-
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 23 |
-
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 24 |
-
22,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 25 |
-
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 26 |
-
24,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 27 |
-
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 28 |
-
26,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 29 |
-
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 30 |
-
28,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 31 |
-
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 32 |
-
30
|
| 33 |
-
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 34 |
-
32,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 35 |
-
33,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 36 |
-
34,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 37 |
-
35,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 38 |
-
36,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 39 |
-
37,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 40 |
-
38,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 41 |
-
39,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 42 |
-
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 43 |
-
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 44 |
-
42,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 45 |
-
43,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584)
|
| 46 |
-
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 47 |
-
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 48 |
-
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 49 |
-
47,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 50 |
-
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 51 |
-
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 52 |
-
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 53 |
-
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1657.0,+98/-71,5.749,0.803,7.38,2.99,442.09,6.381,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1568.0,+110/-63,6.02,0.681,10.55,3.6,1923.88,9.103,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1545.0,+101/-57,7.098,0.687,11.52,4.71,4.91,0.694,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1535.0,+101/-59,7.13,0.632,11.94,4.35,1923.88,1.329,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1515.0,+73/-65,9.038,0.555,12.85,5.23,1152.95,1.784,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1500.0,+53/-56,10.144,0.508,13.58,8.76,2775.44,8.849,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1475.0,+76/-57,10.795,0.463,14.8,7.23,2229.7,1.387,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1438.0,+55/-38,12.3,0.382,16.76,10.85,328.96,1.102,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1422.0,+72/-62,9.134,0.436,17.64,5.97,4982.66,358.753,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1416.0,+81/-59,11.711,0.371,17.95,8.6,2229.7,0.133,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1408.0,+61/-52,12.08,0.353,18.37,9.9,1055.6,0.482,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1403.0,+59/-53,12.174,0.353,18.64,9.24,1055.6,0.063,βοΈ,0.0,False,CPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1403.0,+56/-50,12.048,0.374,18.67,9.35,4.27,0.064,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1400.0,+52/-56,11.944,0.298,18.83,9.7,2775.44,0.415,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1385.0,+62/-53,13.208,0.314,19.7,11.17,472.99,0.621,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1384.0,+49/-31,13.159,0.268,19.73,13.42,328.96,0.126,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1380.0,+68/-68,14.06,0.371,19.99,9.43,250.36,1.708,β,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1367.0,+94/-94,12.88,0.374,20.73,8.42,3383.91,8.396,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1366.0,+58/-59,12.838,0.248,20.75,9.56,3383.91,0.51,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1355.0,+65/-58,10.825,0.301,21.39,7.03,4982.66,42.199,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1350.0,+49/-43,13.724,0.236,21.73,14.36,472.99,0.13,βοΈ,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1331.0,+58/-56,13.837,0.21,22.85,12.96,642.33,2.767,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1318.0,+49/-41,13.457,0.197,23.61,15.72,2241.65,2.415,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1312.0,+69/-65,14.413,0.259,23.95,12.93,8.72,0.126,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1311.0,+52/-48,15.332,0.18,24.03,15.4,1560.02,0.404,βοΈ,0.0,False,CPU
|
| 27 |
+
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1302.0,+47/-58,15.116,0.178,24.57,13.95,642.33,0.146,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1283.0,+64/-72,14.197,0.243,25.68,9.36,49.67,43.824,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1274.0,+51/-46,16.045,0.121,26.2,16.49,1560.02,0.052,βοΈ,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1267.0,+50/-42,15.891,0.15,26.62,13.82,13.5,0.311,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1267.0,+60/-64,15.482,0.152,26.62,16.59,559.38,4.08,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1265.0,+44/-44,14.803,0.11,26.75,17.68,9.33,1.116,βοΈ,0.0,False,GPU
|
| 33 |
+
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1248.0,+49/-52,17.1,0.123,27.77,17.29,4.98,0.049,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1231.0,+66/-56,16.365,0.117,28.74,18.33,1.24,0.11,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1226.0,+46/-39,15.668,0.077,29.08,19.82,2241.65,0.136,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1191.0,+57/-63,17.521,0.061,31.05,19.79,559.38,0.276,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1188.0,+51/-53,18.0,0.061,31.26,22.1,125.38,0.674,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1179.0,+49/-34,17.148,0.047,31.73,27.14,0.81,0.093,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1154.0,+51/-57,19.362,0.035,33.12,22.93,169.75,0.603,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1146.0,+50/-53,19.162,0.038,33.56,23.89,125.38,0.069,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1119.0,+43/-54,20.091,0.018,35.01,23.64,169.75,0.059,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1093.0,+65/-48,20.071,0.019,36.39,27.59,4.95,0.091,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1057.0,+64/-82,21.46,0.021,38.16,24.5,2.56,0.267,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1051.0,+84/-107,26.808,0.054,38.43,26.2,162.68,0.405,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1045.0,+109/-116,25.52,0.099,38.71,22.36,0.85,0.129,β,0.0,False,GPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1022.0,+61/-103,24.212,0.017,39.74,28.61,139.84,3.917,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1022.0,+91/-118,27.502,0.039,39.75,27.56,162.68,0.054,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+62/-79,24.287,0.013,40.7,33.84,0.25,0.029,βοΈ,0.0,False,CPU
|
| 49 |
+
47,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),983.0,+73/-101,26.581,0.026,41.38,33.73,2.8,0.564,βοΈ,0.0,False,GPU
|
| 50 |
+
48,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),959.0,+86/-119,29.448,0.024,42.33,30.48,0.84,0.094,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),955.0,+75/-92,25.759,0.01,42.47,36.5,0.2,0.037,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),915.0,+82/-136,29.325,0.0,43.91,31.65,139.84,0.193,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),602.0,+105/-199,43.863,0.0,50.36,46.66,0.15,0.023,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_all/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2071274
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ccd8f2c2d9058269966c9ba26269dc384f77ba122a369a0a275ecfa62c24acdf
|
| 3 |
size 2071274
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 419894
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37573f734e5396b487c7796eb775df4fbc8e00a9d50f06378ce92b8ae7ed5634
|
| 3 |
size 419894
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4a9b23b48d00a250039cfd2765632d6e5bb7cfe45d3bb6fd9de91cf1fd374183
|
| 3 |
+
size 932514
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 118425
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2249bd657be968fbaec47b182e32bd1eed209524c3c08f04c03eff4517edf112
|
| 3 |
size 118425
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/website_leaderboard.csv
CHANGED
|
@@ -1,54 +1,54 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 4 |
-
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 5 |
-
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 6 |
-
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 7 |
-
5,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 8 |
-
6,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 9 |
-
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 10 |
-
8,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 11 |
-
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 12 |
-
10,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 13 |
-
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 14 |
-
12,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 15 |
-
13,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 16 |
-
14,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 17 |
-
15,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 18 |
-
16,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 19 |
-
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564)
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 22 |
-
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 23 |
-
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 24 |
-
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 25 |
-
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 26 |
-
24,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 27 |
-
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 28 |
-
26,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 29 |
-
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 30 |
-
28,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527)
|
| 31 |
-
29,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 32 |
-
30
|
| 33 |
-
31,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 34 |
-
32,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 35 |
-
33,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 36 |
-
34,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 37 |
-
35,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 38 |
-
36,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 39 |
-
37,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 40 |
-
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 41 |
-
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 42 |
-
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 43 |
-
41,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 44 |
-
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 45 |
-
43,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 46 |
-
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 47 |
-
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 48 |
-
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 49 |
-
47,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 50 |
-
48,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 51 |
-
49,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584)
|
| 52 |
-
50,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 53 |
-
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 54 |
-
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1966.0,+155/-60,2.212,0.904,4.95,2.42,275.07,2.448,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1904.0,+176/-64,2.49,0.851,6.35,2.7,325.91,2.156,βοΈ,0.0,False,CPU
|
| 4 |
+
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1759.0,+141/-88,4.725,0.631,10.98,5.87,619.15,0.198,βοΈ,0.0,False,CPU
|
| 5 |
+
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1754.0,+144/-81,5.018,0.636,11.17,4.87,619.15,0.016,βοΈ,0.0,False,CPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1751.0,+113/-38,5.44,0.575,11.28,8.0,1633.8,2.053,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1736.0,+126/-79,4.763,0.63,11.87,5.47,2.21,0.025,βοΈ,0.0,False,CPU
|
| 8 |
+
6,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1718.0,+152/-92,7.508,0.545,12.6,6.95,110.13,0.386,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1701.0,+149/-83,7.923,0.524,13.3,8.51,86.85,0.668,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1681.0,+192/-136,7.27,0.513,14.19,5.59,804.65,0.71,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1679.0,+154/-138,6.907,0.544,14.26,7.1,2139.17,6.41,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1660.0,+210/-122,8.381,0.489,15.1,5.39,842.24,15.119,βοΈ,0.0,False,GPU
|
| 13 |
+
11,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1652.0,+124/-66,7.028,0.376,15.51,8.78,1633.8,0.088,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1640.0,+124/-80,8.376,0.421,16.04,11.5,110.13,0.061,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1625.0,+197/-156,7.978,0.458,16.73,6.29,804.65,0.063,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1610.0,+194/-117,9.033,0.419,17.44,6.83,842.24,1.465,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1582.0,+158/-128,8.63,0.416,18.81,7.95,2.3,0.896,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1580.0,+163/-89,9.74,0.323,18.95,12.1,86.85,0.078,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),1564.0,+170/-166,9.211,0.42,19.72,8.41,8.53,3.578,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1552.0,+126/-84,9.782,0.253,20.35,12.42,2139.17,0.349,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1536.0,+178/-158,9.019,0.347,21.12,7.53,4860.88,475.791,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1527.0,+95/-112,9.12,0.248,21.62,14.48,1156.69,1.558,βοΈ,0.0,False,CPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1490.0,+141/-106,10.678,0.196,23.53,15.19,572.82,1.935,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1478.0,+124/-111,12.87,0.174,24.2,17.96,270.2,0.192,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1461.0,+126/-146,10.861,0.228,25.07,13.69,0.49,0.053,βοΈ,0.0,False,CPU
|
| 26 |
+
24,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1454.0,+132/-118,12.698,0.163,25.44,19.32,572.82,0.109,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1453.0,+156/-178,10.49,0.241,25.48,14.6,5.5,0.074,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1431.0,+105/-129,11.432,0.123,26.67,20.62,371.59,2.386,βοΈ,0.0,False,CPU
|
| 29 |
+
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1430.0,+81/-65,10.923,0.077,26.75,23.68,6.41,0.247,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1417.0,+121/-138,13.96,0.136,27.44,20.16,96.61,0.754,β,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1404.0,+129/-107,13.997,0.091,28.11,24.03,270.2,0.015,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1380.0,+97/-126,11.531,0.069,29.38,23.47,1156.69,0.054,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1374.0,+134/-137,12.762,0.087,29.67,18.69,4860.88,42.641,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1361.0,+129/-110,15.831,0.05,30.35,26.41,1.07,0.018,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1343.0,+98/-137,12.461,0.069,31.22,28.09,0.29,0.033,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1319.0,+52/-59,14.148,0.002,32.42,30.58,42.95,0.226,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1314.0,+88/-85,13.953,0.008,32.69,29.68,8.34,0.25,βοΈ,0.0,False,GPU
|
| 38 |
+
36,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1284.0,+174/-186,17.019,0.035,34.12,20.85,47.03,45.876,βοΈ,0.0,False,GPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1280.0,+61/-90,13.457,0.0,34.32,32.02,40.36,0.318,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1279.0,+74/-74,15.128,0.005,34.35,30.6,42.95,0.021,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1278.0,+84/-119,15.031,0.036,34.41,29.27,371.59,0.102,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1224.0,+66/-92,15.173,0.0,36.86,35.23,1.86,0.046,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1218.0,+64/-73,15.174,0.0,37.12,35.45,40.36,0.028,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1206.0,+134/-218,18.046,0.042,37.63,32.31,1.52,0.115,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1162.0,+147/-233,24.034,0.009,39.45,35.34,43.64,0.085,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1140.0,+101/-190,20.729,0.011,40.28,31.54,513.06,78.02,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1112.0,+166/-225,25.027,0.005,41.35,38.03,43.64,0.022,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+88/-208,22.275,0.0,44.96,44.23,0.12,0.014,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),982.0,+135/-219,26.73,0.0,45.44,43.9,0.22,0.024,βοΈ,0.0,False,CPU
|
| 50 |
+
48,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),972.0,+202/-455,28.513,0.025,45.72,39.86,2.62,0.186,βοΈ,0.0,False,GPU
|
| 51 |
+
49,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),918.0,+91/-188,30.352,0.0,47.05,46.26,0.24,0.036,β,0.0,False,GPU
|
| 52 |
+
50,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),916.0,+100/-247,24.142,0.0,47.09,46.63,0.1,0.021,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),883.0,+76/-126,27.794,0.0,47.81,47.49,513.06,2.568,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),514.0,+107/-398,45.591,0.0,52.27,52.24,0.11,0.087,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_medium/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2102015
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:58c56a938a79e3e723918c17ab82e3c3d3b8ff9cc40b8406dc8b50fc9e44b474
|
| 3 |
size 2102015
|
data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 430099
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d40895726f44af8a1e29ac7e059ab41df14c611842441e5a9b78be9f3322053f
|
| 3 |
size 430099
|
data/imputation_no/splits_all/tasks_binary/datasets_small/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ab0ea4c367c7c476f7e280f5bf57a910fdc799f4cba65092cf45b083492ecbff
|
| 3 |
+
size 948765
|
data/imputation_no/splits_all/tasks_binary/datasets_small/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 124173
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f64abe4468182633e34180de1e59952ebdfea38b4510064e0d19100c01498bdc
|
| 3 |
size 124173
|
data/imputation_no/splits_all/tasks_binary/datasets_small/website_leaderboard.csv
CHANGED
|
@@ -1,53 +1,53 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 6 |
-
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 7 |
-
5,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 8 |
-
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 9 |
-
7,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 10 |
-
8,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527)
|
| 11 |
-
9,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 12 |
-
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 13 |
-
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 14 |
-
12,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 16 |
-
14,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 17 |
-
15,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 18 |
-
16,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 19 |
-
17,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 20 |
-
18,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 21 |
-
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 22 |
-
20,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 23 |
-
21,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 24 |
-
22,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 25 |
-
23,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 26 |
-
24,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 27 |
-
25,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 28 |
-
26,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 29 |
-
27,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 30 |
-
28,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 31 |
-
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 32 |
-
30,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 33 |
-
31,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 34 |
-
32,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 35 |
-
33,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 36 |
-
34,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 37 |
-
35,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 38 |
-
36,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 39 |
-
37,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 40 |
-
38,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 41 |
-
39,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584)
|
| 42 |
-
40,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 43 |
-
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 44 |
-
42,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 45 |
-
43,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 46 |
-
44,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 47 |
-
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 48 |
-
46,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 49 |
-
47,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 50 |
-
48,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 51 |
-
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 52 |
-
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 53 |
-
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1582.0,+110/-77,7.287,0.748,8.48,3.33,593.57,8.084,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1579.0,+98/-56,6.466,0.789,8.57,4.04,5.96,0.554,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1574.0,+142/-69,5.03,0.753,8.74,3.16,2052.28,8.252,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1547.0,+128/-57,6.337,0.713,9.74,3.78,2052.28,1.266,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1435.0,+81/-50,12.183,0.471,14.72,9.21,2950.72,15.595,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1425.0,+85/-56,12.33,0.434,15.23,8.35,2457.54,1.658,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1415.0,+90/-69,11.866,0.417,15.75,8.92,1921.63,1.718,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1402.0,+82/-72,9.204,0.465,16.4,5.52,5351.68,268.579,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1390.0,+81/-66,14.126,0.467,17.07,7.72,317.91,1.983,β,0.0,False,GPU
|
| 11 |
+
9,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1370.0,+83/-73,10.014,0.385,18.2,5.58,5351.68,37.621,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1366.0,+49/-38,14.198,0.31,18.4,12.57,512.57,1.18,βοΈ,0.0,False,CPU
|
| 13 |
+
11,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1361.0,+85/-59,13.333,0.327,18.67,10.34,2457.54,0.178,βοΈ,0.0,False,GPU
|
| 14 |
+
12,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1333.0,+44/-34,14.644,0.237,20.3,14.26,512.57,0.243,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1330.0,+80/-60,14.072,0.259,20.46,10.21,2950.72,1.225,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1319.0,+88/-68,14.168,0.243,21.12,8.79,4806.04,0.512,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1310.0,+52/-43,15.257,0.224,21.68,14.73,1096.5,0.584,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1309.0,+64/-47,15.195,0.253,21.73,13.86,4.81,0.08,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1305.0,+53/-43,15.264,0.222,21.97,15.14,1096.5,0.074,βοΈ,0.0,False,CPU
|
| 20 |
+
18,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1297.0,+88/-76,13.006,0.324,22.45,7.6,51.83,43.615,βοΈ,0.0,False,GPU
|
| 21 |
+
19,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1290.0,+51/-68,15.211,0.214,22.82,12.25,711.84,2.983,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1289.0,+47/-43,15.673,0.203,22.93,15.54,693.49,1.398,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1278.0,+68/-61,16.117,0.262,23.55,12.39,10.08,0.152,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1276.0,+114/-107,15.466,0.292,23.67,9.47,4806.04,8.461,βοΈ,0.0,False,GPU
|
| 25 |
+
23,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1267.0,+48/-48,16.409,0.176,24.26,14.62,1634.54,0.422,βοΈ,0.0,False,CPU
|
| 26 |
+
24,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1265.0,+62/-65,16.741,0.21,24.38,11.3,14.37,0.334,βοΈ,0.0,False,GPU
|
| 27 |
+
25,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1264.0,+42/-33,16.038,0.149,24.39,16.25,693.49,0.194,βοΈ,0.0,False,CPU
|
| 28 |
+
26,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1263.0,+53/-61,16.17,0.182,24.48,12.54,711.84,0.162,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1259.0,+81/-56,15.336,0.167,24.72,16.57,2665.36,2.619,βοΈ,0.0,False,CPU
|
| 30 |
+
28,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1243.0,+49/-50,16.945,0.134,25.68,14.64,1634.54,0.054,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1224.0,+62/-72,17.235,0.163,26.88,15.4,644.55,5.974,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1222.0,+52/-53,17.663,0.153,26.97,15.18,7.32,0.054,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1221.0,+56/-50,16.483,0.123,27.02,16.05,10.89,2.249,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1185.0,+72/-49,17.457,0.08,29.23,18.73,2665.36,0.143,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1174.0,+64/-77,18.602,0.071,29.9,17.46,644.55,0.398,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1167.0,+63/-83,19.966,0.087,30.28,19.64,203.15,0.968,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1162.0,+61/-59,18.743,0.058,30.6,22.99,1.94,0.121,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1132.0,+45/-51,19.177,0.033,32.32,27.15,2.44,0.121,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1131.0,+59/-76,20.887,0.054,32.38,21.08,203.15,0.091,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1107.0,+54/-85,21.614,0.049,33.76,20.87,484.22,1.025,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1074.0,+108/-127,23.463,0.142,35.56,18.38,1.3,0.15,β,0.0,False,GPU
|
| 42 |
+
40,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1073.0,+51/-82,22.235,0.024,35.64,21.78,484.22,0.086,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1056.0,+61/-76,22.185,0.028,36.52,25.42,9.39,0.13,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1021.0,+89/-132,28.012,0.073,38.3,23.69,278.97,0.873,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1012.0,+76/-85,22.938,0.012,38.71,22.33,2.97,0.388,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+58/-111,25.166,0.018,39.3,30.97,0.42,0.041,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),998.0,+96/-137,28.578,0.053,39.38,24.75,278.97,0.103,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),988.0,+75/-112,25.72,0.019,39.87,27.69,90.71,1.623,βοΈ,0.0,False,CPU
|
| 49 |
+
47,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),986.0,+81/-105,25.768,0.027,39.92,31.85,3.71,0.919,βοΈ,0.0,False,GPU
|
| 50 |
+
48,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),964.0,+79/-130,26.469,0.015,40.92,33.63,0.33,0.043,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),952.0,+88/-162,30.627,0.034,41.4,27.1,1.48,0.139,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),921.0,+80/-144,29.993,0.001,42.66,27.85,90.71,0.125,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),616.0,+109/-176,43.126,0.0,49.97,44.93,0.22,0.02,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_small/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2084457
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e57ff1a51e7be9c3d7151b16069c74a1f7f9e3f496c85bae2adec08d1e77971
|
| 3 |
size 2084457
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 483576
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fc63af627d7d502e12dd05fc5f18682e1b650cb18c1e0bb177b285928b9554b3
|
| 3 |
size 483576
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b8727986cd9b18c958c81b0a916b643bec00333f9951d32fa6a0f2dd174260bc
|
| 3 |
+
size 1037072
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 131179
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81d0e1e01312078f508feaa69219e0a44ff430aa9dc161d2f04a568393e1a8a2
|
| 3 |
size 131179
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/website_leaderboard.csv
CHANGED
|
@@ -1,59 +1,59 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 4 |
-
2,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 6 |
-
4
|
| 7 |
-
5,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6)
|
| 8 |
-
6
|
| 9 |
-
7,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564)
|
| 10 |
-
8,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 11 |
-
9,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 12 |
-
10,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527)
|
| 13 |
-
11,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 14 |
-
12,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 15 |
-
13,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6)
|
| 16 |
-
14,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 17 |
-
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 18 |
-
16,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 19 |
-
17,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6)
|
| 20 |
-
18,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 21 |
-
19,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 22 |
-
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 23 |
-
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 24 |
-
22,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 25 |
-
23,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 26 |
-
24,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 27 |
-
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 28 |
-
26,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 29 |
-
27,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 30 |
-
28,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 31 |
-
29,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 32 |
-
30,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 33 |
-
31,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 34 |
-
32,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 35 |
-
33,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 36 |
-
34,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 37 |
-
35,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 38 |
-
36,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 39 |
-
37,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 40 |
-
38,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 41 |
-
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 42 |
-
40,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 43 |
-
41,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 44 |
-
42,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 45 |
-
43,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 46 |
-
44,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584)
|
| 47 |
-
45,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 48 |
-
46,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 49 |
-
47,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 50 |
-
48,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 51 |
-
49,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 52 |
-
50,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 53 |
-
51,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 54 |
-
52,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 55 |
-
53,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 56 |
-
54,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 57 |
-
55,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 58 |
-
56,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 59 |
-
57,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1600.0,+91/-54,7.184,0.729,10.36,5.33,5.52,0.529,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1588.0,+113/-69,5.826,0.685,10.87,4.46,2046.25,8.114,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1584.0,+88/-56,8.183,0.662,11.04,4.67,592.15,8.082,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1569.0,+104/-64,7.089,0.657,11.74,4.79,2046.25,1.254,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π§ β‘,Foundation Model,[Mitra (default)](https://arxiv.org/abs/2510.21204),1510.0,+92/-60,10.733,0.585,14.67,5.88,144.27,3.772,βοΈ,0.0,False,GPU
|
| 7 |
+
5,π§ β‘,Foundation Model,[TabPFNv2 (tuned + ensembled)](https://www.nature.com/articles/s41586-024-08328-6),1497.0,+79/-54,10.68,0.512,15.33,6.23,3445.6,51.274,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ β‘,Foundation Model,[LimiX (default)](https://arxiv.org/abs/2509.03505),1486.0,+98/-79,11.297,0.565,15.96,5.68,3.76,0.527,β,0.0,False,GPU
|
| 9 |
+
7,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),1479.0,+79/-67,10.213,0.493,16.35,5.93,8.06,1.714,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1442.0,+65/-50,13.145,0.385,18.49,11.6,2879.46,14.626,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1438.0,+75/-59,13.186,0.362,18.78,9.99,2379.18,1.595,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1430.0,+69/-59,14.423,0.406,19.25,9.32,316.0,1.931,β,0.0,False,GPU
|
| 13 |
+
11,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1419.0,+76/-58,12.9,0.339,19.93,11.82,1828.68,1.648,βοΈ,0.0,False,CPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1419.0,+84/-68,10.011,0.391,19.94,6.64,5319.2,249.314,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ β‘,Foundation Model,[TabPFNv2 (tuned)](https://www.nature.com/articles/s41586-024-08328-6),1415.0,+108/-75,13.416,0.407,20.2,6.42,3445.6,0.995,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1399.0,+104/-71,10.637,0.361,21.18,6.68,5319.2,29.488,βοΈ,0.0,False,GPU
|
| 17 |
+
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1381.0,+86/-58,14.163,0.273,22.36,12.32,2379.18,0.176,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1376.0,+45/-44,15.222,0.233,22.67,15.32,449.53,1.149,βοΈ,0.0,False,CPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabPFNv2 (default)](https://www.nature.com/articles/s41586-024-08328-6),1372.0,+96/-85,15.503,0.405,22.91,8.63,3.73,0.488,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1352.0,+65/-52,14.896,0.22,24.25,12.67,2879.46,0.944,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1347.0,+63/-58,14.824,0.225,24.59,10.35,4575.49,0.51,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1347.0,+38/-37,15.649,0.17,24.6,17.27,449.53,0.215,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1326.0,+105/-79,13.65,0.303,25.96,8.98,51.44,43.709,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1326.0,+61/-49,16.157,0.189,25.97,16.69,4.7,0.08,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1323.0,+56/-53,16.287,0.151,26.23,17.99,1081.93,0.556,βοΈ,0.0,False,CPU
|
| 26 |
+
24,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1316.0,+56/-45,16.312,0.159,26.64,19.09,1081.93,0.074,βοΈ,0.0,False,CPU
|
| 27 |
+
25,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1308.0,+67/-67,16.789,0.219,27.19,14.07,9.81,0.146,βοΈ,0.0,False,GPU
|
| 28 |
+
26,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1302.0,+53/-58,16.244,0.162,27.58,15.63,592.34,2.767,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1298.0,+52/-52,16.778,0.138,27.86,19.56,645.57,1.032,βοΈ,0.0,False,CPU
|
| 30 |
+
28,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1295.0,+66/-71,17.352,0.174,28.07,13.53,14.36,0.311,βοΈ,0.0,False,GPU
|
| 31 |
+
29,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1292.0,+50/-50,17.207,0.129,28.32,17.46,1618.46,0.415,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1290.0,+97/-103,16.484,0.254,28.39,11.16,4575.49,8.396,βοΈ,0.0,False,GPU
|
| 33 |
+
31,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1286.0,+69/-58,15.992,0.14,28.68,19.64,2576.18,2.415,βοΈ,0.0,False,CPU
|
| 34 |
+
32,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1280.0,+54/-58,17.188,0.127,29.14,15.16,592.34,0.146,βοΈ,0.0,False,GPU
|
| 35 |
+
33,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1275.0,+42/-42,17.137,0.084,29.47,19.6,645.57,0.172,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1271.0,+52/-55,17.71,0.1,29.74,16.79,1618.46,0.054,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1254.0,+54/-58,18.247,0.115,30.88,16.81,6.86,0.052,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1253.0,+67/-78,17.887,0.143,30.93,17.0,618.9,5.468,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1250.0,+55/-56,17.097,0.088,31.15,18.15,10.47,1.987,βοΈ,0.0,False,GPU
|
| 40 |
+
38,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1213.0,+63/-50,17.997,0.062,33.59,21.56,2576.18,0.136,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1206.0,+67/-74,19.212,0.058,34.09,19.4,618.9,0.352,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1183.0,+84/-72,21.088,0.067,35.56,23.19,199.83,0.865,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1172.0,+64/-60,19.888,0.025,36.23,29.08,1.77,0.119,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1150.0,+78/-78,21.933,0.04,37.6,25.09,199.83,0.086,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1144.0,+40/-43,20.296,0.018,38.0,32.13,2.2,0.12,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1110.0,+95/-131,23.531,0.115,40.03,21.41,1.24,0.143,β,0.0,False,GPU
|
| 47 |
+
45,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1108.0,+65/-85,22.968,0.02,40.14,26.17,440.56,0.933,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1086.0,+75/-74,22.66,0.018,41.44,29.26,8.39,0.127,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1078.0,+52/-79,23.518,0.004,41.88,24.91,440.56,0.085,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1057.0,+98/-123,28.113,0.071,43.04,26.02,273.27,0.715,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1043.0,+78/-87,23.546,0.0,43.76,24.97,2.84,0.381,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1034.0,+94/-126,28.584,0.047,44.19,27.79,273.27,0.098,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1020.0,+83/-108,26.329,0.02,44.93,30.67,89.68,1.55,βοΈ,0.0,False,CPU
|
| 54 |
+
52,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1002.0,+98/-112,26.937,0.011,45.79,36.55,2.96,0.796,βοΈ,0.0,False,GPU
|
| 55 |
+
53,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+63/-105,26.578,0.003,45.87,37.86,0.42,0.04,βοΈ,0.0,False,CPU
|
| 56 |
+
54,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),989.0,+102/-139,30.404,0.03,46.39,30.04,1.44,0.138,βοΈ,0.0,False,CPU
|
| 57 |
+
55,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),976.0,+93/-114,27.729,0.012,46.96,38.72,0.31,0.042,βοΈ,0.0,False,CPU
|
| 58 |
+
56,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),953.0,+86/-138,30.595,0.001,47.95,30.7,89.68,0.12,βοΈ,0.0,False,CPU
|
| 59 |
+
57,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),639.0,+130/-215,43.912,0.0,55.9,49.79,0.21,0.019,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_binary/datasets_tabpfn/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2690375
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72ab1298a6f3165d254d76a2c5aa9e6ea2499200355cb437bfdcf786928aa9d8
|
| 3 |
size 2690375
|
data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 439786
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6bd7e126d5b12ad8d2b6f45ebf02c1452f74196f161c38c111ba598254da30cb
|
| 3 |
size 439786
|
data/imputation_no/splits_all/tasks_classification/datasets_all/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e55ea134c309bccc8dcd6084b333f316ab1c52773176fb266c6c7cb5e741b316
|
| 3 |
+
size 954824
|
data/imputation_no/splits_all/tasks_classification/datasets_all/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 113343
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7cdd342b55a7bf109dbe983c9c4f7bcc6c822faea1908ad566d313d241d44775
|
| 3 |
size 113343
|
data/imputation_no/splits_all/tasks_classification/datasets_all/website_leaderboard.csv
CHANGED
|
@@ -1,53 +1,53 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 4 |
-
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 5 |
-
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 6 |
-
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 7 |
-
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 8 |
-
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 9 |
-
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 10 |
-
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 11 |
-
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 12 |
-
10,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 13 |
-
11,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 14 |
-
12,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 15 |
-
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 16 |
-
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 17 |
-
15,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 18 |
-
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527)
|
| 19 |
-
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 21 |
-
19,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 22 |
-
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 23 |
-
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 24 |
-
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 25 |
-
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 26 |
-
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 27 |
-
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 28 |
-
26,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 29 |
-
27,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 30 |
-
28,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 31 |
-
29,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 32 |
-
30,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 33 |
-
31,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 34 |
-
32,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 35 |
-
33,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 36 |
-
34,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 37 |
-
35,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 38 |
-
36,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 39 |
-
37,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 40 |
-
38,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 41 |
-
39,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 42 |
-
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 43 |
-
41,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 44 |
-
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 45 |
-
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 46 |
-
44,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584)
|
| 47 |
-
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 48 |
-
46,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 49 |
-
47,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 50 |
-
48,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 51 |
-
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 52 |
-
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 53 |
-
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1673.0,+76/-63,6.447,0.809,7.05,3.08,545.23,6.469,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1593.0,+81/-76,5.921,0.709,9.74,3.16,2046.25,8.976,βοΈ,0.0,False,GPU
|
| 4 |
+
2,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1566.0,+79/-70,6.967,0.671,10.79,3.98,2046.25,1.329,βοΈ,0.0,False,GPU
|
| 5 |
+
3,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1550.0,+72/-69,7.392,0.683,11.47,4.59,5.76,0.794,βοΈ,0.0,False,GPU
|
| 6 |
+
4,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1516.0,+78/-58,10.128,0.533,13.01,5.2,1684.49,1.97,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1500.0,+62/-54,10.684,0.508,13.74,8.2,2879.46,12.49,βοΈ,0.0,False,GPU
|
| 8 |
+
6,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1472.0,+76/-48,12.019,0.449,15.12,7.64,2466.21,1.502,βοΈ,0.0,False,GPU
|
| 9 |
+
7,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1440.0,+48/-36,13.132,0.374,16.81,11.12,382.05,1.488,βοΈ,0.0,False,CPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1421.0,+77/-56,11.076,0.428,17.83,6.22,4940.61,307.751,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1417.0,+73/-58,12.922,0.367,18.06,8.85,2466.21,0.176,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1416.0,+58/-47,12.344,0.328,18.11,9.33,2879.46,0.598,βοΈ,0.0,False,GPU
|
| 13 |
+
11,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1415.0,+54/-46,12.625,0.349,18.15,10.54,1372.94,0.556,βοΈ,0.0,False,CPU
|
| 14 |
+
12,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1406.0,+58/-44,12.832,0.338,18.65,10.04,1372.94,0.074,βοΈ,0.0,False,CPU
|
| 15 |
+
13,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1396.0,+41/-34,13.856,0.279,19.26,13.36,382.05,0.254,βοΈ,0.0,False,CPU
|
| 16 |
+
14,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1386.0,+53/-47,13.978,0.305,19.81,11.85,685.87,1.455,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1383.0,+50/-46,13.472,0.325,19.97,10.59,5.72,0.076,βοΈ,0.0,False,CPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1376.0,+57/-54,15.277,0.354,20.4,10.32,282.72,1.886,β,0.0,False,GPU
|
| 19 |
+
17,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1371.0,+89/-82,13.51,0.345,20.64,9.1,4879.89,8.744,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1370.0,+60/-41,13.555,0.238,20.74,9.81,4879.89,0.525,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1359.0,+47/-44,14.358,0.245,21.35,14.58,685.87,0.205,βοΈ,0.0,False,CPU
|
| 22 |
+
20,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1358.0,+67/-58,12.802,0.307,21.4,7.33,4940.61,41.606,βοΈ,0.0,False,GPU
|
| 23 |
+
21,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1337.0,+44/-45,14.984,0.226,22.61,13.17,934.1,3.063,βοΈ,0.0,False,GPU
|
| 24 |
+
22,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1318.0,+43/-36,16.035,0.183,23.73,15.62,2686.11,0.47,βοΈ,0.0,False,CPU
|
| 25 |
+
23,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1315.0,+61/-54,15.709,0.254,23.93,13.32,10.21,0.138,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1314.0,+45/-43,14.908,0.184,23.95,16.27,2389.22,2.158,βοΈ,0.0,False,CPU
|
| 27 |
+
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1294.0,+51/-54,16.495,0.175,25.17,14.33,934.1,0.169,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1280.0,+45/-38,16.759,0.126,25.99,16.88,2686.11,0.054,βοΈ,0.0,False,CPU
|
| 29 |
+
27,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1277.0,+67/-64,16.109,0.238,26.17,9.08,49.21,43.824,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1266.0,+61/-60,17.277,0.169,26.82,15.31,618.9,4.766,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1252.0,+44/-46,17.998,0.128,27.62,18.04,6.86,0.057,βοΈ,0.0,False,CPU
|
| 32 |
+
30,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1252.0,+46/-45,17.837,0.125,27.62,15.26,14.78,0.346,βοΈ,0.0,False,GPU
|
| 33 |
+
31,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1243.0,+40/-37,17.108,0.087,28.19,19.4,10.47,1.707,βοΈ,0.0,False,GPU
|
| 34 |
+
32,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1232.0,+48/-52,17.195,0.106,28.81,19.48,1.77,0.117,βοΈ,0.0,False,CPU
|
| 35 |
+
33,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1228.0,+47/-37,17.147,0.081,29.06,20.0,2389.22,0.152,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1214.0,+52/-52,18.724,0.1,29.84,19.19,189.76,0.743,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1195.0,+53/-59,19.123,0.074,30.91,19.12,618.9,0.298,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1188.0,+64/-57,19.635,0.09,31.32,18.57,323.74,0.743,βοΈ,0.0,False,CPU
|
| 39 |
+
37,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1188.0,+48/-38,18.263,0.065,31.32,26.28,1.79,0.12,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1172.0,+54/-54,19.957,0.073,32.24,19.76,189.76,0.079,βοΈ,0.0,False,CPU
|
| 41 |
+
39,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1150.0,+60/-56,20.504,0.062,33.44,18.14,323.74,0.076,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1085.0,+45/-56,21.856,0.015,36.8,28.14,6.83,0.147,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1041.0,+86/-88,29.56,0.043,38.9,28.09,252.58,0.528,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1038.0,+63/-67,24.207,0.017,39.03,26.67,2.91,0.368,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1019.0,+67/-93,27.374,0.02,39.87,26.93,139.84,3.615,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),1013.0,+86/-103,28.483,0.079,40.12,25.02,1.11,0.189,β,0.0,False,GPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1010.0,+87/-92,30.319,0.031,40.23,29.46,252.58,0.089,βοΈ,0.0,False,CPU
|
| 48 |
+
46,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),1005.0,+73/-85,27.121,0.032,40.44,33.02,3.61,0.939,βοΈ,0.0,False,GPU
|
| 49 |
+
47,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+58/-63,26.637,0.01,40.67,34.46,0.38,0.037,βοΈ,0.0,False,CPU
|
| 50 |
+
48,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),947.0,+68/-72,28.882,0.008,42.72,37.34,0.25,0.041,βοΈ,0.0,False,CPU
|
| 51 |
+
49,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),927.0,+94/-111,33.16,0.019,43.43,32.94,1.29,0.131,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),900.0,+84/-117,33.585,0.004,44.32,32.53,139.84,0.193,βοΈ,0.0,False,CPU
|
| 53 |
+
51,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),563.0,+111/-112,49.469,0.0,50.66,47.64,0.18,0.029,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_classification/datasets_all/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2041622
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:597cf8a2debe07fef7194817772d424e9b90a8e5f88e729d87c6341999c84549
|
| 3 |
size 2041622
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_front_improvability_vs_time_infer.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 420152
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3de46251d70777fedf2009f664158f3a1cd46dacd611adc6a93e81b90ea28f65
|
| 3 |
size 420152
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/pareto_n_configs_imp.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1c48c1cc97b1dfd4312245ceb7067e74666b06c9186291e43ecc8d89924f64f4
|
| 3 |
+
size 948975
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/tuning-impact-elo.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 118664
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5be0ed1ffd3ea931c4655b13af19386480aeb6e9d5856f5840543c4b489bb95a
|
| 3 |
size 118664
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/website_leaderboard.csv
CHANGED
|
@@ -1,54 +1,54 @@
|
|
| 1 |
-
#,Type,TypeName,Model,
|
| 2 |
-
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 3 |
-
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)"
|
| 4 |
-
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516)
|
| 5 |
-
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516)
|
| 6 |
-
4,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516)
|
| 7 |
-
5,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754)
|
| 8 |
-
6,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 9 |
-
7,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491)
|
| 10 |
-
8,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667)
|
| 11 |
-
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257)
|
| 12 |
-
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210)
|
| 13 |
-
11,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754)
|
| 14 |
-
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667)
|
| 15 |
-
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491)
|
| 16 |
-
14,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 17 |
-
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210)
|
| 18 |
-
16,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667)
|
| 19 |
-
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564)
|
| 20 |
-
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257)
|
| 21 |
-
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164)
|
| 22 |
-
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 23 |
-
21,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 24 |
-
22,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754)
|
| 25 |
-
23,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053)
|
| 26 |
-
24,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 27 |
-
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053)
|
| 28 |
-
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210)
|
| 29 |
-
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491)
|
| 30 |
-
28,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505)
|
| 31 |
-
29,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527)
|
| 32 |
-
30,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 33 |
-
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf)
|
| 34 |
-
32,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164)
|
| 35 |
-
33,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 36 |
-
34,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html)
|
| 37 |
-
35,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 38 |
-
36,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257)
|
| 39 |
-
37,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 40 |
-
38,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164)
|
| 41 |
-
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505)
|
| 42 |
-
40,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 43 |
-
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 44 |
-
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505)
|
| 45 |
-
43,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 46 |
-
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 47 |
-
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 48 |
-
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324)
|
| 49 |
-
47,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html)
|
| 50 |
-
48,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053)
|
| 51 |
-
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1)
|
| 52 |
-
50,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584)
|
| 53 |
-
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html)
|
| 54 |
-
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html)
|
|
|
|
| 1 |
+
#,Type,TypeName,Model,Elo [β¬οΈ],Elo 95% CI,Improvability (%) [β¬οΈ],Score [β¬οΈ],Rank [β¬οΈ],Harmonic Rank [β¬οΈ],Median Train Time (s/1K) [β¬οΈ],Median Predict Time (s/1K) [β¬οΈ],Verified,Imputed (%) [β¬οΈ],Imputed,Hardware
|
| 2 |
+
0,π,Reference Pipeline,"[AutoGluon 1.4 (extreme, 4h)](https://arxiv.org/abs/2003.06505)",1929.0,+143/-60,2.178,0.907,4.76,2.46,275.97,2.818,βοΈ,0.0,False,GPU
|
| 3 |
+
1,π,Reference Pipeline,"[AutoGluon 1.4 (best, 4h)](https://arxiv.org/abs/2003.06505)",1873.0,+172/-66,2.411,0.859,5.97,2.64,314.17,2.249,βοΈ,0.0,False,CPU
|
| 4 |
+
2,π³,Tree-based,[CatBoost (tuned + ensembled)](https://arxiv.org/abs/1706.09516),1707.0,+129/-66,5.406,0.618,11.18,6.2,697.8,0.199,βοΈ,0.0,False,CPU
|
| 5 |
+
3,π³,Tree-based,[CatBoost (tuned)](https://arxiv.org/abs/1706.09516),1705.0,+141/-72,5.651,0.623,11.24,5.16,697.8,0.023,βοΈ,0.0,False,CPU
|
| 6 |
+
4,π³,Tree-based,[CatBoost (default)](https://arxiv.org/abs/1706.09516),1676.0,+124/-64,5.593,0.609,12.42,5.87,2.44,0.027,βοΈ,0.0,False,CPU
|
| 7 |
+
5,π³,Tree-based,[XGBoost (tuned + ensembled)](https://arxiv.org/abs/1603.02754),1673.0,+138/-96,7.874,0.542,12.54,7.25,207.65,0.398,βοΈ,0.0,False,CPU
|
| 8 |
+
6,π³,Tree-based,[LightGBM (tuned + ensembled)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1669.0,+144/-74,8.132,0.529,12.7,8.34,93.21,0.758,βοΈ,0.0,False,CPU
|
| 9 |
+
7,π§ π,Neural Network,[RealMLP (tuned + ensembled)](https://arxiv.org/abs/2407.04491),1651.0,+120/-91,7.253,0.517,13.46,8.65,1624.54,1.763,βοΈ,0.0,False,GPU
|
| 10 |
+
8,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned + ensembled)](https://arxiv.org/abs/2511.08667),1646.0,+218/-129,7.545,0.54,13.7,3.82,783.29,13.79,βοΈ,0.0,False,GPU
|
| 11 |
+
9,π§ π,Neural Network,[ModernNCA (tuned + ensembled)](https://arxiv.org/abs/2407.03257),1626.0,+148/-132,7.556,0.53,14.59,7.55,2338.19,14.248,βοΈ,0.0,False,GPU
|
| 12 |
+
10,π§ π,Neural Network,[TabM (tuned + ensembled)](https://arxiv.org/abs/2410.24210),1604.0,+180/-118,8.633,0.462,15.6,6.08,1398.9,0.645,βοΈ,0.0,False,GPU
|
| 13 |
+
11,π³,Tree-based,[XGBoost (tuned)](https://arxiv.org/abs/1603.02754),1599.0,+111/-77,8.689,0.429,15.82,11.69,207.65,0.056,βοΈ,0.0,False,CPU
|
| 14 |
+
12,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (tuned)](https://arxiv.org/abs/2511.08667),1594.0,+205/-121,8.372,0.468,16.03,6.06,783.29,1.924,βοΈ,0.0,False,GPU
|
| 15 |
+
13,π§ π,Neural Network,[RealMLP (tuned)](https://arxiv.org/abs/2407.04491),1567.0,+129/-90,8.727,0.338,17.34,9.49,1624.54,0.083,βοΈ,0.0,False,GPU
|
| 16 |
+
14,π³,Tree-based,[LightGBM (tuned)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1554.0,+167/-78,9.811,0.346,17.97,11.64,93.21,0.087,βοΈ,0.0,False,CPU
|
| 17 |
+
15,π§ π,Neural Network,[TabM (tuned)](https://arxiv.org/abs/2410.24210),1554.0,+190/-148,9.345,0.412,17.98,6.83,1398.9,0.062,βοΈ,0.0,False,GPU
|
| 18 |
+
16,π§ β‘,Foundation Model,[RealTabPFN-v2.5 (default)](https://arxiv.org/abs/2511.08667),1541.0,+154/-119,9.121,0.414,18.63,8.37,2.3,0.82,βοΈ,0.0,False,GPU
|
| 19 |
+
17,π§ β‘,Foundation Model,[TabICL (default)](https://arxiv.org/abs/2502.05564),1518.0,+166/-148,9.743,0.413,19.76,8.93,7.51,3.146,βοΈ,0.0,False,GPU
|
| 20 |
+
18,π§ π,Neural Network,[ModernNCA (tuned)](https://arxiv.org/abs/2407.03257),1508.0,+114/-82,10.245,0.263,20.28,12.89,2338.19,0.54,βοΈ,0.0,False,GPU
|
| 21 |
+
19,π§ β‘,Foundation Model,[TabDPT (tuned + ensembled)](https://arxiv.org/abs/2410.18164),1486.0,+156/-141,9.963,0.326,21.43,8.09,4805.66,461.797,βοΈ,0.0,False,GPU
|
| 22 |
+
20,π§ π,Neural Network,[TorchMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1476.0,+89/-75,10.081,0.234,21.91,15.1,1169.3,1.442,βοΈ,0.0,False,CPU
|
| 23 |
+
21,π³,Tree-based,[EBM (tuned + ensembled)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1466.0,+146/-106,12.538,0.216,22.47,15.25,893.93,0.205,βοΈ,0.0,False,CPU
|
| 24 |
+
22,π³,Tree-based,[XGBoost (default)](https://arxiv.org/abs/1603.02754),1438.0,+156/-129,10.925,0.255,23.92,13.66,0.47,0.052,βοΈ,0.0,False,CPU
|
| 25 |
+
23,β,Other,[xRFM (tuned + ensembled)](https://arxiv.org/abs/2508.10053),1422.0,+131/-134,12.437,0.177,24.79,16.12,709.85,2.929,βοΈ,0.0,False,GPU
|
| 26 |
+
24,π³,Tree-based,[EBM (tuned)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1398.0,+160/-107,13.588,0.139,26.12,19.84,893.93,0.016,βοΈ,0.0,False,CPU
|
| 27 |
+
25,β,Other,[xRFM (tuned)](https://arxiv.org/abs/2508.10053),1388.0,+130/-132,14.508,0.146,26.66,20.31,709.85,0.19,βοΈ,0.0,False,GPU
|
| 28 |
+
26,π§ π,Neural Network,[TabM (default)](https://arxiv.org/abs/2410.24210),1385.0,+149/-155,12.673,0.217,26.8,15.57,5.67,0.081,βοΈ,0.0,False,GPU
|
| 29 |
+
27,π§ π,Neural Network,[RealMLP (default)](https://arxiv.org/abs/2407.04491),1359.0,+84/-82,13.533,0.069,28.18,24.73,6.98,0.233,βοΈ,0.0,False,GPU
|
| 30 |
+
28,π§ π,Neural Network,[FastaiMLP (tuned + ensembled)](https://arxiv.org/abs/2003.06505),1357.0,+96/-140,14.453,0.11,28.29,21.75,389.62,2.114,βοΈ,0.0,False,CPU
|
| 31 |
+
29,π§ β‘,Foundation Model,[BetaTabPFN (default)](https://arxiv.org/abs/2502.02527),1350.0,+138/-132,15.914,0.122,28.69,21.21,84.36,0.919,β,0.0,False,GPU
|
| 32 |
+
30,π§ π,Neural Network,[TorchMLP (tuned)](https://arxiv.org/abs/2003.06505),1345.0,+81/-84,12.262,0.073,28.91,23.58,1169.3,0.053,βοΈ,0.0,False,CPU
|
| 33 |
+
31,π³,Tree-based,[EBM (default)](https://www.cs.cornell.edu/~yinlou/papers/lou-kdd13.pdf),1342.0,+125/-102,15.622,0.084,29.11,25.2,2.09,0.019,βοΈ,0.0,False,CPU
|
| 34 |
+
32,π§ β‘,Foundation Model,[TabDPT (tuned)](https://arxiv.org/abs/2410.18164),1329.0,+117/-121,13.696,0.078,29.75,19.44,4805.66,43.211,βοΈ,0.0,False,GPU
|
| 35 |
+
33,π³,Tree-based,[RandomForest (tuned + ensembled)](https://link.springer.com/article/10.1023/A:1010933404324),1327.0,+118/-103,13.691,0.062,29.86,22.08,52.45,0.219,βοΈ,0.0,False,CPU
|
| 36 |
+
34,π³,Tree-based,[LightGBM (default)](https://papers.nips.cc/paper_files/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html),1294.0,+94/-111,13.707,0.062,31.52,28.6,0.28,0.033,βοΈ,0.0,False,CPU
|
| 37 |
+
35,π³,Tree-based,[RandomForest (tuned)](https://link.springer.com/article/10.1023/A:1010933404324),1289.0,+127/-116,14.607,0.063,31.78,23.78,52.45,0.021,βοΈ,0.0,False,CPU
|
| 38 |
+
36,π§ π,Neural Network,[ModernNCA (default)](https://arxiv.org/abs/2407.03257),1281.0,+79/-74,14.625,0.007,32.17,29.44,10.5,0.606,βοΈ,0.0,False,GPU
|
| 39 |
+
37,π³,Tree-based,[ExtraTrees (tuned + ensembled)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1262.0,+71/-88,13.747,0.025,33.1,30.65,38.42,0.32,βοΈ,0.0,False,CPU
|
| 40 |
+
38,π§ β‘,Foundation Model,[TabDPT (default)](https://arxiv.org/abs/2410.18164),1249.0,+123/-152,17.564,0.032,33.75,21.52,46.9,45.623,βοΈ,0.0,False,GPU
|
| 41 |
+
39,π§ π,Neural Network,[FastaiMLP (tuned)](https://arxiv.org/abs/2003.06505),1218.0,+79/-144,17.632,0.032,35.18,30.19,389.62,0.112,βοΈ,0.0,False,CPU
|
| 42 |
+
40,π³,Tree-based,[ExtraTrees (tuned)](https://link.springer.com/article/10.1007/s10994-006-6226-1),1203.0,+77/-86,15.534,0.011,35.87,33.94,38.42,0.028,βοΈ,0.0,False,CPU
|
| 43 |
+
41,π§ π,Neural Network,[TorchMLP (default)](https://arxiv.org/abs/2003.06505),1179.0,+62/-68,16.733,0.0,36.96,35.47,1.87,0.046,βοΈ,0.0,False,CPU
|
| 44 |
+
42,π§ π,Neural Network,[FastaiMLP (default)](https://arxiv.org/abs/2003.06505),1145.0,+110/-215,21.37,0.038,38.39,33.26,1.61,0.112,βοΈ,0.0,False,CPU
|
| 45 |
+
43,π,Baseline,[Linear (tuned + ensembled)](https://scikit-learn.org/stable/modules/linear_model.html),1103.0,+142/-227,26.799,0.008,40.08,36.17,43.46,0.087,βοΈ,0.0,False,CPU
|
| 46 |
+
44,π,Baseline,[KNN (tuned + ensembled)](https://scikit-learn.org/stable/modules/neighbors.html),1070.0,+93/-195,24.389,0.01,41.31,32.77,331.68,44.947,βοΈ,0.0,False,CPU
|
| 47 |
+
45,π,Baseline,[Linear (tuned)](https://scikit-learn.org/stable/modules/linear_model.html),1051.0,+151/-241,28.022,0.005,41.96,38.8,43.46,0.021,βοΈ,0.0,False,CPU
|
| 48 |
+
46,π³,Tree-based,[RandomForest (default)](https://link.springer.com/article/10.1023/A:1010933404324),1000.0,+102/-183,22.382,0.0,43.65,42.56,0.12,0.013,βοΈ,0.0,False,CPU
|
| 49 |
+
47,π,Baseline,[Linear (default)](https://scikit-learn.org/stable/modules/linear_model.html),927.0,+140/-232,29.594,0.0,45.73,44.31,0.2,0.023,βοΈ,0.0,False,CPU
|
| 50 |
+
48,β,Other,[xRFM (default)](https://arxiv.org/abs/2508.10053),916.0,+205/-468,31.186,0.022,46.02,40.6,2.8,0.224,βοΈ,0.0,False,GPU
|
| 51 |
+
49,π³,Tree-based,[ExtraTrees (default)](https://link.springer.com/article/10.1007/s10994-006-6226-1),884.0,+91/-212,26.748,0.0,46.79,46.36,0.09,0.019,βοΈ,0.0,False,CPU
|
| 52 |
+
50,π§ β‘,Foundation Model,[TabFlex (default)](https://arxiv.org/abs/2506.05584),861.0,+107/-173,32.966,0.0,47.32,46.59,0.2,0.033,β,0.0,False,GPU
|
| 53 |
+
51,π,Baseline,[KNN (tuned)](https://scikit-learn.org/stable/modules/neighbors.html),816.0,+64/-150,32.095,0.0,48.23,47.9,331.68,1.626,βοΈ,0.0,False,CPU
|
| 54 |
+
52,π,Baseline,[KNN (default)](https://scikit-learn.org/stable/modules/neighbors.html),451.0,+130/-393,49.299,0.0,52.34,52.31,0.12,0.101,βοΈ,0.0,False,CPU
|
data/imputation_no/splits_all/tasks_classification/datasets_medium/winrate_matrix.png.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2104005
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2e75580dd3f3c6afecb6c21e7f64ae847ec30929e333433a88451173b51bd16
|
| 3 |
size 2104005
|