autogluon/fev-bench

1model_name,win_rate,skill_score,median_training_time_s_per100,median_inference_time_s_per100,training_corpus_overlap,num_failures2Toto-2.0-2.5B,96.61290322580645,66.67609437659667,0.0,5.064579399732653,0.0,0.03Toto-2.0-1B,95.48387096774194,66.67229326421315,0.0,2.3743196950416188,0.0,0.04Toto-2.0-313m,93.06451612903226,66.42835118245338,0.0,0.9745701860666667,0.0,0.05Toto-2.0-22m,85.64516129032258,64.64905946685398,0.0,0.13920661274489796,0.0,0.06TimesFM-3,85.3225806451613,65.49636349554686,0.0,8.200040489446785,0.0,0.07Toto-1.0,77.25806451612904,63.05875031595707,0.0,45.854219394249995,0.0,0.08t0-beta,76.61290322580645,64.10856710007313,0.0,4.3975796048998745,0.0,0.09Chronos-2,74.35483870967741,63.92789670076326,0.0,1.1862588189,0.0,0.010Toto-2.0-4m,73.2258064516129,62.51740509789393,0.0,0.09261558033545919,0.0,0.011TiRex-2,67.74193548387096,61.657338261486025,0.0,0.19312244271691675,0.0,0.012TimesFM-2.5,65.32258064516128,61.98663035039822,0.0,6.434508300230608,0.0,0.013TiRex,63.70967741935484,60.871565834690514,0.0,0.20884203875396826,0.0,0.014TS-ICL,63.38709677419354,61.929921677293606,0.0,3.327645272361891,0.0,0.015TabPFN-TS-3,53.064516129032256,59.42246884042356,0.0,431.5150328579276,0.0,0.016Moirai-2.0,50.16129032258064,58.416109773202194,0.0,0.35171731723214283,0.1,0.017FlowState,49.03225806451613,55.917373913965896,0.0,12.472611368300264,0.0,0.018citras-fm,46.93548387096774,57.40397994436643,0.0,0.7048698485226532,0.0,0.019PatchTST,45.564516129032256,56.65838528437654,1068.4652680383783,0.7892402496428571,0.0,0.020TFT,44.67741935483872,56.101100728840805,1003.5120332510221,1.1076982505700976,0.0,0.021Sundial-Base,40.483870967741936,56.64773521043558,0.0,7.874095355196429,0.0,0.022TabPFN-TS,40.32258064516129,54.882167458139385,0.0,285.2805137923404,0.0,0.023Chronos-Bolt,40.16129032258065,54.85929046462743,0.0,0.21284866287857143,0.0,0.024DeepAR,35.24193548387096,50.20430422932948,1590.4637105111146,1.558186748969388,0.0,0.025CatBoost,27.903225806451616,46.25315473529981,123.37088255733154,0.43462186795918367,0.0,0.026LightGBM,22.58064516129032,40.369919076130486,7.053590123430682,0.3469036807346939,0.0,0.027AutoARIMA,22.016129032258064,34.1099179045811,0.0,18.324502920714288,0.0,5.028Stat. Ensemble,19.91935483870968,21.741616773476768,0.0,140.07917045413043,0.0,5.029AutoETS,14.274193548387096,-26.853793282334813,0.0,2.9907604154761906,0.0,15.030AutoTheta,10.483870967741936,-2.114517117703918,0.0,4.0546638315458425,0.0,0.031Seasonal Naive,10.403225806451612,0.0,0.0,0.5176203110585994,0.0,0.032Naive,7.096774193548386,-102.14853947002402,0.0,0.43933051720441596,0.0,0.033Drift,1.9354838709677424,-110.24318719846286,0.0,0.4190869192562794,0.0,0.034