open-llm-leaderboard-old/details_Josephgflowers__Tinyllama-1.5B-Cinder-Test-2
Dataset Card for Evaluation run of Josephgflowers/Tinyllama-1.5B-Cinder-Test-2 Dataset automatically created during the evaluation run of model Josephgflowers/Tinyllama-1.5B-Cinder-Test-2 on the Open LLM Leaderboard. The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task. The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Josephgflowers__Tinyllama-1.5B-Cinder-Test-2.
0267
1---2pretty_name: Evaluation run of Josephgflowers/Tinyllama-1.5B-Cinder-Test-23dataset_summary: "Dataset automatically created during the evaluation run of model\4 \ [Josephgflowers/Tinyllama-1.5B-Cinder-Test-2](https://huggingface.co/Josephgflowers/Tinyllama-1.5B-Cinder-Test-2)\5 \ on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).\n\6 \nThe dataset is composed of 63 configuration, each one coresponding to one of the\7 \ evaluated task.\n\nThe dataset has been created from 2 run(s). Each run can be\8 \ found as a specific split in each configuration, the split being named using the\9 \ timestamp of the run.The \"train\" split is always pointing to the latest results.\n\10 \nAn additional configuration \"results\" store all the aggregated results of the\11 \ run (and is used to compute and display the aggregated metrics on the [Open LLM\12 \ Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).\n\13 \nTo load the details from a run, you can for instance do the following:\n```python\n\14 from datasets import load_dataset\ndata = load_dataset(\"open-llm-leaderboard/details_Josephgflowers__Tinyllama-1.5B-Cinder-Test-2\"\15 ,\n\t\"harness_winogrande_5\",\n\tsplit=\"train\")\n```\n\n## Latest results\n\n\16 These are the [latest results from run 2024-04-05T21:22:09.465979](https://huggingface.co/datasets/open-llm-leaderboard/details_Josephgflowers__Tinyllama-1.5B-Cinder-Test-2/blob/main/results_2024-04-05T21-22-09.465979.json)(note\17 \ that their might be results for other tasks in the repos if successive evals didn't\18 \ cover the same tasks. You find each in the results and the \"latest\" split for\19 \ each eval):\n\n```python\n{\n \"all\": {\n \"acc\": 0.2705480629693628,\n\20 \ \"acc_stderr\": 0.031211817677101388,\n \"acc_norm\": 0.2722219261351411,\n\21 \ \"acc_norm_stderr\": 0.03204316052559818,\n \"mc1\": 0.24112607099143207,\n\22 \ \"mc1_stderr\": 0.01497482727975233,\n \"mc2\": 0.4055707932475926,\n\23 \ \"mc2_stderr\": 0.014734925050237744\n },\n \"harness|arc:challenge|25\"\24 : {\n \"acc\": 0.32337883959044367,\n \"acc_stderr\": 0.01366942163001213,\n\25 \ \"acc_norm\": 0.35494880546075086,\n \"acc_norm_stderr\": 0.013983036904094092\n\26 \ },\n \"harness|hellaswag|10\": {\n \"acc\": 0.39693288189603665,\n\27 \ \"acc_stderr\": 0.004882619484166598,\n \"acc_norm\": 0.5189205337582155,\n\28 \ \"acc_norm_stderr\": 0.004986207581862946\n },\n \"harness|hendrycksTest-abstract_algebra|5\"\29 : {\n \"acc\": 0.23,\n \"acc_stderr\": 0.04229525846816507,\n \30 \ \"acc_norm\": 0.23,\n \"acc_norm_stderr\": 0.04229525846816507\n \31 \ },\n \"harness|hendrycksTest-anatomy|5\": {\n \"acc\": 0.3333333333333333,\n\32 \ \"acc_stderr\": 0.04072314811876837,\n \"acc_norm\": 0.3333333333333333,\n\33 \ \"acc_norm_stderr\": 0.04072314811876837\n },\n \"harness|hendrycksTest-astronomy|5\"\34 : {\n \"acc\": 0.25,\n \"acc_stderr\": 0.03523807393012047,\n \35 \ \"acc_norm\": 0.25,\n \"acc_norm_stderr\": 0.03523807393012047\n \36 \ },\n \"harness|hendrycksTest-business_ethics|5\": {\n \"acc\": 0.29,\n\37 \ \"acc_stderr\": 0.045604802157206845,\n \"acc_norm\": 0.29,\n \38 \ \"acc_norm_stderr\": 0.045604802157206845\n },\n \"harness|hendrycksTest-clinical_knowledge|5\"\39 : {\n \"acc\": 0.28679245283018867,\n \"acc_stderr\": 0.02783491252754408,\n\40 \ \"acc_norm\": 0.28679245283018867,\n \"acc_norm_stderr\": 0.02783491252754408\n\41 \ },\n \"harness|hendrycksTest-college_biology|5\": {\n \"acc\": 0.24305555555555555,\n\42 \ \"acc_stderr\": 0.03586879280080342,\n \"acc_norm\": 0.24305555555555555,\n\43 \ \"acc_norm_stderr\": 0.03586879280080342\n },\n \"harness|hendrycksTest-college_chemistry|5\"\44 : {\n \"acc\": 0.25,\n \"acc_stderr\": 0.04351941398892446,\n \45 \ \"acc_norm\": 0.25,\n \"acc_norm_stderr\": 0.04351941398892446\n \46 \ },\n \"harness|hendrycksTest-college_computer_science|5\": {\n \"acc\"\47 : 0.32,\n \"acc_stderr\": 0.046882617226215034,\n \"acc_norm\": 0.32,\n\48 \ \"acc_norm_stderr\": 0.046882617226215034\n },\n \"harness|hendrycksTest-college_mathematics|5\"\49 : {\n \"acc\": 0.25,\n \"acc_stderr\": 0.04351941398892446,\n \50 \ \"acc_norm\": 0.25,\n \"acc_norm_stderr\": 0.04351941398892446\n \51 \ },\n \"harness|hendrycksTest-college_medicine|5\": {\n \"acc\": 0.21965317919075145,\n\52 \ \"acc_stderr\": 0.031568093627031744,\n \"acc_norm\": 0.21965317919075145,\n\53 \ \"acc_norm_stderr\": 0.031568093627031744\n },\n \"harness|hendrycksTest-college_physics|5\"\54 : {\n \"acc\": 0.21568627450980393,\n \"acc_stderr\": 0.04092563958237654,\n\55 \ \"acc_norm\": 0.21568627450980393,\n \"acc_norm_stderr\": 0.04092563958237654\n\56 \ },\n \"harness|hendrycksTest-computer_security|5\": {\n \"acc\":\57 \ 0.21,\n \"acc_stderr\": 0.04093601807403326,\n \"acc_norm\": 0.21,\n\58 \ \"acc_norm_stderr\": 0.04093601807403326\n },\n \"harness|hendrycksTest-conceptual_physics|5\"\59 : {\n \"acc\": 0.2680851063829787,\n \"acc_stderr\": 0.02895734278834235,\n\60 \ \"acc_norm\": 0.2680851063829787,\n \"acc_norm_stderr\": 0.02895734278834235\n\61 \ },\n \"harness|hendrycksTest-econometrics|5\": {\n \"acc\": 0.2982456140350877,\n\62 \ \"acc_stderr\": 0.04303684033537315,\n \"acc_norm\": 0.2982456140350877,\n\63 \ \"acc_norm_stderr\": 0.04303684033537315\n },\n \"harness|hendrycksTest-electrical_engineering|5\"\64 : {\n \"acc\": 0.23448275862068965,\n \"acc_stderr\": 0.035306258743465914,\n\65 \ \"acc_norm\": 0.23448275862068965,\n \"acc_norm_stderr\": 0.035306258743465914\n\66 \ },\n \"harness|hendrycksTest-elementary_mathematics|5\": {\n \"acc\"\67 : 0.2566137566137566,\n \"acc_stderr\": 0.022494510767503154,\n \"\68 acc_norm\": 0.2566137566137566,\n \"acc_norm_stderr\": 0.022494510767503154\n\69 \ },\n \"harness|hendrycksTest-formal_logic|5\": {\n \"acc\": 0.2777777777777778,\n\70 \ \"acc_stderr\": 0.040061680838488774,\n \"acc_norm\": 0.2777777777777778,\n\71 \ \"acc_norm_stderr\": 0.040061680838488774\n },\n \"harness|hendrycksTest-global_facts|5\"\72 : {\n \"acc\": 0.15,\n \"acc_stderr\": 0.03588702812826371,\n \73 \ \"acc_norm\": 0.15,\n \"acc_norm_stderr\": 0.03588702812826371\n \74 \ },\n \"harness|hendrycksTest-high_school_biology|5\": {\n \"acc\": 0.3161290322580645,\n\75 \ \"acc_stderr\": 0.02645087448904277,\n \"acc_norm\": 0.3161290322580645,\n\76 \ \"acc_norm_stderr\": 0.02645087448904277\n },\n \"harness|hendrycksTest-high_school_chemistry|5\"\77 : {\n \"acc\": 0.30049261083743845,\n \"acc_stderr\": 0.03225799476233484,\n\78 \ \"acc_norm\": 0.30049261083743845,\n \"acc_norm_stderr\": 0.03225799476233484\n\79 \ },\n \"harness|hendrycksTest-high_school_computer_science|5\": {\n \80 \ \"acc\": 0.23,\n \"acc_stderr\": 0.04229525846816508,\n \"acc_norm\"\81 : 0.23,\n \"acc_norm_stderr\": 0.04229525846816508\n },\n \"harness|hendrycksTest-high_school_european_history|5\"\82 : {\n \"acc\": 0.296969696969697,\n \"acc_stderr\": 0.03567969772268049,\n\83 \ \"acc_norm\": 0.296969696969697,\n \"acc_norm_stderr\": 0.03567969772268049\n\84 \ },\n \"harness|hendrycksTest-high_school_geography|5\": {\n \"acc\"\85 : 0.2777777777777778,\n \"acc_stderr\": 0.03191178226713547,\n \"\86 acc_norm\": 0.2777777777777778,\n \"acc_norm_stderr\": 0.03191178226713547\n\87 \ },\n \"harness|hendrycksTest-high_school_government_and_politics|5\": {\n\88 \ \"acc\": 0.24870466321243523,\n \"acc_stderr\": 0.031195840877700307,\n\89 \ \"acc_norm\": 0.24870466321243523,\n \"acc_norm_stderr\": 0.031195840877700307\n\90 \ },\n \"harness|hendrycksTest-high_school_macroeconomics|5\": {\n \91 \ \"acc\": 0.2205128205128205,\n \"acc_stderr\": 0.021020672680827912,\n\92 \ \"acc_norm\": 0.2205128205128205,\n \"acc_norm_stderr\": 0.021020672680827912\n\93 \ },\n \"harness|hendrycksTest-high_school_mathematics|5\": {\n \"\94 acc\": 0.24814814814814815,\n \"acc_stderr\": 0.0263357394040558,\n \95 \ \"acc_norm\": 0.24814814814814815,\n \"acc_norm_stderr\": 0.0263357394040558\n\96 \ },\n \"harness|hendrycksTest-high_school_microeconomics|5\": {\n \97 \ \"acc\": 0.2647058823529412,\n \"acc_stderr\": 0.02865749128507197,\n \98 \ \"acc_norm\": 0.2647058823529412,\n \"acc_norm_stderr\": 0.02865749128507197\n\99 \ },\n \"harness|hendrycksTest-high_school_physics|5\": {\n \"acc\"\100 : 0.26490066225165565,\n \"acc_stderr\": 0.036030385453603854,\n \"\101 acc_norm\": 0.26490066225165565,\n \"acc_norm_stderr\": 0.036030385453603854\n\102 \ },\n \"harness|hendrycksTest-high_school_psychology|5\": {\n \"acc\"\103 : 0.24403669724770644,\n \"acc_stderr\": 0.018415286351416416,\n \"\104 acc_norm\": 0.24403669724770644,\n \"acc_norm_stderr\": 0.018415286351416416\n\105 \ },\n \"harness|hendrycksTest-high_school_statistics|5\": {\n \"acc\"\106 : 0.4212962962962963,\n \"acc_stderr\": 0.03367462138896078,\n \"\107 acc_norm\": 0.4212962962962963,\n \"acc_norm_stderr\": 0.03367462138896078\n\108 \ },\n \"harness|hendrycksTest-high_school_us_history|5\": {\n \"acc\"\109 : 0.23529411764705882,\n \"acc_stderr\": 0.02977177522814565,\n \"\110 acc_norm\": 0.23529411764705882,\n \"acc_norm_stderr\": 0.02977177522814565\n\111 \ },\n \"harness|hendrycksTest-high_school_world_history|5\": {\n \"\112 acc\": 0.2320675105485232,\n \"acc_stderr\": 0.027479744550808507,\n \113 \ \"acc_norm\": 0.2320675105485232,\n \"acc_norm_stderr\": 0.027479744550808507\n\114 \ },\n \"harness|hendrycksTest-human_aging|5\": {\n \"acc\": 0.3183856502242152,\n\115 \ \"acc_stderr\": 0.03126580522513713,\n \"acc_norm\": 0.3183856502242152,\n\116 \ \"acc_norm_stderr\": 0.03126580522513713\n },\n \"harness|hendrycksTest-human_sexuality|5\"\117 : {\n \"acc\": 0.2748091603053435,\n \"acc_stderr\": 0.03915345408847835,\n\118 \ \"acc_norm\": 0.2748091603053435,\n \"acc_norm_stderr\": 0.03915345408847835\n\119 \ },\n \"harness|hendrycksTest-international_law|5\": {\n \"acc\":\120 \ 0.36363636363636365,\n \"acc_stderr\": 0.04391326286724071,\n \"\121 acc_norm\": 0.36363636363636365,\n \"acc_norm_stderr\": 0.04391326286724071\n\122 \ },\n \"harness|hendrycksTest-jurisprudence|5\": {\n \"acc\": 0.19444444444444445,\n\123 \ \"acc_stderr\": 0.038260763248848646,\n \"acc_norm\": 0.19444444444444445,\n\124 \ \"acc_norm_stderr\": 0.038260763248848646\n },\n \"harness|hendrycksTest-logical_fallacies|5\"\125 : {\n \"acc\": 0.2883435582822086,\n \"acc_stderr\": 0.03559039531617342,\n\126 \ \"acc_norm\": 0.2883435582822086,\n \"acc_norm_stderr\": 0.03559039531617342\n\127 \ },\n \"harness|hendrycksTest-machine_learning|5\": {\n \"acc\": 0.25,\n\128 \ \"acc_stderr\": 0.04109974682633932,\n \"acc_norm\": 0.25,\n \129 \ \"acc_norm_stderr\": 0.04109974682633932\n },\n \"harness|hendrycksTest-management|5\"\130 : {\n \"acc\": 0.21359223300970873,\n \"acc_stderr\": 0.040580420156460344,\n\131 \ \"acc_norm\": 0.21359223300970873,\n \"acc_norm_stderr\": 0.040580420156460344\n\132 \ },\n \"harness|hendrycksTest-marketing|5\": {\n \"acc\": 0.2564102564102564,\n\133 \ \"acc_stderr\": 0.028605953702004243,\n \"acc_norm\": 0.2564102564102564,\n\134 \ \"acc_norm_stderr\": 0.028605953702004243\n },\n \"harness|hendrycksTest-medical_genetics|5\"\135 : {\n \"acc\": 0.26,\n \"acc_stderr\": 0.04408440022768078,\n \136 \ \"acc_norm\": 0.26,\n \"acc_norm_stderr\": 0.04408440022768078\n \137 \ },\n \"harness|hendrycksTest-miscellaneous|5\": {\n \"acc\": 0.29118773946360155,\n\138 \ \"acc_stderr\": 0.016246087069701407,\n \"acc_norm\": 0.29118773946360155,\n\139 \ \"acc_norm_stderr\": 0.016246087069701407\n },\n \"harness|hendrycksTest-moral_disputes|5\"\140 : {\n \"acc\": 0.2138728323699422,\n \"acc_stderr\": 0.022075709251757183,\n\141 \ \"acc_norm\": 0.2138728323699422,\n \"acc_norm_stderr\": 0.022075709251757183\n\142 \ },\n \"harness|hendrycksTest-moral_scenarios|5\": {\n \"acc\": 0.2681564245810056,\n\143 \ \"acc_stderr\": 0.014816119635317003,\n \"acc_norm\": 0.2681564245810056,\n\144 \ \"acc_norm_stderr\": 0.014816119635317003\n },\n \"harness|hendrycksTest-nutrition|5\"\145 : {\n \"acc\": 0.3300653594771242,\n \"acc_stderr\": 0.026925654653615693,\n\146 \ \"acc_norm\": 0.3300653594771242,\n \"acc_norm_stderr\": 0.026925654653615693\n\147 \ },\n \"harness|hendrycksTest-philosophy|5\": {\n \"acc\": 0.2829581993569132,\n\148 \ \"acc_stderr\": 0.025583062489984838,\n \"acc_norm\": 0.2829581993569132,\n\149 \ \"acc_norm_stderr\": 0.025583062489984838\n },\n \"harness|hendrycksTest-prehistory|5\"\150 : {\n \"acc\": 0.29012345679012347,\n \"acc_stderr\": 0.025251173936495022,\n\151 \ \"acc_norm\": 0.29012345679012347,\n \"acc_norm_stderr\": 0.025251173936495022\n\152 \ },\n \"harness|hendrycksTest-professional_accounting|5\": {\n \"\153 acc\": 0.23404255319148937,\n \"acc_stderr\": 0.02525786135943241,\n \154 \ \"acc_norm\": 0.23404255319148937,\n \"acc_norm_stderr\": 0.02525786135943241\n\155 \ },\n \"harness|hendrycksTest-professional_law|5\": {\n \"acc\": 0.23272490221642764,\n\156 \ \"acc_stderr\": 0.010792595553888496,\n \"acc_norm\": 0.23272490221642764,\n\157 \ \"acc_norm_stderr\": 0.010792595553888496\n },\n \"harness|hendrycksTest-professional_medicine|5\"\158 : {\n \"acc\": 0.3088235294117647,\n \"acc_stderr\": 0.028064998167040094,\n\159 \ \"acc_norm\": 0.3088235294117647,\n \"acc_norm_stderr\": 0.028064998167040094\n\160 \ },\n \"harness|hendrycksTest-professional_psychology|5\": {\n \"\161 acc\": 0.21895424836601307,\n \"acc_stderr\": 0.01672993756553753,\n \162 \ \"acc_norm\": 0.21895424836601307,\n \"acc_norm_stderr\": 0.01672993756553753\n\163 \ },\n \"harness|hendrycksTest-public_relations|5\": {\n \"acc\": 0.18181818181818182,\n\164 \ \"acc_stderr\": 0.036942843353378,\n \"acc_norm\": 0.18181818181818182,\n\165 \ \"acc_norm_stderr\": 0.036942843353378\n },\n \"harness|hendrycksTest-security_studies|5\"\166 : {\n \"acc\": 0.3836734693877551,\n \"acc_stderr\": 0.03113088039623592,\n\167 \ \"acc_norm\": 0.3836734693877551,\n \"acc_norm_stderr\": 0.03113088039623592\n\168 \ },\n \"harness|hendrycksTest-sociology|5\": {\n \"acc\": 0.23880597014925373,\n\169 \ \"acc_stderr\": 0.030147775935409217,\n \"acc_norm\": 0.23880597014925373,\n\170 \ \"acc_norm_stderr\": 0.030147775935409217\n },\n \"harness|hendrycksTest-us_foreign_policy|5\"\171 : {\n \"acc\": 0.35,\n \"acc_stderr\": 0.0479372485441102,\n \172 \ \"acc_norm\": 0.35,\n \"acc_norm_stderr\": 0.0479372485441102\n },\n\173 \ \"harness|hendrycksTest-virology|5\": {\n \"acc\": 0.2710843373493976,\n\174 \ \"acc_stderr\": 0.03460579907553027,\n \"acc_norm\": 0.2710843373493976,\n\175 \ \"acc_norm_stderr\": 0.03460579907553027\n },\n \"harness|hendrycksTest-world_religions|5\"\176 : {\n \"acc\": 0.28654970760233917,\n \"acc_stderr\": 0.034678266857038266,\n\177 \ \"acc_norm\": 0.28654970760233917,\n \"acc_norm_stderr\": 0.034678266857038266\n\178 \ },\n \"harness|truthfulqa:mc|0\": {\n \"mc1\": 0.24112607099143207,\n\179 \ \"mc1_stderr\": 0.01497482727975233,\n \"mc2\": 0.4055707932475926,\n\180 \ \"mc2_stderr\": 0.014734925050237744\n },\n \"harness|winogrande|5\"\181 : {\n \"acc\": 0.595895816890292,\n \"acc_stderr\": 0.01379161066467085\n\182 \ },\n \"harness|gsm8k|5\": {\n \"acc\": 0.0,\n \"acc_stderr\"\183 : 0.0\n }\n}\n```"184repo_url: https://huggingface.co/Josephgflowers/Tinyllama-1.5B-Cinder-Test-2185leaderboard_url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard186point_of_contact: clementine@hf.co187configs:188- config_name: harness_arc_challenge_25189 data_files:190 - split: 2024_04_05T21_15_56.896724191 path:192 - '**/details_harness|arc:challenge|25_2024-04-05T21-15-56.896724.parquet'193 - split: 2024_04_05T21_22_09.465979194 path:195 - '**/details_harness|arc:challenge|25_2024-04-05T21-22-09.465979.parquet'196 - split: latest197 path:198 - '**/details_harness|arc:challenge|25_2024-04-05T21-22-09.465979.parquet'199- config_name: harness_gsm8k_5200 data_files:201 - split: 2024_04_05T21_15_56.896724202 path:203 - '**/details_harness|gsm8k|5_2024-04-05T21-15-56.896724.parquet'204 - split: 2024_04_05T21_22_09.465979205 path:206 - '**/details_harness|gsm8k|5_2024-04-05T21-22-09.465979.parquet'207 - split: latest208 path:209 - '**/details_harness|gsm8k|5_2024-04-05T21-22-09.465979.parquet'210- config_name: harness_hellaswag_10211 data_files:212 - split: 2024_04_05T21_15_56.896724213 path:214 - '**/details_harness|hellaswag|10_2024-04-05T21-15-56.896724.parquet'215 - split: 2024_04_05T21_22_09.465979216 path:217 - '**/details_harness|hellaswag|10_2024-04-05T21-22-09.465979.parquet'218 - split: latest219 path:220 - '**/details_harness|hellaswag|10_2024-04-05T21-22-09.465979.parquet'221- config_name: harness_hendrycksTest_5222 data_files:223 - split: 2024_04_05T21_15_56.896724224 path:225 - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-04-05T21-15-56.896724.parquet'226 - '**/details_harness|hendrycksTest-anatomy|5_2024-04-05T21-15-56.896724.parquet'227 - '**/details_harness|hendrycksTest-astronomy|5_2024-04-05T21-15-56.896724.parquet'228 - '**/details_harness|hendrycksTest-business_ethics|5_2024-04-05T21-15-56.896724.parquet'229 - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-05T21-15-56.896724.parquet'230 - '**/details_harness|hendrycksTest-college_biology|5_2024-04-05T21-15-56.896724.parquet'231 - '**/details_harness|hendrycksTest-college_chemistry|5_2024-04-05T21-15-56.896724.parquet'232 - '**/details_harness|hendrycksTest-college_computer_science|5_2024-04-05T21-15-56.896724.parquet'233 - '**/details_harness|hendrycksTest-college_mathematics|5_2024-04-05T21-15-56.896724.parquet'234 - '**/details_harness|hendrycksTest-college_medicine|5_2024-04-05T21-15-56.896724.parquet'235 - '**/details_harness|hendrycksTest-college_physics|5_2024-04-05T21-15-56.896724.parquet'236 - '**/details_harness|hendrycksTest-computer_security|5_2024-04-05T21-15-56.896724.parquet'237 - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-04-05T21-15-56.896724.parquet'238 - '**/details_harness|hendrycksTest-econometrics|5_2024-04-05T21-15-56.896724.parquet'239 - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-04-05T21-15-56.896724.parquet'240 - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-05T21-15-56.896724.parquet'241 - '**/details_harness|hendrycksTest-formal_logic|5_2024-04-05T21-15-56.896724.parquet'242 - '**/details_harness|hendrycksTest-global_facts|5_2024-04-05T21-15-56.896724.parquet'243 - '**/details_harness|hendrycksTest-high_school_biology|5_2024-04-05T21-15-56.896724.parquet'244 - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-04-05T21-15-56.896724.parquet'245 - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-04-05T21-15-56.896724.parquet'246 - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-04-05T21-15-56.896724.parquet'247 - '**/details_harness|hendrycksTest-high_school_geography|5_2024-04-05T21-15-56.896724.parquet'248 - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-04-05T21-15-56.896724.parquet'249 - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-04-05T21-15-56.896724.parquet'250 - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-04-05T21-15-56.896724.parquet'251 - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-04-05T21-15-56.896724.parquet'252 - '**/details_harness|hendrycksTest-high_school_physics|5_2024-04-05T21-15-56.896724.parquet'253 - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-04-05T21-15-56.896724.parquet'254 - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-04-05T21-15-56.896724.parquet'255 - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-04-05T21-15-56.896724.parquet'256 - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-04-05T21-15-56.896724.parquet'257 - '**/details_harness|hendrycksTest-human_aging|5_2024-04-05T21-15-56.896724.parquet'258 - '**/details_harness|hendrycksTest-human_sexuality|5_2024-04-05T21-15-56.896724.parquet'259 - '**/details_harness|hendrycksTest-international_law|5_2024-04-05T21-15-56.896724.parquet'260 - '**/details_harness|hendrycksTest-jurisprudence|5_2024-04-05T21-15-56.896724.parquet'261 - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-04-05T21-15-56.896724.parquet'262 - '**/details_harness|hendrycksTest-machine_learning|5_2024-04-05T21-15-56.896724.parquet'263 - '**/details_harness|hendrycksTest-management|5_2024-04-05T21-15-56.896724.parquet'264 - '**/details_harness|hendrycksTest-marketing|5_2024-04-05T21-15-56.896724.parquet'265 - '**/details_harness|hendrycksTest-medical_genetics|5_2024-04-05T21-15-56.896724.parquet'266 - '**/details_harness|hendrycksTest-miscellaneous|5_2024-04-05T21-15-56.896724.parquet'267 - '**/details_harness|hendrycksTest-moral_disputes|5_2024-04-05T21-15-56.896724.parquet'268 - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-04-05T21-15-56.896724.parquet'269 - '**/details_harness|hendrycksTest-nutrition|5_2024-04-05T21-15-56.896724.parquet'270 - '**/details_harness|hendrycksTest-philosophy|5_2024-04-05T21-15-56.896724.parquet'271 - '**/details_harness|hendrycksTest-prehistory|5_2024-04-05T21-15-56.896724.parquet'272 - '**/details_harness|hendrycksTest-professional_accounting|5_2024-04-05T21-15-56.896724.parquet'273 - '**/details_harness|hendrycksTest-professional_law|5_2024-04-05T21-15-56.896724.parquet'274 - '**/details_harness|hendrycksTest-professional_medicine|5_2024-04-05T21-15-56.896724.parquet'275 - '**/details_harness|hendrycksTest-professional_psychology|5_2024-04-05T21-15-56.896724.parquet'276 - '**/details_harness|hendrycksTest-public_relations|5_2024-04-05T21-15-56.896724.parquet'277 - '**/details_harness|hendrycksTest-security_studies|5_2024-04-05T21-15-56.896724.parquet'278 - '**/details_harness|hendrycksTest-sociology|5_2024-04-05T21-15-56.896724.parquet'279 - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-04-05T21-15-56.896724.parquet'280 - '**/details_harness|hendrycksTest-virology|5_2024-04-05T21-15-56.896724.parquet'281 - '**/details_harness|hendrycksTest-world_religions|5_2024-04-05T21-15-56.896724.parquet'282 - split: 2024_04_05T21_22_09.465979283 path:284 - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-04-05T21-22-09.465979.parquet'285 - '**/details_harness|hendrycksTest-anatomy|5_2024-04-05T21-22-09.465979.parquet'286 - '**/details_harness|hendrycksTest-astronomy|5_2024-04-05T21-22-09.465979.parquet'287 - '**/details_harness|hendrycksTest-business_ethics|5_2024-04-05T21-22-09.465979.parquet'288 - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-05T21-22-09.465979.parquet'289 - '**/details_harness|hendrycksTest-college_biology|5_2024-04-05T21-22-09.465979.parquet'290 - '**/details_harness|hendrycksTest-college_chemistry|5_2024-04-05T21-22-09.465979.parquet'291 - '**/details_harness|hendrycksTest-college_computer_science|5_2024-04-05T21-22-09.465979.parquet'292 - '**/details_harness|hendrycksTest-college_mathematics|5_2024-04-05T21-22-09.465979.parquet'293 - '**/details_harness|hendrycksTest-college_medicine|5_2024-04-05T21-22-09.465979.parquet'294 - '**/details_harness|hendrycksTest-college_physics|5_2024-04-05T21-22-09.465979.parquet'295 - '**/details_harness|hendrycksTest-computer_security|5_2024-04-05T21-22-09.465979.parquet'296 - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-04-05T21-22-09.465979.parquet'297 - '**/details_harness|hendrycksTest-econometrics|5_2024-04-05T21-22-09.465979.parquet'298 - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-04-05T21-22-09.465979.parquet'299 - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-05T21-22-09.465979.parquet'300 - '**/details_harness|hendrycksTest-formal_logic|5_2024-04-05T21-22-09.465979.parquet'301 - '**/details_harness|hendrycksTest-global_facts|5_2024-04-05T21-22-09.465979.parquet'302 - '**/details_harness|hendrycksTest-high_school_biology|5_2024-04-05T21-22-09.465979.parquet'303 - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-04-05T21-22-09.465979.parquet'304 - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-04-05T21-22-09.465979.parquet'305 - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-04-05T21-22-09.465979.parquet'306 - '**/details_harness|hendrycksTest-high_school_geography|5_2024-04-05T21-22-09.465979.parquet'307 - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-04-05T21-22-09.465979.parquet'308 - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-04-05T21-22-09.465979.parquet'309 - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-04-05T21-22-09.465979.parquet'310 - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-04-05T21-22-09.465979.parquet'311 - '**/details_harness|hendrycksTest-high_school_physics|5_2024-04-05T21-22-09.465979.parquet'312 - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-04-05T21-22-09.465979.parquet'313 - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-04-05T21-22-09.465979.parquet'314 - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-04-05T21-22-09.465979.parquet'315 - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-04-05T21-22-09.465979.parquet'316 - '**/details_harness|hendrycksTest-human_aging|5_2024-04-05T21-22-09.465979.parquet'317 - '**/details_harness|hendrycksTest-human_sexuality|5_2024-04-05T21-22-09.465979.parquet'318 - '**/details_harness|hendrycksTest-international_law|5_2024-04-05T21-22-09.465979.parquet'319 - '**/details_harness|hendrycksTest-jurisprudence|5_2024-04-05T21-22-09.465979.parquet'320 - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-04-05T21-22-09.465979.parquet'321 - '**/details_harness|hendrycksTest-machine_learning|5_2024-04-05T21-22-09.465979.parquet'322 - '**/details_harness|hendrycksTest-management|5_2024-04-05T21-22-09.465979.parquet'323 - '**/details_harness|hendrycksTest-marketing|5_2024-04-05T21-22-09.465979.parquet'324 - '**/details_harness|hendrycksTest-medical_genetics|5_2024-04-05T21-22-09.465979.parquet'325 - '**/details_harness|hendrycksTest-miscellaneous|5_2024-04-05T21-22-09.465979.parquet'326 - '**/details_harness|hendrycksTest-moral_disputes|5_2024-04-05T21-22-09.465979.parquet'327 - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-04-05T21-22-09.465979.parquet'328 - '**/details_harness|hendrycksTest-nutrition|5_2024-04-05T21-22-09.465979.parquet'329 - '**/details_harness|hendrycksTest-philosophy|5_2024-04-05T21-22-09.465979.parquet'330 - '**/details_harness|hendrycksTest-prehistory|5_2024-04-05T21-22-09.465979.parquet'331 - '**/details_harness|hendrycksTest-professional_accounting|5_2024-04-05T21-22-09.465979.parquet'332 - '**/details_harness|hendrycksTest-professional_law|5_2024-04-05T21-22-09.465979.parquet'333 - '**/details_harness|hendrycksTest-professional_medicine|5_2024-04-05T21-22-09.465979.parquet'334 - '**/details_harness|hendrycksTest-professional_psychology|5_2024-04-05T21-22-09.465979.parquet'335 - '**/details_harness|hendrycksTest-public_relations|5_2024-04-05T21-22-09.465979.parquet'336 - '**/details_harness|hendrycksTest-security_studies|5_2024-04-05T21-22-09.465979.parquet'337 - '**/details_harness|hendrycksTest-sociology|5_2024-04-05T21-22-09.465979.parquet'338 - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-04-05T21-22-09.465979.parquet'339 - '**/details_harness|hendrycksTest-virology|5_2024-04-05T21-22-09.465979.parquet'340 - '**/details_harness|hendrycksTest-world_religions|5_2024-04-05T21-22-09.465979.parquet'341 - split: latest342 path:343 - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-04-05T21-22-09.465979.parquet'344 - '**/details_harness|hendrycksTest-anatomy|5_2024-04-05T21-22-09.465979.parquet'345 - '**/details_harness|hendrycksTest-astronomy|5_2024-04-05T21-22-09.465979.parquet'346 - '**/details_harness|hendrycksTest-business_ethics|5_2024-04-05T21-22-09.465979.parquet'347 - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-05T21-22-09.465979.parquet'348 - '**/details_harness|hendrycksTest-college_biology|5_2024-04-05T21-22-09.465979.parquet'349 - '**/details_harness|hendrycksTest-college_chemistry|5_2024-04-05T21-22-09.465979.parquet'350 - '**/details_harness|hendrycksTest-college_computer_science|5_2024-04-05T21-22-09.465979.parquet'351 - '**/details_harness|hendrycksTest-college_mathematics|5_2024-04-05T21-22-09.465979.parquet'352 - '**/details_harness|hendrycksTest-college_medicine|5_2024-04-05T21-22-09.465979.parquet'353 - '**/details_harness|hendrycksTest-college_physics|5_2024-04-05T21-22-09.465979.parquet'354 - '**/details_harness|hendrycksTest-computer_security|5_2024-04-05T21-22-09.465979.parquet'355 - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-04-05T21-22-09.465979.parquet'356 - '**/details_harness|hendrycksTest-econometrics|5_2024-04-05T21-22-09.465979.parquet'357 - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-04-05T21-22-09.465979.parquet'358 - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-05T21-22-09.465979.parquet'359 - '**/details_harness|hendrycksTest-formal_logic|5_2024-04-05T21-22-09.465979.parquet'360 - '**/details_harness|hendrycksTest-global_facts|5_2024-04-05T21-22-09.465979.parquet'361 - '**/details_harness|hendrycksTest-high_school_biology|5_2024-04-05T21-22-09.465979.parquet'362 - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-04-05T21-22-09.465979.parquet'363 - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-04-05T21-22-09.465979.parquet'364 - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-04-05T21-22-09.465979.parquet'365 - '**/details_harness|hendrycksTest-high_school_geography|5_2024-04-05T21-22-09.465979.parquet'366 - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-04-05T21-22-09.465979.parquet'367 - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-04-05T21-22-09.465979.parquet'368 - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-04-05T21-22-09.465979.parquet'369 - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-04-05T21-22-09.465979.parquet'370 - '**/details_harness|hendrycksTest-high_school_physics|5_2024-04-05T21-22-09.465979.parquet'371 - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-04-05T21-22-09.465979.parquet'372 - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-04-05T21-22-09.465979.parquet'373 - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-04-05T21-22-09.465979.parquet'374 - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-04-05T21-22-09.465979.parquet'375 - '**/details_harness|hendrycksTest-human_aging|5_2024-04-05T21-22-09.465979.parquet'376 - '**/details_harness|hendrycksTest-human_sexuality|5_2024-04-05T21-22-09.465979.parquet'377 - '**/details_harness|hendrycksTest-international_law|5_2024-04-05T21-22-09.465979.parquet'378 - '**/details_harness|hendrycksTest-jurisprudence|5_2024-04-05T21-22-09.465979.parquet'379 - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-04-05T21-22-09.465979.parquet'380 - '**/details_harness|hendrycksTest-machine_learning|5_2024-04-05T21-22-09.465979.parquet'381 - '**/details_harness|hendrycksTest-management|5_2024-04-05T21-22-09.465979.parquet'382 - '**/details_harness|hendrycksTest-marketing|5_2024-04-05T21-22-09.465979.parquet'383 - '**/details_harness|hendrycksTest-medical_genetics|5_2024-04-05T21-22-09.465979.parquet'384 - '**/details_harness|hendrycksTest-miscellaneous|5_2024-04-05T21-22-09.465979.parquet'385 - '**/details_harness|hendrycksTest-moral_disputes|5_2024-04-05T21-22-09.465979.parquet'386 - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-04-05T21-22-09.465979.parquet'387 - '**/details_harness|hendrycksTest-nutrition|5_2024-04-05T21-22-09.465979.parquet'388 - '**/details_harness|hendrycksTest-philosophy|5_2024-04-05T21-22-09.465979.parquet'389 - '**/details_harness|hendrycksTest-prehistory|5_2024-04-05T21-22-09.465979.parquet'390 - '**/details_harness|hendrycksTest-professional_accounting|5_2024-04-05T21-22-09.465979.parquet'391 - '**/details_harness|hendrycksTest-professional_law|5_2024-04-05T21-22-09.465979.parquet'392 - '**/details_harness|hendrycksTest-professional_medicine|5_2024-04-05T21-22-09.465979.parquet'393 - '**/details_harness|hendrycksTest-professional_psychology|5_2024-04-05T21-22-09.465979.parquet'394 - '**/details_harness|hendrycksTest-public_relations|5_2024-04-05T21-22-09.465979.parquet'395 - '**/details_harness|hendrycksTest-security_studies|5_2024-04-05T21-22-09.465979.parquet'396 - '**/details_harness|hendrycksTest-sociology|5_2024-04-05T21-22-09.465979.parquet'397 - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-04-05T21-22-09.465979.parquet'398 - '**/details_harness|hendrycksTest-virology|5_2024-04-05T21-22-09.465979.parquet'399 - '**/details_harness|hendrycksTest-world_religions|5_2024-04-05T21-22-09.465979.parquet'400- config_name: harness_hendrycksTest_abstract_algebra_5401 data_files:402 - split: 2024_04_05T21_15_56.896724403 path:404 - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-04-05T21-15-56.896724.parquet'405 - split: 2024_04_05T21_22_09.465979406 path:407 - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-04-05T21-22-09.465979.parquet'408 - split: latest409 path:410 - '**/details_harness|hendrycksTest-abstract_algebra|5_2024-04-05T21-22-09.465979.parquet'411- config_name: harness_hendrycksTest_anatomy_5412 data_files:413 - split: 2024_04_05T21_15_56.896724414 path:415 - '**/details_harness|hendrycksTest-anatomy|5_2024-04-05T21-15-56.896724.parquet'416 - split: 2024_04_05T21_22_09.465979417 path:418 - '**/details_harness|hendrycksTest-anatomy|5_2024-04-05T21-22-09.465979.parquet'419 - split: latest420 path:421 - '**/details_harness|hendrycksTest-anatomy|5_2024-04-05T21-22-09.465979.parquet'422- config_name: harness_hendrycksTest_astronomy_5423 data_files:424 - split: 2024_04_05T21_15_56.896724425 path:426 - '**/details_harness|hendrycksTest-astronomy|5_2024-04-05T21-15-56.896724.parquet'427 - split: 2024_04_05T21_22_09.465979428 path:429 - '**/details_harness|hendrycksTest-astronomy|5_2024-04-05T21-22-09.465979.parquet'430 - split: latest431 path:432 - '**/details_harness|hendrycksTest-astronomy|5_2024-04-05T21-22-09.465979.parquet'433- config_name: harness_hendrycksTest_business_ethics_5434 data_files:435 - split: 2024_04_05T21_15_56.896724436 path:437 - '**/details_harness|hendrycksTest-business_ethics|5_2024-04-05T21-15-56.896724.parquet'438 - split: 2024_04_05T21_22_09.465979439 path:440 - '**/details_harness|hendrycksTest-business_ethics|5_2024-04-05T21-22-09.465979.parquet'441 - split: latest442 path:443 - '**/details_harness|hendrycksTest-business_ethics|5_2024-04-05T21-22-09.465979.parquet'444- config_name: harness_hendrycksTest_clinical_knowledge_5445 data_files:446 - split: 2024_04_05T21_15_56.896724447 path:448 - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-05T21-15-56.896724.parquet'449 - split: 2024_04_05T21_22_09.465979450 path:451 - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-05T21-22-09.465979.parquet'452 - split: latest453 path:454 - '**/details_harness|hendrycksTest-clinical_knowledge|5_2024-04-05T21-22-09.465979.parquet'455- config_name: harness_hendrycksTest_college_biology_5456 data_files:457 - split: 2024_04_05T21_15_56.896724458 path:459 - '**/details_harness|hendrycksTest-college_biology|5_2024-04-05T21-15-56.896724.parquet'460 - split: 2024_04_05T21_22_09.465979461 path:462 - '**/details_harness|hendrycksTest-college_biology|5_2024-04-05T21-22-09.465979.parquet'463 - split: latest464 path:465 - '**/details_harness|hendrycksTest-college_biology|5_2024-04-05T21-22-09.465979.parquet'466- config_name: harness_hendrycksTest_college_chemistry_5467 data_files:468 - split: 2024_04_05T21_15_56.896724469 path:470 - '**/details_harness|hendrycksTest-college_chemistry|5_2024-04-05T21-15-56.896724.parquet'471 - split: 2024_04_05T21_22_09.465979472 path:473 - '**/details_harness|hendrycksTest-college_chemistry|5_2024-04-05T21-22-09.465979.parquet'474 - split: latest475 path:476 - '**/details_harness|hendrycksTest-college_chemistry|5_2024-04-05T21-22-09.465979.parquet'477- config_name: harness_hendrycksTest_college_computer_science_5478 data_files:479 - split: 2024_04_05T21_15_56.896724480 path:481 - '**/details_harness|hendrycksTest-college_computer_science|5_2024-04-05T21-15-56.896724.parquet'482 - split: 2024_04_05T21_22_09.465979483 path:484 - '**/details_harness|hendrycksTest-college_computer_science|5_2024-04-05T21-22-09.465979.parquet'485 - split: latest486 path:487 - '**/details_harness|hendrycksTest-college_computer_science|5_2024-04-05T21-22-09.465979.parquet'488- config_name: harness_hendrycksTest_college_mathematics_5489 data_files:490 - split: 2024_04_05T21_15_56.896724491 path:492 - '**/details_harness|hendrycksTest-college_mathematics|5_2024-04-05T21-15-56.896724.parquet'493 - split: 2024_04_05T21_22_09.465979494 path:495 - '**/details_harness|hendrycksTest-college_mathematics|5_2024-04-05T21-22-09.465979.parquet'496 - split: latest497 path:498 - '**/details_harness|hendrycksTest-college_mathematics|5_2024-04-05T21-22-09.465979.parquet'499- config_name: harness_hendrycksTest_college_medicine_5500 data_files:501 - split: 2024_04_05T21_15_56.896724502 path:503 - '**/details_harness|hendrycksTest-college_medicine|5_2024-04-05T21-15-56.896724.parquet'504 - split: 2024_04_05T21_22_09.465979505 path:506 - '**/details_harness|hendrycksTest-college_medicine|5_2024-04-05T21-22-09.465979.parquet'507 - split: latest508 path:509 - '**/details_harness|hendrycksTest-college_medicine|5_2024-04-05T21-22-09.465979.parquet'510- config_name: harness_hendrycksTest_college_physics_5511 data_files:512 - split: 2024_04_05T21_15_56.896724513 path:514 - '**/details_harness|hendrycksTest-college_physics|5_2024-04-05T21-15-56.896724.parquet'515 - split: 2024_04_05T21_22_09.465979516 path:517 - '**/details_harness|hendrycksTest-college_physics|5_2024-04-05T21-22-09.465979.parquet'518 - split: latest519 path:520 - '**/details_harness|hendrycksTest-college_physics|5_2024-04-05T21-22-09.465979.parquet'521- config_name: harness_hendrycksTest_computer_security_5522 data_files:523 - split: 2024_04_05T21_15_56.896724524 path:525 - '**/details_harness|hendrycksTest-computer_security|5_2024-04-05T21-15-56.896724.parquet'526 - split: 2024_04_05T21_22_09.465979527 path:528 - '**/details_harness|hendrycksTest-computer_security|5_2024-04-05T21-22-09.465979.parquet'529 - split: latest530 path:531 - '**/details_harness|hendrycksTest-computer_security|5_2024-04-05T21-22-09.465979.parquet'532- config_name: harness_hendrycksTest_conceptual_physics_5533 data_files:534 - split: 2024_04_05T21_15_56.896724535 path:536 - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-04-05T21-15-56.896724.parquet'537 - split: 2024_04_05T21_22_09.465979538 path:539 - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-04-05T21-22-09.465979.parquet'540 - split: latest541 path:542 - '**/details_harness|hendrycksTest-conceptual_physics|5_2024-04-05T21-22-09.465979.parquet'543- config_name: harness_hendrycksTest_econometrics_5544 data_files:545 - split: 2024_04_05T21_15_56.896724546 path:547 - '**/details_harness|hendrycksTest-econometrics|5_2024-04-05T21-15-56.896724.parquet'548 - split: 2024_04_05T21_22_09.465979549 path:550 - '**/details_harness|hendrycksTest-econometrics|5_2024-04-05T21-22-09.465979.parquet'551 - split: latest552 path:553 - '**/details_harness|hendrycksTest-econometrics|5_2024-04-05T21-22-09.465979.parquet'554- config_name: harness_hendrycksTest_electrical_engineering_5555 data_files:556 - split: 2024_04_05T21_15_56.896724557 path:558 - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-04-05T21-15-56.896724.parquet'559 - split: 2024_04_05T21_22_09.465979560 path:561 - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-04-05T21-22-09.465979.parquet'562 - split: latest563 path:564 - '**/details_harness|hendrycksTest-electrical_engineering|5_2024-04-05T21-22-09.465979.parquet'565- config_name: harness_hendrycksTest_elementary_mathematics_5566 data_files:567 - split: 2024_04_05T21_15_56.896724568 path:569 - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-05T21-15-56.896724.parquet'570 - split: 2024_04_05T21_22_09.465979571 path:572 - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-05T21-22-09.465979.parquet'573 - split: latest574 path:575 - '**/details_harness|hendrycksTest-elementary_mathematics|5_2024-04-05T21-22-09.465979.parquet'576- config_name: harness_hendrycksTest_formal_logic_5577 data_files:578 - split: 2024_04_05T21_15_56.896724579 path:580 - '**/details_harness|hendrycksTest-formal_logic|5_2024-04-05T21-15-56.896724.parquet'581 - split: 2024_04_05T21_22_09.465979582 path:583 - '**/details_harness|hendrycksTest-formal_logic|5_2024-04-05T21-22-09.465979.parquet'584 - split: latest585 path:586 - '**/details_harness|hendrycksTest-formal_logic|5_2024-04-05T21-22-09.465979.parquet'587- config_name: harness_hendrycksTest_global_facts_5588 data_files:589 - split: 2024_04_05T21_15_56.896724590 path:591 - '**/details_harness|hendrycksTest-global_facts|5_2024-04-05T21-15-56.896724.parquet'592 - split: 2024_04_05T21_22_09.465979593 path:594 - '**/details_harness|hendrycksTest-global_facts|5_2024-04-05T21-22-09.465979.parquet'595 - split: latest596 path:597 - '**/details_harness|hendrycksTest-global_facts|5_2024-04-05T21-22-09.465979.parquet'598- config_name: harness_hendrycksTest_high_school_biology_5599 data_files:600 - split: 2024_04_05T21_15_56.896724601 path:602 - '**/details_harness|hendrycksTest-high_school_biology|5_2024-04-05T21-15-56.896724.parquet'603 - split: 2024_04_05T21_22_09.465979604 path:605 - '**/details_harness|hendrycksTest-high_school_biology|5_2024-04-05T21-22-09.465979.parquet'606 - split: latest607 path:608 - '**/details_harness|hendrycksTest-high_school_biology|5_2024-04-05T21-22-09.465979.parquet'609- config_name: harness_hendrycksTest_high_school_chemistry_5610 data_files:611 - split: 2024_04_05T21_15_56.896724612 path:613 - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-04-05T21-15-56.896724.parquet'614 - split: 2024_04_05T21_22_09.465979615 path:616 - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-04-05T21-22-09.465979.parquet'617 - split: latest618 path:619 - '**/details_harness|hendrycksTest-high_school_chemistry|5_2024-04-05T21-22-09.465979.parquet'620- config_name: harness_hendrycksTest_high_school_computer_science_5621 data_files:622 - split: 2024_04_05T21_15_56.896724623 path:624 - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-04-05T21-15-56.896724.parquet'625 - split: 2024_04_05T21_22_09.465979626 path:627 - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-04-05T21-22-09.465979.parquet'628 - split: latest629 path:630 - '**/details_harness|hendrycksTest-high_school_computer_science|5_2024-04-05T21-22-09.465979.parquet'631- config_name: harness_hendrycksTest_high_school_european_history_5632 data_files:633 - split: 2024_04_05T21_15_56.896724634 path:635 - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-04-05T21-15-56.896724.parquet'636 - split: 2024_04_05T21_22_09.465979637 path:638 - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-04-05T21-22-09.465979.parquet'639 - split: latest640 path:641 - '**/details_harness|hendrycksTest-high_school_european_history|5_2024-04-05T21-22-09.465979.parquet'642- config_name: harness_hendrycksTest_high_school_geography_5643 data_files:644 - split: 2024_04_05T21_15_56.896724645 path:646 - '**/details_harness|hendrycksTest-high_school_geography|5_2024-04-05T21-15-56.896724.parquet'647 - split: 2024_04_05T21_22_09.465979648 path:649 - '**/details_harness|hendrycksTest-high_school_geography|5_2024-04-05T21-22-09.465979.parquet'650 - split: latest651 path:652 - '**/details_harness|hendrycksTest-high_school_geography|5_2024-04-05T21-22-09.465979.parquet'653- config_name: harness_hendrycksTest_high_school_government_and_politics_5654 data_files:655 - split: 2024_04_05T21_15_56.896724656 path:657 - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-04-05T21-15-56.896724.parquet'658 - split: 2024_04_05T21_22_09.465979659 path:660 - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-04-05T21-22-09.465979.parquet'661 - split: latest662 path:663 - '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2024-04-05T21-22-09.465979.parquet'664- config_name: harness_hendrycksTest_high_school_macroeconomics_5665 data_files:666 - split: 2024_04_05T21_15_56.896724667 path:668 - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-04-05T21-15-56.896724.parquet'669 - split: 2024_04_05T21_22_09.465979670 path:671 - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-04-05T21-22-09.465979.parquet'672 - split: latest673 path:674 - '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2024-04-05T21-22-09.465979.parquet'675- config_name: harness_hendrycksTest_high_school_mathematics_5676 data_files:677 - split: 2024_04_05T21_15_56.896724678 path:679 - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-04-05T21-15-56.896724.parquet'680 - split: 2024_04_05T21_22_09.465979681 path:682 - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-04-05T21-22-09.465979.parquet'683 - split: latest684 path:685 - '**/details_harness|hendrycksTest-high_school_mathematics|5_2024-04-05T21-22-09.465979.parquet'686- config_name: harness_hendrycksTest_high_school_microeconomics_5687 data_files:688 - split: 2024_04_05T21_15_56.896724689 path:690 - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-04-05T21-15-56.896724.parquet'691 - split: 2024_04_05T21_22_09.465979692 path:693 - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-04-05T21-22-09.465979.parquet'694 - split: latest695 path:696 - '**/details_harness|hendrycksTest-high_school_microeconomics|5_2024-04-05T21-22-09.465979.parquet'697- config_name: harness_hendrycksTest_high_school_physics_5698 data_files:699 - split: 2024_04_05T21_15_56.896724700 path:701 - '**/details_harness|hendrycksTest-high_school_physics|5_2024-04-05T21-15-56.896724.parquet'702 - split: 2024_04_05T21_22_09.465979703 path:704 - '**/details_harness|hendrycksTest-high_school_physics|5_2024-04-05T21-22-09.465979.parquet'705 - split: latest706 path:707 - '**/details_harness|hendrycksTest-high_school_physics|5_2024-04-05T21-22-09.465979.parquet'708- config_name: harness_hendrycksTest_high_school_psychology_5709 data_files:710 - split: 2024_04_05T21_15_56.896724711 path:712 - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-04-05T21-15-56.896724.parquet'713 - split: 2024_04_05T21_22_09.465979714 path:715 - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-04-05T21-22-09.465979.parquet'716 - split: latest717 path:718 - '**/details_harness|hendrycksTest-high_school_psychology|5_2024-04-05T21-22-09.465979.parquet'719- config_name: harness_hendrycksTest_high_school_statistics_5720 data_files:721 - split: 2024_04_05T21_15_56.896724722 path:723 - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-04-05T21-15-56.896724.parquet'724 - split: 2024_04_05T21_22_09.465979725 path:726 - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-04-05T21-22-09.465979.parquet'727 - split: latest728 path:729 - '**/details_harness|hendrycksTest-high_school_statistics|5_2024-04-05T21-22-09.465979.parquet'730- config_name: harness_hendrycksTest_high_school_us_history_5731 data_files:732 - split: 2024_04_05T21_15_56.896724733 path:734 - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-04-05T21-15-56.896724.parquet'735 - split: 2024_04_05T21_22_09.465979736 path:737 - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-04-05T21-22-09.465979.parquet'738 - split: latest739 path:740 - '**/details_harness|hendrycksTest-high_school_us_history|5_2024-04-05T21-22-09.465979.parquet'741- config_name: harness_hendrycksTest_high_school_world_history_5742 data_files:743 - split: 2024_04_05T21_15_56.896724744 path:745 - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-04-05T21-15-56.896724.parquet'746 - split: 2024_04_05T21_22_09.465979747 path:748 - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-04-05T21-22-09.465979.parquet'749 - split: latest750 path:751 - '**/details_harness|hendrycksTest-high_school_world_history|5_2024-04-05T21-22-09.465979.parquet'752- config_name: harness_hendrycksTest_human_aging_5753 data_files:754 - split: 2024_04_05T21_15_56.896724755 path:756 - '**/details_harness|hendrycksTest-human_aging|5_2024-04-05T21-15-56.896724.parquet'757 - split: 2024_04_05T21_22_09.465979758 path:759 - '**/details_harness|hendrycksTest-human_aging|5_2024-04-05T21-22-09.465979.parquet'760 - split: latest761 path:762 - '**/details_harness|hendrycksTest-human_aging|5_2024-04-05T21-22-09.465979.parquet'763- config_name: harness_hendrycksTest_human_sexuality_5764 data_files:765 - split: 2024_04_05T21_15_56.896724766 path:767 - '**/details_harness|hendrycksTest-human_sexuality|5_2024-04-05T21-15-56.896724.parquet'768 - split: 2024_04_05T21_22_09.465979769 path:770 - '**/details_harness|hendrycksTest-human_sexuality|5_2024-04-05T21-22-09.465979.parquet'771 - split: latest772 path:773 - '**/details_harness|hendrycksTest-human_sexuality|5_2024-04-05T21-22-09.465979.parquet'774- config_name: harness_hendrycksTest_international_law_5775 data_files:776 - split: 2024_04_05T21_15_56.896724777 path:778 - '**/details_harness|hendrycksTest-international_law|5_2024-04-05T21-15-56.896724.parquet'779 - split: 2024_04_05T21_22_09.465979780 path:781 - '**/details_harness|hendrycksTest-international_law|5_2024-04-05T21-22-09.465979.parquet'782 - split: latest783 path:784 - '**/details_harness|hendrycksTest-international_law|5_2024-04-05T21-22-09.465979.parquet'785- config_name: harness_hendrycksTest_jurisprudence_5786 data_files:787 - split: 2024_04_05T21_15_56.896724788 path:789 - '**/details_harness|hendrycksTest-jurisprudence|5_2024-04-05T21-15-56.896724.parquet'790 - split: 2024_04_05T21_22_09.465979791 path:792 - '**/details_harness|hendrycksTest-jurisprudence|5_2024-04-05T21-22-09.465979.parquet'793 - split: latest794 path:795 - '**/details_harness|hendrycksTest-jurisprudence|5_2024-04-05T21-22-09.465979.parquet'796- config_name: harness_hendrycksTest_logical_fallacies_5797 data_files:798 - split: 2024_04_05T21_15_56.896724799 path:800 - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-04-05T21-15-56.896724.parquet'801 - split: 2024_04_05T21_22_09.465979802 path:803 - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-04-05T21-22-09.465979.parquet'804 - split: latest805 path:806 - '**/details_harness|hendrycksTest-logical_fallacies|5_2024-04-05T21-22-09.465979.parquet'807- config_name: harness_hendrycksTest_machine_learning_5808 data_files:809 - split: 2024_04_05T21_15_56.896724810 path:811 - '**/details_harness|hendrycksTest-machine_learning|5_2024-04-05T21-15-56.896724.parquet'812 - split: 2024_04_05T21_22_09.465979813 path:814 - '**/details_harness|hendrycksTest-machine_learning|5_2024-04-05T21-22-09.465979.parquet'815 - split: latest816 path:817 - '**/details_harness|hendrycksTest-machine_learning|5_2024-04-05T21-22-09.465979.parquet'818- config_name: harness_hendrycksTest_management_5819 data_files:820 - split: 2024_04_05T21_15_56.896724821 path:822 - '**/details_harness|hendrycksTest-management|5_2024-04-05T21-15-56.896724.parquet'823 - split: 2024_04_05T21_22_09.465979824 path:825 - '**/details_harness|hendrycksTest-management|5_2024-04-05T21-22-09.465979.parquet'826 - split: latest827 path:828 - '**/details_harness|hendrycksTest-management|5_2024-04-05T21-22-09.465979.parquet'829- config_name: harness_hendrycksTest_marketing_5830 data_files:831 - split: 2024_04_05T21_15_56.896724832 path:833 - '**/details_harness|hendrycksTest-marketing|5_2024-04-05T21-15-56.896724.parquet'834 - split: 2024_04_05T21_22_09.465979835 path:836 - '**/details_harness|hendrycksTest-marketing|5_2024-04-05T21-22-09.465979.parquet'837 - split: latest838 path:839 - '**/details_harness|hendrycksTest-marketing|5_2024-04-05T21-22-09.465979.parquet'840- config_name: harness_hendrycksTest_medical_genetics_5841 data_files:842 - split: 2024_04_05T21_15_56.896724843 path:844 - '**/details_harness|hendrycksTest-medical_genetics|5_2024-04-05T21-15-56.896724.parquet'845 - split: 2024_04_05T21_22_09.465979846 path:847 - '**/details_harness|hendrycksTest-medical_genetics|5_2024-04-05T21-22-09.465979.parquet'848 - split: latest849 path:850 - '**/details_harness|hendrycksTest-medical_genetics|5_2024-04-05T21-22-09.465979.parquet'851- config_name: harness_hendrycksTest_miscellaneous_5852 data_files:853 - split: 2024_04_05T21_15_56.896724854 path:855 - '**/details_harness|hendrycksTest-miscellaneous|5_2024-04-05T21-15-56.896724.parquet'856 - split: 2024_04_05T21_22_09.465979857 path:858 - '**/details_harness|hendrycksTest-miscellaneous|5_2024-04-05T21-22-09.465979.parquet'859 - split: latest860 path:861 - '**/details_harness|hendrycksTest-miscellaneous|5_2024-04-05T21-22-09.465979.parquet'862- config_name: harness_hendrycksTest_moral_disputes_5863 data_files:864 - split: 2024_04_05T21_15_56.896724865 path:866 - '**/details_harness|hendrycksTest-moral_disputes|5_2024-04-05T21-15-56.896724.parquet'867 - split: 2024_04_05T21_22_09.465979868 path:869 - '**/details_harness|hendrycksTest-moral_disputes|5_2024-04-05T21-22-09.465979.parquet'870 - split: latest871 path:872 - '**/details_harness|hendrycksTest-moral_disputes|5_2024-04-05T21-22-09.465979.parquet'873- config_name: harness_hendrycksTest_moral_scenarios_5874 data_files:875 - split: 2024_04_05T21_15_56.896724876 path:877 - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-04-05T21-15-56.896724.parquet'878 - split: 2024_04_05T21_22_09.465979879 path:880 - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-04-05T21-22-09.465979.parquet'881 - split: latest882 path:883 - '**/details_harness|hendrycksTest-moral_scenarios|5_2024-04-05T21-22-09.465979.parquet'884- config_name: harness_hendrycksTest_nutrition_5885 data_files:886 - split: 2024_04_05T21_15_56.896724887 path:888 - '**/details_harness|hendrycksTest-nutrition|5_2024-04-05T21-15-56.896724.parquet'889 - split: 2024_04_05T21_22_09.465979890 path:891 - '**/details_harness|hendrycksTest-nutrition|5_2024-04-05T21-22-09.465979.parquet'892 - split: latest893 path:894 - '**/details_harness|hendrycksTest-nutrition|5_2024-04-05T21-22-09.465979.parquet'895- config_name: harness_hendrycksTest_philosophy_5896 data_files:897 - split: 2024_04_05T21_15_56.896724898 path:899 - '**/details_harness|hendrycksTest-philosophy|5_2024-04-05T21-15-56.896724.parquet'900 - split: 2024_04_05T21_22_09.465979901 path:902 - '**/details_harness|hendrycksTest-philosophy|5_2024-04-05T21-22-09.465979.parquet'903 - split: latest904 path:905 - '**/details_harness|hendrycksTest-philosophy|5_2024-04-05T21-22-09.465979.parquet'906- config_name: harness_hendrycksTest_prehistory_5907 data_files:908 - split: 2024_04_05T21_15_56.896724909 path:910 - '**/details_harness|hendrycksTest-prehistory|5_2024-04-05T21-15-56.896724.parquet'911 - split: 2024_04_05T21_22_09.465979912 path:913 - '**/details_harness|hendrycksTest-prehistory|5_2024-04-05T21-22-09.465979.parquet'914 - split: latest915 path:916 - '**/details_harness|hendrycksTest-prehistory|5_2024-04-05T21-22-09.465979.parquet'917- config_name: harness_hendrycksTest_professional_accounting_5918 data_files:919 - split: 2024_04_05T21_15_56.896724920 path:921 - '**/details_harness|hendrycksTest-professional_accounting|5_2024-04-05T21-15-56.896724.parquet'922 - split: 2024_04_05T21_22_09.465979923 path:924 - '**/details_harness|hendrycksTest-professional_accounting|5_2024-04-05T21-22-09.465979.parquet'925 - split: latest926 path:927 - '**/details_harness|hendrycksTest-professional_accounting|5_2024-04-05T21-22-09.465979.parquet'928- config_name: harness_hendrycksTest_professional_law_5929 data_files:930 - split: 2024_04_05T21_15_56.896724931 path:932 - '**/details_harness|hendrycksTest-professional_law|5_2024-04-05T21-15-56.896724.parquet'933 - split: 2024_04_05T21_22_09.465979934 path:935 - '**/details_harness|hendrycksTest-professional_law|5_2024-04-05T21-22-09.465979.parquet'936 - split: latest937 path:938 - '**/details_harness|hendrycksTest-professional_law|5_2024-04-05T21-22-09.465979.parquet'939- config_name: harness_hendrycksTest_professional_medicine_5940 data_files:941 - split: 2024_04_05T21_15_56.896724942 path:943 - '**/details_harness|hendrycksTest-professional_medicine|5_2024-04-05T21-15-56.896724.parquet'944 - split: 2024_04_05T21_22_09.465979945 path:946 - '**/details_harness|hendrycksTest-professional_medicine|5_2024-04-05T21-22-09.465979.parquet'947 - split: latest948 path:949 - '**/details_harness|hendrycksTest-professional_medicine|5_2024-04-05T21-22-09.465979.parquet'950- config_name: harness_hendrycksTest_professional_psychology_5951 data_files:952 - split: 2024_04_05T21_15_56.896724953 path:954 - '**/details_harness|hendrycksTest-professional_psychology|5_2024-04-05T21-15-56.896724.parquet'955 - split: 2024_04_05T21_22_09.465979956 path:957 - '**/details_harness|hendrycksTest-professional_psychology|5_2024-04-05T21-22-09.465979.parquet'958 - split: latest959 path:960 - '**/details_harness|hendrycksTest-professional_psychology|5_2024-04-05T21-22-09.465979.parquet'961- config_name: harness_hendrycksTest_public_relations_5962 data_files:963 - split: 2024_04_05T21_15_56.896724964 path:965 - '**/details_harness|hendrycksTest-public_relations|5_2024-04-05T21-15-56.896724.parquet'966 - split: 2024_04_05T21_22_09.465979967 path:968 - '**/details_harness|hendrycksTest-public_relations|5_2024-04-05T21-22-09.465979.parquet'969 - split: latest970 path:971 - '**/details_harness|hendrycksTest-public_relations|5_2024-04-05T21-22-09.465979.parquet'972- config_name: harness_hendrycksTest_security_studies_5973 data_files:974 - split: 2024_04_05T21_15_56.896724975 path:976 - '**/details_harness|hendrycksTest-security_studies|5_2024-04-05T21-15-56.896724.parquet'977 - split: 2024_04_05T21_22_09.465979978 path:979 - '**/details_harness|hendrycksTest-security_studies|5_2024-04-05T21-22-09.465979.parquet'980 - split: latest981 path:982 - '**/details_harness|hendrycksTest-security_studies|5_2024-04-05T21-22-09.465979.parquet'983- config_name: harness_hendrycksTest_sociology_5984 data_files:985 - split: 2024_04_05T21_15_56.896724986 path:987 - '**/details_harness|hendrycksTest-sociology|5_2024-04-05T21-15-56.896724.parquet'988 - split: 2024_04_05T21_22_09.465979989 path:990 - '**/details_harness|hendrycksTest-sociology|5_2024-04-05T21-22-09.465979.parquet'991 - split: latest992 path:993 - '**/details_harness|hendrycksTest-sociology|5_2024-04-05T21-22-09.465979.parquet'994- config_name: harness_hendrycksTest_us_foreign_policy_5995 data_files:996 - split: 2024_04_05T21_15_56.896724997 path:998 - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-04-05T21-15-56.896724.parquet'999 - split: 2024_04_05T21_22_09.4659791000 path:1001 - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-04-05T21-22-09.465979.parquet'1002 - split: latest1003 path:1004 - '**/details_harness|hendrycksTest-us_foreign_policy|5_2024-04-05T21-22-09.465979.parquet'1005- config_name: harness_hendrycksTest_virology_51006 data_files:1007 - split: 2024_04_05T21_15_56.8967241008 path:1009 - '**/details_harness|hendrycksTest-virology|5_2024-04-05T21-15-56.896724.parquet'1010 - split: 2024_04_05T21_22_09.4659791011 path:1012 - '**/details_harness|hendrycksTest-virology|5_2024-04-05T21-22-09.465979.parquet'1013 - split: latest1014 path:1015 - '**/details_harness|hendrycksTest-virology|5_2024-04-05T21-22-09.465979.parquet'1016- config_name: harness_hendrycksTest_world_religions_51017 data_files:1018 - split: 2024_04_05T21_15_56.8967241019 path:1020 - '**/details_harness|hendrycksTest-world_religions|5_2024-04-05T21-15-56.896724.parquet'1021 - split: 2024_04_05T21_22_09.4659791022 path:1023 - '**/details_harness|hendrycksTest-world_religions|5_2024-04-05T21-22-09.465979.parquet'1024 - split: latest1025 path:1026 - '**/details_harness|hendrycksTest-world_religions|5_2024-04-05T21-22-09.465979.parquet'1027- config_name: harness_truthfulqa_mc_01028 data_files:1029 - split: 2024_04_05T21_15_56.8967241030 path:1031 - '**/details_harness|truthfulqa:mc|0_2024-04-05T21-15-56.896724.parquet'1032 - split: 2024_04_05T21_22_09.4659791033 path:1034 - '**/details_harness|truthfulqa:mc|0_2024-04-05T21-22-09.465979.parquet'1035 - split: latest1036 path:1037 - '**/details_harness|truthfulqa:mc|0_2024-04-05T21-22-09.465979.parquet'1038- config_name: harness_winogrande_51039 data_files:1040 - split: 2024_04_05T21_15_56.8967241041 path:1042 - '**/details_harness|winogrande|5_2024-04-05T21-15-56.896724.parquet'1043 - split: 2024_04_05T21_22_09.4659791044 path:1045 - '**/details_harness|winogrande|5_2024-04-05T21-22-09.465979.parquet'1046 - split: latest1047 path:1048 - '**/details_harness|winogrande|5_2024-04-05T21-22-09.465979.parquet'1049- config_name: results1050 data_files:1051 - split: 2024_04_05T21_15_56.8967241052 path:1053 - results_2024-04-05T21-15-56.896724.parquet1054 - split: 2024_04_05T21_22_09.4659791055 path:1056 - results_2024-04-05T21-22-09.465979.parquet1057 - split: latest1058 path:1059 - results_2024-04-05T21-22-09.465979.parquet1060---1061 1062# Dataset Card for Evaluation run of Josephgflowers/Tinyllama-1.5B-Cinder-Test-21063 1064<!-- Provide a quick summary of the dataset. -->1065 1066Dataset automatically created during the evaluation run of model [Josephgflowers/Tinyllama-1.5B-Cinder-Test-2](https://huggingface.co/Josephgflowers/Tinyllama-1.5B-Cinder-Test-2) on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).1067 1068The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.1069 1070The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.1071 1072An additional configuration "results" store all the aggregated results of the run (and is used to compute and display the aggregated metrics on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).1073 1074To load the details from a run, you can for instance do the following:1075```python1076from datasets import load_dataset1077data = load_dataset("open-llm-leaderboard/details_Josephgflowers__Tinyllama-1.5B-Cinder-Test-2",1078 "harness_winogrande_5",1079 split="train")1080```1081 1082## Latest results1083 1084These are the [latest results from run 2024-04-05T21:22:09.465979](https://huggingface.co/datasets/open-llm-leaderboard/details_Josephgflowers__Tinyllama-1.5B-Cinder-Test-2/blob/main/results_2024-04-05T21-22-09.465979.json)(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):1085 1086```python1087{1088 "all": {1089 "acc": 0.2705480629693628,1090 "acc_stderr": 0.031211817677101388,1091 "acc_norm": 0.2722219261351411,1092 "acc_norm_stderr": 0.03204316052559818,1093 "mc1": 0.24112607099143207,1094 "mc1_stderr": 0.01497482727975233,1095 "mc2": 0.4055707932475926,1096 "mc2_stderr": 0.0147349250502377441097 },1098 "harness|arc:challenge|25": {1099 "acc": 0.32337883959044367,1100 "acc_stderr": 0.01366942163001213,1101 "acc_norm": 0.35494880546075086,1102 "acc_norm_stderr": 0.0139830369040940921103 },1104 "harness|hellaswag|10": {1105 "acc": 0.39693288189603665,1106 "acc_stderr": 0.004882619484166598,1107 "acc_norm": 0.5189205337582155,1108 "acc_norm_stderr": 0.0049862075818629461109 },1110 "harness|hendrycksTest-abstract_algebra|5": {1111 "acc": 0.23,1112 "acc_stderr": 0.04229525846816507,1113 "acc_norm": 0.23,1114 "acc_norm_stderr": 0.042295258468165071115 },1116 "harness|hendrycksTest-anatomy|5": {1117 "acc": 0.3333333333333333,1118 "acc_stderr": 0.04072314811876837,1119 "acc_norm": 0.3333333333333333,1120 "acc_norm_stderr": 0.040723148118768371121 },1122 "harness|hendrycksTest-astronomy|5": {1123 "acc": 0.25,1124 "acc_stderr": 0.03523807393012047,1125 "acc_norm": 0.25,1126 "acc_norm_stderr": 0.035238073930120471127 },1128 "harness|hendrycksTest-business_ethics|5": {1129 "acc": 0.29,1130 "acc_stderr": 0.045604802157206845,1131 "acc_norm": 0.29,1132 "acc_norm_stderr": 0.0456048021572068451133 },1134 "harness|hendrycksTest-clinical_knowledge|5": {1135 "acc": 0.28679245283018867,1136 "acc_stderr": 0.02783491252754408,1137 "acc_norm": 0.28679245283018867,1138 "acc_norm_stderr": 0.027834912527544081139 },1140 "harness|hendrycksTest-college_biology|5": {1141 "acc": 0.24305555555555555,1142 "acc_stderr": 0.03586879280080342,1143 "acc_norm": 0.24305555555555555,1144 "acc_norm_stderr": 0.035868792800803421145 },1146 "harness|hendrycksTest-college_chemistry|5": {1147 "acc": 0.25,1148 "acc_stderr": 0.04351941398892446,1149 "acc_norm": 0.25,1150 "acc_norm_stderr": 0.043519413988924461151 },1152 "harness|hendrycksTest-college_computer_science|5": {1153 "acc": 0.32,1154 "acc_stderr": 0.046882617226215034,1155 "acc_norm": 0.32,1156 "acc_norm_stderr": 0.0468826172262150341157 },1158 "harness|hendrycksTest-college_mathematics|5": {1159 "acc": 0.25,1160 "acc_stderr": 0.04351941398892446,1161 "acc_norm": 0.25,1162 "acc_norm_stderr": 0.043519413988924461163 },1164 "harness|hendrycksTest-college_medicine|5": {1165 "acc": 0.21965317919075145,1166 "acc_stderr": 0.031568093627031744,1167 "acc_norm": 0.21965317919075145,1168 "acc_norm_stderr": 0.0315680936270317441169 },1170 "harness|hendrycksTest-college_physics|5": {1171 "acc": 0.21568627450980393,1172 "acc_stderr": 0.04092563958237654,1173 "acc_norm": 0.21568627450980393,1174 "acc_norm_stderr": 0.040925639582376541175 },1176 "harness|hendrycksTest-computer_security|5": {1177 "acc": 0.21,1178 "acc_stderr": 0.04093601807403326,1179 "acc_norm": 0.21,1180 "acc_norm_stderr": 0.040936018074033261181 },1182 "harness|hendrycksTest-conceptual_physics|5": {1183 "acc": 0.2680851063829787,1184 "acc_stderr": 0.02895734278834235,1185 "acc_norm": 0.2680851063829787,1186 "acc_norm_stderr": 0.028957342788342351187 },1188 "harness|hendrycksTest-econometrics|5": {1189 "acc": 0.2982456140350877,1190 "acc_stderr": 0.04303684033537315,1191 "acc_norm": 0.2982456140350877,1192 "acc_norm_stderr": 0.043036840335373151193 },1194 "harness|hendrycksTest-electrical_engineering|5": {1195 "acc": 0.23448275862068965,1196 "acc_stderr": 0.035306258743465914,1197 "acc_norm": 0.23448275862068965,1198 "acc_norm_stderr": 0.0353062587434659141199 },1200 "harness|hendrycksTest-elementary_mathematics|5": {