datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
details_bigcode__gpt_bigcode-santacoder
Dataset Card for Evaluation run of bigcode/gpt_bigcode-santacoder
Dataset Summary
Dataset automatically created during the evaluation run of model bigcode/gpt_bigcode-santacoder on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_bigcode__gpt_bigcode-santacoder.bigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att10_sol5_debugbigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att20_sol5_fixed_filteredbigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att10_sol5_v1_dpo_2000bigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att10_sol5_v1_dpo_2800bigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att10_sol5bigcodebench-complete_qwen32b_gpt-4o-mini_att_iter0_att10_sol5_debugbigcodebench-complete_qwen7b_gpt-4o-mini_att_iter1_att10_sol5_dpo_10000bigcodebench-complete_qwen7b_gpt-4o-mini_att_iter1_att10_sol5bigcodebench-complete_qwen7b_gpt-4o-mini_att_iter1_att10_sol5_dpo_5000bigcodebench_complete_att_iter0_qwen7b_gpt-4o-mini_att10_sol1_solved_problemsbigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att20_sol5_fixed_solved_problemsbigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att10_sol5_v1gpt-4o-mini_bigcodebench_complete_unsolved_bugsbigcodebench-complete_qwen7b_gpt-4o-mini_base_att20_sol5_fixed_consistencybigcodebench-complete_qwen32b_gpt-4o-mini_att_iter0_att20_sol5_fixedbigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att20_sol5_fixedbigcodebench_complete_att_iter0_qwen7b_gpt-4o-mini_att10_sol1bigcodebench-complete_qwen7b_gpt-4o-mini_att_iter0_att20_sol5_fixed_filtered_solved_problemsbigcodebench_complete_gpt-4o-mini_sol_best_of_1gpt-4o-mini_bigcodebench-complete_solved_bugs
