BlazingCustoms/pybytecode-mbpp-3.12
Data card — MBPP held-out decompilation benchmark 383 MBPP reference solutions compiled to Python 3.12 bytecode and paired with their source, with the original task_id restored on every row. Built 2026-08-04 by tools/build_mbpp_ood.py. Redistributable under CC-BY-4.0, provided NOTICES.md ships alongside. The set Rows 383 (400 candidates − 17 contaminated) Source google-research-datasets/mbpp, config full Licence CC-BY-4.0 task_id restored 383 /… See the full description on the dataset page: https://huggingface.co/datasets/BlazingCustoms/pybytecode-mbpp-3.12.
0479
1{2 "in": 400,3 "kept": 383,4 "drop_untraceable": 0,5 "drop_compile": 0,6 "drop_contaminated_exact": 0,7 "drop_contaminated_fingerprint": 17,8 "task_ids_restored": 383,9 "task_id_min": 11,10 "task_id_max": 973,11 "distinct_task_ids": 38312}