namanbnsl/rosettabench-150-stratified-compressed
About Dataset Why? Used for RosettaBench (A contamination-free benchmark for measuring learning, not memorization). Preparation Source: LiveCodeBench (release_v5, AtCoder platform only), accessed via sam-paech/livecodebench-code_generation_lite on Hugging Face. AtCoder problems were selected for platform consistency and STDIN/STDOUT format compatibility. Problems with fewer than 3 test cases were excluded, leaving a pool of 342 problems. Sampling:… See the full description on the dataset page: https://huggingface.co/datasets/namanbnsl/rosettabench-150-stratified-compressed.
About Dataset
Why?
Used for RosettaBench (A contamination-free benchmark for measuring learning, not memorization).
Preparation
Source: LiveCodeBench (release_v5, AtCoder platform only), accessed via sam-paech/livecodebench-code_generation_lite on Hugging Face.
AtCoder problems were selected for platform consistency and STDIN/STDOUT format compatibility. Problems with fewer than 3 test cases were excluded, leaving a pool of 342 problems.
Sampling: 150 problems sampled with random_state=42 using stratified sampling across difficulty tiers.
Avg test cases per problem: 3.2 (min: 3, max: 6).