CoolFace
Datasetpublic

MinghuiXu/countdown_fresh_heldout_1024

Countdown Fresh Held-Out 1024 This dataset contains 1,024 fresh held-out Countdown arithmetic problems for evaluating language models on the 3-to-4 number Countdown task. Each problem provides a target integer and a list of 3 or 4 numbers. A model must construct an arithmetic expression using each number at most once and the basic operations +, -, *, and / to equal the target. Files standard/test.parquet: prompts for standard no-tool evaluation.… See the full description on the dataset page: https://huggingface.co/datasets/MinghuiXu/countdown_fresh_heldout_1024.

sourceHugging Facemitupdated 4mo agoView on Hugging Face
0likes22downloads
3 commits on main
a34d2904mo ago

Remove notebook checkpoint

MinghuiXu
f57f8f64mo ago

Add 1024 fresh held-out Countdown benchmark

MinghuiXu
91b2bde4mo ago

initial commit

MinghuiXu