tests
Datasets
All datasets matching “tests”ProgramBench-Tests
ProgramBench Generated Tests
This dataset contains the AI-generated behavioral test suites used to evaluate model solutions in ProgramBench.
ProgramBench is a benchmark that evaluates whether language models can rebuild programs from scratch. Given only a compiled binary and its documentation, AI agents must architect and implement a complete codebase that reproduces the original program's behavior. These test suites are used to assess whether a candidate solution is behaviorally… See the full description on the dataset page: https://huggingface.co/datasets/programbench/ProgramBench-Tests.datasets-tests-compressiontests-raw-jsonldatatrove-testsDatasets used for datatrove testing.
Each split contains the same data:
dst = [
{"text": "hello"},
{"text": "world"},
{"text": "how"},
{"text": "are"},
{"text": "you"},
]
But based on the split name the data are sharded into n-bins
c4-10k-mini-tokenized-16-ctx-gelu-1l-testsdataset-test-1