datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ProgramBench-Tests
ProgramBench Generated Tests
This dataset contains the AI-generated behavioral test suites used to evaluate model solutions in ProgramBench.
ProgramBench is a benchmark that evaluates whether language models can rebuild programs from scratch. Given only a compiled binary and its documentation, AI agents must architect and implement a complete codebase that reproduces the original program's behavior. These test suites are used to assess whether a candidate solution is behaviorally… See the full description on the dataset page: https://huggingface.co/datasets/programbench/ProgramBench-Tests.datasets-tests-compressiontests-raw-jsonldatatrove-testsDatasets used for datatrove testing.
Each split contains the same data:
dst = [
{"text": "hello"},
{"text": "world"},
{"text": "how"},
{"text": "are"},
{"text": "you"},
]
But based on the split name the data are sharded into n-bins
c4-10k-mini-tokenized-16-ctx-gelu-1l-testsdataset-test-1IfEvalCode-testsetmask-for-image-segmentation-testsSpatialLM-Testset
SpatialLM Testset
Project page | Paper | Code
We provide a test set of 107 preprocessed point clouds and their corresponding GT layouts, point clouds are reconstructed from RGB videos using MASt3R-SLAM. SpatialLM-Testset is quite challenging compared to prior clean RGBD scan datasets due to the noises and occlusions in the point clouds reconstructed from monocular RGB videos.
Folder Structure
Outlines of the dataset files:… See the full description on the dataset page: https://huggingface.co/datasets/manycore-research/SpatialLM-Testset.Easy-Turn-Testset
Easy Turn: Integrating Acoustic and Linguistic Modalities for Robust Turn-Taking in Full-Duplex Spoken Dialogue Systems
Guojian Li1, Chengyou Wang1, Hongfei Xue1,
Shuiyuan Wang1, Dehui Gao1, Zihan Zhang2,
Yuke Lin2, Wenjie Li2, Longshuai Xiao2,
Zhonghua Fu1,╀, Lei Xie1,╀
1 Audio, Speech and Language Processing Group (ASLP@NPU), Northwestern Polytechnical University
2 Huawei Technologies, China
🎤 Demo Page
🤖 Easy Turn Model
📑 Paper
🌐 Huggingface… See the full description on the dataset page: https://huggingface.co/datasets/ASLP-lab/Easy-Turn-Testset.backendbench_tests
TorchBench
The TorchBench suite of BackendBench is designed to mimic real-world use cases. It provides operators and inputs derived from 155 model traces found in TIMM (67), Hugging Face Transformers (45), and TorchBench (43). (These are also the models PyTorch developers use to validate performance.) You can view the origin of these traces by switching the subset in the dataset viewer to ops_traces_models and torchbench for the full dataset.
When running BackendBench, much of the… See the full description on the dataset page: https://huggingface.co/datasets/GPUMODE/backendbench_tests.vindr-cxr-testsettestsduckdb_ci_teststest_sr_lmbattery-tests-cfo-analysis
Battery-test CFO analysis
This folder contains the all-packet CFO fingerprints, statistics, and plots for
all ten Morty battery experiments (10% through 100%). Source H5 recordings were
read without modification. The estimator reuses
CSE237D_weyl\pipeline\parallel_h5_cfo_all_packets.py.
Start with summary\all_packets\ALL_PACKETS_RESULTS.md for the consolidated
index. Each experiment has:
all_packets_cfo\packet_cfo_all_fingerprints.csv — every assigned packet.… See the full description on the dataset page: https://huggingface.co/datasets/Morty0311/battery-tests-cfo-analysis.hardtests_tests
Dataset Card for HARDTESTS Tests
HARDTESTS Tests is the test suite of HARDTESTS, a competitive programming dataset. The dataset contains multiple .parquet files. Each instance contains structured test case objects for one problem. This dataset is presented in the paper HardTests: Synthesizing High-Quality Test Cases for LLM Coding.
Project Page
Data Summary
The test suite is generated using the HARDTESTSGEN pipeline.
The dataset contains the generated test suites of… See the full description on the dataset page: https://huggingface.co/datasets/sigcp/hardtests_tests.repo2rlenv-equivalence-tests
repo2rlenv-equivalence-tests
Generated by Repo2RLEnv — turning real GitHub repositories into verifiable RL environments.
💡 Browse this dataset in your browser — click the badge above or open
HuggingFaceH4/harbor-visualiser
to inspect every task's spec, instruction, oracle patch, test script, and Dockerfile.
Source repos (7):
Suor/funcy
hjson/hjson-py
mahmoud/boltons
more-itertools/more-itertools
pygments/pygments
pytoolz/toolz
sympy/sympy
Pipeline: equivalence_tests… See the full description on the dataset page: https://huggingface.co/datasets/AdithyaSK/repo2rlenv-equivalence-tests.test_sample_1000THCHS-30-tests
THCHS-30 Test Set
THCHS-30 test split for Mandarin Chinese speech recognition benchmarking.
Dataset Info
Language: Mandarin Chinese (zh-CN)
Samples: 2,495
Speakers: 10
Sample Rate: 16 kHz
License: Apache 2.0
Usage
from datasets import load_dataset
# After uploading to HuggingFace
dataset = load_dataset("your-username/thchs30-test")
# Example
print(dataset['train'][0])
# {
# 'audio': {'array': [...], 'sampling_rate': 16000, 'path': 'audio/D11_750.wav'},
#… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/THCHS-30-tests.video-SALMONN_2_testset
video-SALMONN 2 Benchmark
Generate the caption corresponding to the video and the audio with video_salmonn2_test.json
Organize your results in the format like the following example:
[
{
"id": ["0.mp4"],
"pred": "Generated Caption"
}
]
Replace res_file in eval.py with your result file.
Run python3 eval.pyvideo-SALMONN_2_testset
video-SALMONN 2 Benchmark
Github Link
Paper Link
Generate the caption corresponding to the video and the audio with video_salmonn2_test.json
Organize your results in the format like the following example:
[
{
"id": ["0.mp4"],
"pred": "Generated Caption"
}
]
Replace res_file in eval.py with your result file.
Run python3 eval.py
test-sync-commentsStableSR-TestSets
StableSR TestSets Card
These test sets are used associated with the StableSR, available here.
Data Details
Developed by: Jianyi Wang
Data type: Synthetic and real-world test sets for image super-resolution
License: S-Lab License 1.0
Data Description: The test sets are used to reproduce the metric results shown in Paper.
Resources for more information: GitHub Repository.
Cite as:
@InProceedings{wang2023exploiting,
author = {Wang, Jianyi and Yue, Zongsheng and… See the full description on the dataset page: https://huggingface.co/datasets/Iceclear/StableSR-TestSets.SpatialGen-Testset
SpatialGen Testset
This repository contains the test set for SPATIALGEN: Layout-guided 3D Indoor Scene Generation, a novel multi-view multi-modal diffusion model for generating realistic and semantically consistent 3D indoor scenes.
Project page | Paper | Code
We provide a test set of 48 preprocessed point clouds and their corresponding GT layouts, multi-view images are cropped from the high-resolution panoramic images.
Folder Structure
Outlines of the dataset files:… See the full description on the dataset page: https://huggingface.co/datasets/manycore-research/SpatialGen-Testset.swesmith-sandboxes-with_teststorchani-tests-pickled-filestestset_popqatest-sciencetestset_piqa