datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
lca-bug-localization
🏟️ Long Code Arena (Bug localization)
This is the benchmark for the Bug localization task as part of the
🏟️ Long Code Arena benchmark.
The bug localization problem can be formulated as follows: given an issue with a bug description and a repository snapshot in a state where the bug is reproducible, identify the files within the repository that need to be modified to address the reported bug.
The dataset provides all the required components for evaluation of bug localization… See the full description on the dataset page: https://huggingface.co/datasets/JetBrains-Research/lca-bug-localization.recreate-bug-pre-fix-v1-trimThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 20,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos",
"tilt.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/VibeCuisine/recreate-bug-pre-fix-v1-trim.recreate-bug-post-fix-v1-trimThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 20,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos",
"tilt.pos"
]… See the full description on the dataset page: https://huggingface.co/datasets/VibeCuisine/recreate-bug-post-fix-v1-trim.bug-localization
Bug Localization
This is the data for Bug Localization benchmark.
How-to
Since the dataset is private, if you haven't used HF Hub before, add your token via huggingface-cli first:
huggingface-cli login
List all the available configs via datasets.get_dataset_config_names and choose an appropriate one
Load the data via load_dataset:
from datasets import load_dataset
# Select a configuration from ["py", "java", "kt", "mixed"]
configuration = "py"
# Select a split from… See the full description on the dataset page: https://huggingface.co/datasets/tiginamaria/bug-localization.ierd-codeforces-subtle-bugs
IERD Codeforces subtle bugs
This public dataset contains 682 generated buggy C++ solutions for 682 Codeforces
problems. Each solution passes most tests in the frozen source corpus and fails from
one to five stored human or Hugging Face tests. The package also contains the frozen
manifest, provenance files, and aggregate reports from the final test generation
study.
Source and version
The problems, tests, and reference solution candidates come from… See the full description on the dataset page: https://huggingface.co/datasets/shivank21/ierd-codeforces-subtle-bugs.benchname-bug-localization
🥷 BenchName (Bug localization)
This is the benchmark for the Bug localization task as part of the
🥷 BenchName benchmark.
The bug localization problem can be formulated as follows: given an issue with a bug description and a repository snapshot in a state where the bug is reproducible, identify the files within the repository that need to be modified to address the reported bug.
The dataset provides all the required components for evaluation of bug localization approaches in… See the full description on the dataset page: https://huggingface.co/datasets/anon-iclr-submission/benchname-bug-localization.auto_0207_bugauto_0207_bug_updatedcheck_tail_bugThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_so_follower",
"total_episodes": 14,
"total_frames": 4162,
"total_tasks": 1,
"chunks_size": 1000000,
"data_files_size_in_mb": 10000,
"video_files_size_in_mb": 50000,
"fps": 30,
"splits": {
"train": "0:14"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/msmandelbrot/check_tail_bug.apache_bug_reportsmini_bug_input.json4o_bug_input.jsonpick_cube_bug_fixThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": null,
"total_episodes": 30,
"total_frames": 423,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 10,
"splits": {
"train": "0:30"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lilkm/pick_cube_bug_fix.zcc-compiler-bug-corpus
ZCC Compiler Bug Corpus
A growing dataset of confirmed, ground-truth C compiler codegen bugs, AST traversal faults, and SysV ABI violations discovered during the creation of the ZCC compiler.
Provenance Codebases (Stress Categories)
Baseline Arithmetic
Memory Allocation
Complex Expressions
SQLite 3.45.0
DOOM 1.10
Lua 5.4.6
libcurl-8.7.1 (Network/IO)
wall_cube_FULL_bugThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so100_follower",
"total_episodes": 121,
"total_frames": 112942,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:121"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/satvikahuja/wall_cube_FULL_bug.buggy-python-functionsbriobinThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 51,
"total_frames": 22577,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:51"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/buggybrain/briobin.bug-fixing-latent-demos-v1COFFEE2-electric-bugalooThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 25,
"total_frames": 6132,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:25"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/elvisxiang/COFFEE2-electric-bugaloo.py-bug-trace-laguna-xs-2-l1-rolloutsSplitted_Bug_report_Final_new_dataset_2024bug-localization
BenchName (Bug localization)
This is the benchmark for the Bug localization task as part of the
BenchName benchmark.
The bug localization problem can be formulated as follows: given an issue with a bug description and a repository snapshot in a state where the bug is reproducible, identify the files within the repository that need to be modified to address the reported bug.
The dataset provides all the required components for evaluation of bug localization approaches in real… See the full description on the dataset page: https://huggingface.co/datasets/icmlbenchname/bug-localization.py-bug-trace-laguna-xs-2-l1-rolloutsF_Bug_report_Final_new_dataset_2024Ichigo-instruction-tokenized-v0.2-bugDPO_turn_bug
Dataset Details
This is the training dataset for the DPO Turn strategy in PLAYPEN: An Environment for Exploring Learning From Dialogue Game Feedback.
These preference dataset have been obtained from these games' instances using this script, with --preference_depth turn.
Given the huge number of chosen vs rejected pairs in the first turn of the conversation, we limit the numbers of chosen and rejected pairs for the first turn to 10k samples (--first_turn_limit True).… See the full description on the dataset page: https://huggingface.co/datasets/clembench-playpen/DPO_turn_bug.adversarial_bugbench_bcb_oldeval_spatialPE_v5_bugfixThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 1,
"total_frames": 149,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/seriintan/eval_spatialPE_v5_bugfix.eval_spatialPE_v5_bugfixxThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 13,
"total_frames": 4503,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:13"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/seriintan/eval_spatialPE_v5_bugfixx.neurips-bug-eval-v4