datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
lca-results
Long Code Arena (raw results)
These are the raw results from the Long Code Arena benchmark suite, as well as the corresponding model predictions.
Please use the subset dropdown menu to select the necessary data relating to our six benchmarks:
🤗 Library-based code generation
🤗 CI builds repair
🤗 Project-level code completion
🤗 Commit message generation🤗 Bug localization
🤗 Module summarization
lca-bug-localization
🏟️ Long Code Arena (Bug localization)
This is the benchmark for the Bug localization task as part of the
🏟️ Long Code Arena benchmark.
The bug localization problem can be formulated as follows: given an issue with a bug description and a repository snapshot in a state where the bug is reproducible, identify the files within the repository that need to be modified to address the reported bug.
The dataset provides all the required components for evaluation of bug localization… See the full description on the dataset page: https://huggingface.co/datasets/JetBrains-Research/lca-bug-localization.lca-ci-builds-repair
🏟️ Long Code Arena (CI builds repair)
This is the benchmark for CI builds repair task as part of the
🏟️ Long Code Arena benchmark.
🛠️ Task. Given the logs of a failed GitHub Actions workflow and the corresponding repository snapshot,
repair the repository contents in order to make the workflow pass.
All the data is collected from repositories published under permissive licenses (MIT, Apache-2.0, BSD-3-Clause, and BSD-2-Clause). The datapoints can be removed upon request.
To… See the full description on the dataset page: https://huggingface.co/datasets/JetBrains-Research/lca-ci-builds-repair.LeroyDyer__LCARS_AI_001-details
Dataset Card for Evaluation run of LeroyDyer/LCARS_AI_001
Dataset automatically created during the evaluation run of model LeroyDyer/LCARS_AI_001
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/LeroyDyer__LCARS_AI_001-details.EcoDynElec-ResultsLeroyDyer__LCARS_AI_StarTrek_Computer-details
Dataset Card for Evaluation run of LeroyDyer/LCARS_AI_StarTrek_Computer
Dataset automatically created during the evaluation run of model LeroyDyer/LCARS_AI_StarTrek_Computer
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/LeroyDyer__LCARS_AI_StarTrek_Computer-details.LeroyDyer__LCARS_TOP_SCORE-details
Dataset Card for Evaluation run of LeroyDyer/LCARS_TOP_SCORE
Dataset automatically created during the evaluation run of model LeroyDyer/LCARS_TOP_SCORE
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/LeroyDyer__LCARS_TOP_SCORE-details.edited_Lerobot_move_blue_tube_rack_farthest_corner_LcamThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 13,
"total_frames": 5138,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:13"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gravta42/edited_Lerobot_move_blue_tube_rack_farthest_corner_Lcam.ende_mind_topics
ENDE-MIND-Topics
ENDE-MIND-Topics (English–German) is a bilingual corpus of 25,148 Wikipedia-derived document chunks containing topic modeling information derived from training a PLTM model on this data with 25 topics. The dataset serves as input for the MIND pipeline, which performs multilingual question–answer generation and discrepancy detection.
Each record includes the passage and corresponding full document, preprocessing outputs (lemmas, translations), and topic model… See the full description on the dataset page: https://huggingface.co/datasets/lcalvobartolome/ende_mind_topics.edited_Lerobot_place_tube_rack_Lfar_LcamThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 16,
"total_frames": 3625,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:16"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gravta42/edited_Lerobot_place_tube_rack_Lfar_Lcam.lca-disclosure-dataLerobot_move_blue_tube_rack_farthest_corner_LcamThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 15,
"total_frames": 5884,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:15"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gravta42/Lerobot_move_blue_tube_rack_farthest_corner_Lcam.lca-StartingPoints-expanded🧠 LCA-Starting Points
A benchmark for evaluating project-local code completion ranking.
Curated to validate TreeRanker (ASE2025).
📖 Dataset Description
Starting Points is a specialized dataset designed to evaluate code completion ranking, with a specific focus on locally defined identifiers (project-specific APIs) in Python.
Most LLM benchmarks focus on global APIs (standard libraries). However, developers spend significant time using APIs defined within their own… See the full description on the dataset page: https://huggingface.co/datasets/DanCip/lca-StartingPoints-expanded.Lerobot_place_tube_rack_Lfar_LcamThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 25,
"total_frames": 5722,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:25"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gravta42/Lerobot_place_tube_rack_Lfar_Lcam.edited_Lerobot_move_white_tube_rack_to_other_rack_LcamThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 10,
"total_frames": 3734,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gravta42/edited_Lerobot_move_white_tube_rack_to_other_rack_Lcam.lca_trajectories_32kedited_Lerobot_place_tube_rack_Rfar_LcamThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 13,
"total_frames": 3216,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:13"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gravta42/edited_Lerobot_place_tube_rack_Rfar_Lcam.Lerobot_place_tube_rack_Rfar_LcamThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 16,
"total_frames": 3972,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:16"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gravta42/Lerobot_place_tube_rack_Rfar_Lcam.lerobot_lcarus_dataset_GrabCuplerobot_lcarus3000_dataset_GrabPenLeroyDyer__LCARS_AI_1x4_003_SuperAI-details
Dataset Card for Evaluation run of LeroyDyer/LCARS_AI_1x4_003_SuperAI
Dataset automatically created during the evaluation run of model LeroyDyer/LCARS_AI_1x4_003_SuperAI
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/LeroyDyer__LCARS_AI_1x4_003_SuperAI-details.lca-StartingPoints-expanded-filteredlerobot_lcarus_dataset_GrabPen2mirror-lca-bug-localization
🏟️ Long Code Arena (Bug localization)
This is the benchmark for the Bug localization task as part of the
🏟️ Long Code Arena benchmark.
The bug localization problem can be formulated as follows: given an issue with a bug description and a repository snapshot in a state where the bug is reproducible, identify the files within the repository that need to be modified to address the reported bug.
The dataset provides all the required components for evaluation of bug localization… See the full description on the dataset page: https://huggingface.co/datasets/alucent/mirror-lca-bug-localization.coredrill-datas2-1MLCA_Mining_1