datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
code_generation_lite
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
🏠 Home Page •
💻 GitHub Repository •
🏆 Leaderboard •
📄 Paper
Change Log
Since LiveCodeBench is a continuously updated benchmark, we provide different versions of the dataset. Particularly, we provide the following versions of the dataset:
release_v1: The initial release of the dataset with problems released between May 2023 and Mar 2024 containing 400… See the full description on the dataset page: https://huggingface.co/datasets/lighteval/code_generation_lite.hf-codegen-v2
Dataset Card for "hf-codegen-v2"
Dataset generated with the code from: https://github.com/sayakpaul/hf-codegen.
humaneval-mbpp-codegen-qa
Dataset Card for "humaneval-mbpp-codegen-qa"
This dataset contains prompt-reply (question-answer) pairs where the prompt is to create a Python function which satisfies the functionality described in a specified docstring. The responses are then the generated functions.
codesearchnet-codegen
Dataset Card for CodeSearchNet for CodeGen
This is a processed version of the CodeSearchNet dataset. Namely, I separated the doc (documentation/docstring), sign (function signature), and output (function body) into separate fields; doc and sign are concatenated (according to the correct order of the programming language) into the problem field, making it suitable for the code generation task.
Dataset Details
Dataset Description
Curated by: [More… See the full description on the dataset page: https://huggingface.co/datasets/pengyunie/codesearchnet-codegen.CodeGen4Libs_RetrievalCodeLib
Dataset Card for FudanSELab CodeGen4Libs Code Retrieval Library
Dataset Summary
This dataset is the code retrieval library used in the ASE2023 paper titled "CodeGen4Libs: A Two-stage Approach for Library-oriented Code Generation".
Additional Information
Citation Information
@inproceedings{ase2023codegen4libs,
author = {Mingwei Liu and Tianyong Yang and Yiling Lou and Xueying Du and Ying Wang and and Xin Peng},
title =… See the full description on the dataset page: https://huggingface.co/datasets/FudanSELab/CodeGen4Libs_RetrievalCodeLib.usacobench_formattedleetcode-codegen-python
LeetCode Code-Gen Dataset — Python
2522 rows. Given a problem statement, its input/output examples, and a
required algorithm/technique, generate a correct Python solution.
Part of a 4-language collection built from the same source: see the sibling
Python,
Java,
C++, and
JavaScript
datasets.
Verification
Every row was extracted, then executed in a sandboxed subprocess against the problem's own stated examples. Only rows that passed all examples are included -- this… See the full description on the dataset page: https://huggingface.co/datasets/AmareshHebbar/leetcode-codegen-python.Code-Generation-Quality-Estimation
Code Generation Quality Estimation
This repository contains model-ready task context, generated code, and complete-case execution-resource targets for five public LLM code-generation cohorts. It provides deterministic 70/10/20 group-aware split versions using seeds 42, 1234, and 2026.
Configurations
There are 15 configurations: one for each dataset and split seed. Each configuration has train, validation, and test splits.
Dataset
Complete rows
Groups
Models… See the full description on the dataset page: https://huggingface.co/datasets/Samsoup/Code-Generation-Quality-Estimation.code_generation_lite-th
LiveCodeBench code_generation_lite, Thai
111 competitive-programming problems from LeetCode and AtCoder, with the problem
statement translated to Thai. Everything else — test cases, starter code, metadata —
is the upstream value unchanged.
Known defects
The line breaks are gone from the problem statements. 110 of the 111 rows have no
line break at all in question_content; the one remaining row has two. These are
competitive-programming statements whose input and… See the full description on the dataset page: https://huggingface.co/datasets/iapp/code_generation_lite-th.TinyStories-CodeGen-Tokenized-combinedleetcode-codegen-javascript
LeetCode Code-Gen Dataset — JavaScript
631 rows. Given a problem statement, its input/output examples, and a
required algorithm/technique, generate a correct JavaScript solution.
Part of a 4-language collection built from the same source: see the sibling
Python,
Java,
C++, and
JavaScript
datasets.
Verification
Not execution-verified. There is currently no compiler/runtime harness for this language in the build pipeline (only Python has one). Rows are extracted… See the full description on the dataset page: https://huggingface.co/datasets/AmareshHebbar/leetcode-codegen-javascript.leetcode-codegen-java
LeetCode Code-Gen Dataset — Java
4068 rows. Given a problem statement, its input/output examples, and a
required algorithm/technique, generate a correct Java solution.
Part of a 4-language collection built from the same source: see the sibling
Python,
Java,
C++, and
JavaScript
datasets.
Verification
Not execution-verified. There is currently no compiler/runtime harness for this language in the build pipeline (only Python has one). Rows are extracted directly from… See the full description on the dataset page: https://huggingface.co/datasets/AmareshHebbar/leetcode-codegen-java.TinyStories-CodeGen-Tokenizedleetcode-codegen-cpp
LeetCode Code-Gen Dataset — C++
4025 rows. Given a problem statement, its input/output examples, and a
required algorithm/technique, generate a correct C++ solution.
Part of a 4-language collection built from the same source: see the sibling
Python,
Java,
C++, and
JavaScript
datasets.
Verification
Not execution-verified. There is currently no compiler/runtime harness for this language in the build pipeline (only Python has one). Rows are extracted directly from… See the full description on the dataset page: https://huggingface.co/datasets/AmareshHebbar/leetcode-codegen-cpp.D14-codegen-annotated
D14 CodeGen Annotated — CAD code generation with chain-of-thought
The code_gen layer of D14 (BenchCAD) with teacher-written reasoning: 17,900 records, each
4-view orthographic render → reasoning → complete **CadQuery** program. The reasoning ends with the complete program in a ```python block, and the program
is AST-equivalent to BenchCAD's execution-verified reference — asserted per record at assembly
(records whose regeneration drifted carry the reference spliced verbatim;… See the full description on the dataset page: https://huggingface.co/datasets/AI4Manufacturing/D14-codegen-annotated.repo-codegen-py-py-context-path-distance
Dataset Card for "repo-codegen-py-py-context-path-distance"
More Information needed
codegen-instruct-CPlus-1kcode-generation-pyB_taco_clean_v1repo-codegen-py-non-py-context-path-distance
Dataset Card for "repo-codegen-py-non-py-context-path-distance"
More Information needed
Codegen_tokenizedB_livecodebench_lite_v3lca-codegen-huge
LCA Project Level Code Completion
How to load the dataset
from datasets import load_dataset
ds = load_dataset('JetBrains-Research/lca-codegen-huge', split='test')
Data Point Structure
repo – repository name in format {GitHub_user_name}__{repository_name}
commit_hash – commit hash
completion_file – dictionary with the completion file content in the following format:
filename – filepath to the completion file
content – content of the completion file… See the full description on the dataset page: https://huggingface.co/datasets/JetBrains-Research/lca-codegen-huge.html-css-codegen-datasethf-codegenstack_dedup_lua_codegen_full
Dataset Card for "stack_dedup_lua_codegen_full"
More Information needed
repo-codegen-py-all-context-path-distance
Dataset Card for "repo-codegen-py-all-context-path-distance"
More Information needed
code-general-fonction-publique
Code général de la fonction publique, non-instruct (11-12-2023)
This project focuses on fine-tuning pre-trained language models to create efficient and accurate models for legal practice.
Fine-tuning is the process of adapting a pre-trained model to perform specific tasks or cater to particular domains. It involves adjusting the model's parameters through a further round of training on task-specific or domain-specific data. While conventional fine-tuning strategies involve… See the full description on the dataset page: https://huggingface.co/datasets/louisbrulenaudet/code-general-fonction-publique.livecodebench_lite_v2_testbank_reB_livecodebench_lite_v2