datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
code_x_glue_cc_code_completion_token
Dataset Card for "code_x_glue_cc_code_completion_token"
Dataset Summary
CodeXGLUE CodeCompletion-token dataset, available at https://github.com/microsoft/CodeXGLUE/tree/main/Code-Code/CodeCompletion-token
Predict next code token given context of previous tokens. Models are evaluated by token level accuracy.
Code completion is a one of the most widely used features in software development through IDEs. An effective code completion tool could improve software… See the full description on the dataset page: https://huggingface.co/datasets/google/code_x_glue_cc_code_completion_token.lca-project-level-code-completion
🏟️ Long Code Arena (Project-level code completion)
This is the benchmark for Project-level code completion task as part of the 🏟️ Long Code Arena benchmark.
Each datapoint contains the file for completion, a list of lines to complete with their categories (see the categorization below), and a repository snapshot that can be used to build the context.
All the repositories are published under permissive licenses (MIT, Apache-2.0, BSD-3-Clause, and BSD-2-Clause). The datapoints can… See the full description on the dataset page: https://huggingface.co/datasets/JetBrains-Research/lca-project-level-code-completion.code_x_glue_cc_code_completion_line
Dataset Card for "code_x_glue_cc_code_completion_line"
Dataset Summary
CodeXGLUE CodeCompletion-line dataset, available at https://github.com/microsoft/CodeXGLUE/tree/main/Code-Code/CodeCompletion-line
Complete the unfinished line given previous context. Models are evaluated by exact match and edit similarity.
We propose line completion task to test model's ability to autocomplete a line. Majority code completion systems behave well in token level completion, but fail in… See the full description on the dataset page: https://huggingface.co/datasets/google/code_x_glue_cc_code_completion_line.context-aware-fim-code-completionsbenchname-project-level-code-completion
🥷 BenchName (Project-level code completion)
This is the benchmark for Project-level code completion task as part of the 🥷 BenchName benchmark.
Each datapoint contains the file for completion, a list of lines to complete with their categories (see the categorization below), and a repository snapshot that can be used to build the context.
All the repositories are published under permissive licenses (MIT, Apache-2.0, BSD-3-Clause, and BSD-2-Clause). The datapoints can be removed upon… See the full description on the dataset page: https://huggingface.co/datasets/anon-iclr-submission/benchname-project-level-code-completion.repo-code-completion
Repository Level Code Completion Dataset for Evaluation
This is a dataset of repository snapshots before a commit where a python file has been added. One needs to complete added file with given content of repository composed in different ways.
How to load the data
via load_dataset:
from datasets import load_dataset
data_files = # choose from the table below
dataset = load_dataset("jenyag/repo-code-completion", data_files=data_files, split="train")
Options… See the full description on the dataset page: https://huggingface.co/datasets/jenyag/repo-code-completion.project-level-code-completion
BenchName (Project-level code completion)
This is the benchmark for Project-level code completion task as part of the BenchName benchmark.
Each datapoint contains the file for completion, a list of lines to complete with their categories (see the categorization below), and a repository snapshot that can be used to build the context.
All the repositories are published under permissive licenses (MIT, Apache-2.0, BSD-3-Clause, and BSD-2-Clause). The datapoints can be removed upon… See the full description on the dataset page: https://huggingface.co/datasets/icmlbenchname/project-level-code-completion.code-completioncode_x_glue_cc_code_completion_line_pythoncode-hint-completionscode_completion_for_data_analysiscode-alpaca-eval-debug-completionsmbpp_code_completion_taskcode-completion-gsm8kcode-hint-3-completionssynthetic2-rlvr-code-compressed_completionsopen-code-reasoning-rlvr-stdio_completionssynthetic2-rlvr-code-compressed_filtered_olmo_completions_filteredklear-code-rlvr_completionssynthetic2-rlvr-code-compressed_filtered_olmo_completionscode-hint-2-completionsfim-code-completions