embedding-benchmark/MBPP
The MBPP dataset consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task description, code solution and 3 automated test cases. As described in the paper, a subset of the data has been hand-verified by the dataset authors to ensure quality. Usage import datasets # Download the dataset queries =… See the full description on the dataset page: https://huggingface.co/datasets/embedding-benchmark/MBPP.
The MBPP dataset consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task description, code solution and 3 automated test cases. As described in the paper, a subset of the data has been hand-verified by the dataset authors to ensure quality.
Usage
import datasets
# Download the dataset
queries = datasets.load_dataset("embedding-benchmark/MBPP", "queries")
documents = datasets.load_dataset("embedding-benchmark/MBPP", "corpus")
pair_labels = datasets.load_dataset("embedding-benchmark/MBPP", "default")