embedding-benchmark/HumanEval
The HumanEval dataset released by OpenAI includes 164 programming problems with a handwritten function signature, docstring, body, and several unit tests for each problem. The dataset was handcrafted by engineers and researchers at OpenAI. Usage import datasets # Download the dataset queries = datasets.load_dataset("embedding-benchmark/HumanEval", "queries") documents = datasets.load_dataset("embedding-benchmark/HumanEval", "corpus") pair_labels =… See the full description on the dataset page: https://huggingface.co/datasets/embedding-benchmark/HumanEval.
The HumanEval dataset released by OpenAI includes 164 programming problems with a handwritten function signature, docstring, body, and several unit tests for each problem. The dataset was handcrafted by engineers and researchers at OpenAI.
Usage
import datasets
# Download the dataset
queries = datasets.load_dataset("embedding-benchmark/HumanEval", "queries")
documents = datasets.load_dataset("embedding-benchmark/HumanEval", "corpus")
pair_labels = datasets.load_dataset("embedding-benchmark/HumanEval", "default")