CoolFace
Datasetpublic

mteb/Core17InstructionRetrieval

Core17InstructionRetrieval An MTEB dataset Massive Text Embedding Benchmark Measuring retrieval instruction following ability on Core17 narratives for the FollowIR benchmark. Task category t2t Domains News, Written Reference https://arxiv.org/abs/2403.15246 Source datasets: jhu-clsp/core17-instructions-mteb How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/Core17InstructionRetrieval.

sourceHugging Facemitupdated 7mo agoView on Hugging Face
0likes8.1kdownloads
eval.yaml10 linesDownload Raw Back to root
1name: Core17InstructionRetrieval2description: Measuring retrieval instruction following ability on Core17 narratives3  for the FollowIR benchmark.4evaluation_framework: mteb5tasks:6- id: Core17InstructionRetrieval7- id: Core17InstructionRetrieval_default_test8  config: default9  split: test10