mteb/Core17InstructionRetrieval
Core17InstructionRetrieval An MTEB dataset Massive Text Embedding Benchmark Measuring retrieval instruction following ability on Core17 narratives for the FollowIR benchmark. Task category t2t Domains News, Written Reference https://arxiv.org/abs/2403.15246 Source datasets: jhu-clsp/core17-instructions-mteb How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/Core17InstructionRetrieval.
08.1k
1name: Core17InstructionRetrieval2description: Measuring retrieval instruction following ability on Core17 narratives3 for the FollowIR benchmark.4evaluation_framework: mteb5tasks:6- id: Core17InstructionRetrieval7- id: Core17InstructionRetrieval_default_test8 config: default9 split: test10 