ir-benchmark
nasa-smd-IR-benchmark
NASA-IR benchmark
NASA SMD and IBM Research developed a domain-specific information retrieval benchmark, NASA-IR, spanning almost 500 question-answer pairs related to the Earth science, planetary science, heliophysics, astrophysics, and biological physical sciences domains. Specifically, we sampled a set of 166 paragraphs from AGU, AMS, ADS, PMC, and PubMed and manually annotated with 3 questions that are answerable from each of these paragraphs, resulting in 498 questions. We used… See the full description on the dataset page: https://huggingface.co/datasets/nasa-impact/nasa-smd-IR-benchmark.Constrained-IR-Benchmark
Constrained-IR-Benchmark
10-domain retrieval test set. Each domain is a separate config with a test split.
Domains
config
samples
business_selection
25
company
25
course_selection
25
drug
25
enterprise_collaboration
25
phone
25
rental_house
25
restaurant
25
resume
25
vector_database
25
Load
from datasets import load_dataset
# 单个 domain
ds = load_dataset("WangSenQWQ/Constrained-IR-Benchmark", "phone", split="test")… See the full description on the dataset page: https://huggingface.co/datasets/WangSenQWQ/Constrained-IR-Benchmark.nasa-sde-IR-benchmark-20251024-v5
NASA SDE IR Benchmark v5
A comprehensive Information Retrieval benchmark dataset for the NASA Science Discovery Engine (SDE), containing synthetically generated query-document pairs for scientific content retrieval evaluation.
Paper: INDUS-SDE: A Language Model for Scientific Content Curation and Discovery — KDD 2026, AI for Sciences Track. This is the in-domain NASA SDE IR benchmark used to evaluate INDUS-SDE-ST.
Code: NASA-IMPACT/st-training-workflow
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/nasa-impact/nasa-sde-IR-benchmark-20251024-v5.Benchmark_IR_Dominican_News