datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Scientific-Summaries
Scientific Summaries
22 million LLM-generated structured summaries of scientific papers, enriched with OpenAlex scholarly metadata. Each paper has an 18-field structured summary covering methodology, key results, claims, limitations, and more. This public dataset includes full paper text for ~5.3 million papers where open-access status has been confirmed -- either through OpenAlex metadata or because the paper originates from a permissively licensed source such as the arXiv preprint… See the full description on the dataset page: https://huggingface.co/datasets/laion/Scientific-Summaries.scientific_data_2026_curated_trackssim-datasets
SIM-Datasets: A Unified Symbolic Regression Benchmark
A standardized benchmark collection designed for the Scientific Intelligent Modelling (SIM) toolkit, providing comprehensive datasets for symbolic regression research and applications.
Overview
SIM-Datasets serves as a unified benchmark for symbolic regression tasks, offering standardized datasets with consistent formatting and evaluation protocols. This collection is specifically curated to support the Scientific… See the full description on the dataset page: https://huggingface.co/datasets/scientific-intelligent-modelling/sim-datasets.scientific-quality-score-predictionDatasets related to the task of Scholarly Document Quality Prediction (SDQP).
Each sample is an academic paper for which either the citation count or the review score can be predicted (depending on availability).
ACL-OCL Extended
A dataset for citation count prediction only, based on the ACL-OCL dataset.
Extended with updated citation counts, references and annotated research hypothesis.
OpenReview (Last Update: 1.1.2025)
A dataset for review score and citation count… See the full description on the dataset page: https://huggingface.co/datasets/nhop/scientific-quality-score-prediction.scientific-verification
Scientific Verification Benchmark: NMC Cathodes
Dataset summary
The benchmark contains 50 scientific claims about NMC (lithium nickel manganese cobalt oxide) battery cathodes. Each claim is answered by Claude Opus 5, GPT 5.6 Luna and Gemini 3.1 Pro using a set of 20 open-access papers, producing 150 scored answers. The accompanying reference set contains 1,991 experiment-grounded measurements curated from 227 open-access papers, with experimental conditions and… See the full description on the dataset page: https://huggingface.co/datasets/GenData-Research/scientific-verification.tda-gnn-scientific-retrievalscientific_lay_summarisation-plos-norm
scientific_lay_summarisation - PLOS - normalized
This dataset is a modified version of tomasg25/scientific_lay_summarization and contains scientific lay summaries that have been preprocessed with this code. The preprocessing includes fixing punctuation and whitespace problems, and calculating the token length of each text sample using a tokenizer from the T5 model.
Original dataset details:
Repository: https://github.com/TGoldsack1/Corpora_for_Lay_Summarisation
Paper: Making… See the full description on the dataset page: https://huggingface.co/datasets/pszemraj/scientific_lay_summarisation-plos-norm.scientific-question-outcomes
Scientific Question Outcomes
980 astronomy research questions, frozen at five historical cutoffs, each
labelled with what the following five years of literature actually did with
it.
Systems that propose research questions are usually evaluated by asking a
person or a model how good the questions sound. This dataset supplies the
alternative: questions frozen using only pre-cutoff literature, and outcome
labels drawn from the literature published afterwards. It is, to our… See the full description on the dataset page: https://huggingface.co/datasets/huiluckylucky/scientific-question-outcomes.scientific-exaggeration-detection
Dataset Card for Scientific Exaggeration Detection
Dataset Summary
Public trust in science depends on honest and factual communication of scientific papers. However, recent studies have demonstrated a tendency of news media to misrepresent scientific papers by exaggerating their findings. Given this, we present a formalization of and study into the problem of exaggeration detection in science communication. While there are an abundance of scientific papers and popular… See the full description on the dataset page: https://huggingface.co/datasets/copenlu/scientific-exaggeration-detection.douvras-scientific-ci-evidence-graph
Douvras Scientific CI Evidence Graph v0.1
Synthetic protocol dataset for linking a claim to its paper, repository,
dataset, seed and reproduced metric. It contains 30 records from six toy paper
instances (20 train, 5 validation and 5 frozen test), split by paper_id.
The labels distinguish REPRODUCED, PARTIAL, FAILED and INCONCLUSIVE.
Shortcuts and leakage fail closed. No real paper, code, dataset or result is
included, and this release is not a reproduction benchmark.
scientific-summaries-pubmed-open-accesshttps://huggingface.co/datasets/laion/Scientific-Summaries
scientific_lay_summarisation-elife-norm
scientific_lay_summarisation - elife - normalized
This is the "elife" split. For more words, refer to the PLOS split README
Contents
load with datasets:
from datasets import load_dataset
# If the dataset is gated/private, make sure you have run huggingface-cli login
dataset = load_dataset("pszemraj/scientific_lay_summarisation-elife-norm")
dataset
Output:
DatasetDict({
train: Dataset({
features: ['article', 'summary', 'section_headings', 'keywords', 'year'… See the full description on the dataset page: https://huggingface.co/datasets/pszemraj/scientific_lay_summarisation-elife-norm.mathematical_scientific_notation
Dataset Card for Tokenization Robustness
A comprehensive evaluation dataset for testing robustness of different tokenization strategies.
Dataset Details
Dataset Description
This dataset evaluates how robust language models are to different tokenization strategies and edge cases. It includes questions with multiple choice answers designed to test various aspects of tokenization handling.
Curated by: R3
Funded by [optional]: [More Information Needed]
Shared… See the full description on the dataset page: https://huggingface.co/datasets/gsaltintas/mathematical_scientific_notation.scientific_papers_citation_scores
Dataset Summary
This dataset comprises an array of scientific papers, each paper is associated with a series of scores.
These scores quantify the number of citations each paper has received.
The data regarding the papers and their citations were sourced from OpenCitations, a comprehensive and accessible online database of scholarly citations (available at https://opencitations.net/).
How are these scores calculated?
Imagine a tree where papers are nodes and citations… See the full description on the dataset page: https://huggingface.co/datasets/JoaoCoelho/scientific_papers_citation_scores.Scientific-and-technical-journal-articles-Africa
Scientific and technical journal articles Africa | Africa (World Bank)
Size category: n<1K - Formats: csv - Sector: climate_environment - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help analysts… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/Scientific-and-technical-journal-articles-Africa.gen_rec_industrial_scientific_all_tasksscientific-literature-research-assistant-dataDLT-Scientific-Literature
DLT-Scientific-Literature
Paper | GitHub
Dataset Description
Dataset Summary
DLT-Scientific-Literature is a specialized corpus of academic publications focused on Distributed Ledger Technology (DLT). This dataset is part of the larger DLT-Corpus collection, designed to support NLP research, language model development, and innovation studies in the DLT domain.
The dataset contains 37,440 scientific documents with 564 million tokens, spanning publications from… See the full description on the dataset page: https://huggingface.co/datasets/ExponentialScience/DLT-Scientific-Literature.persian-scientific-qa
language:
- fa
pretty_name: "PersianSciQA"
tags:
- question-answering
- scientific-texts
- persian
- information-retrieval
- relevance-ranking
- text-classification
size_categories:
- 10k-50k
dataset_info:
features:
- name: question
dtype: string
- name: abstract
dtype: string
- name: relevance
dtype: int32
- name: abstract_id
dtype: int64
splits:
train:
name: train
num_bytes: 56149171
num_examples: 31837
validation:
name:… See the full description on the dataset page: https://huggingface.co/datasets/safora/persian-scientific-qa.eng_latn_mathematical_scientific_notation
Dataset Card for Tokenization Robustness
A comprehensive evaluation dataset for testing robustness of different tokenization strategies.
Dataset Details
Dataset Description
This dataset evaluates how robust language models are to different tokenization strategies and edge cases. It includes questions with multiple choice answers designed to test various aspects of tokenization handling.
Curated by: R3
Funded by [optional]: [More Information Needed]
Shared… See the full description on the dataset page: https://huggingface.co/datasets/r-three/eng_latn_mathematical_scientific_notation.Summarize-Scientific-Papers-Processed
Scientific summarization dataset
Original dataset: https://huggingface.co/datasets/inference-net/Small-Summarized-Paper-Dataset
The current version of dataset is a part of the original dataset, processed into a readable and usable json format with relevant data of each paper.
collabllm-multiturn-scientific-papers-summarizationASCAT-Arabic-Scientific-Translation
ASCAT: Arabic Scientific Corpus for Advanced Translation
ASCAT (Arabic Scientific Corpus for Advanced Translation) is a high-quality English–Arabic parallel corpus of full scientific abstracts designed for rigorous evaluation and training of domain-specific machine translation (MT) systems.
Unlike existing Arabic–English corpora that rely on short sentences or narrow domains, ASCAT targets long-form scientific abstracts validated through a multi-engine translation and expert… See the full description on the dataset page: https://huggingface.co/datasets/NAMAA-Space/ASCAT-Arabic-Scientific-Translation.scientific-agent-protocol-traces
SciAgentTrace
Matched cross-domain dataset of scientific-agent protocols. The central
comparison contains the same 6,653 problems under two actor models and four
protocols: 53,224 trajectories in 40 complete model--benchmark--protocol
groups. The broader table-first package contains 68,892
trajectories. Begin with trajectories, outcomes, or matched_outcomes, then
follow stable identifiers to messages and compressed raw traces.
Repository:… See the full description on the dataset page: https://huggingface.co/datasets/AgentsSci/scientific-agent-protocol-traces.openalex-scientific-paper-impacttur_latn_mathematical_scientific_notation
Dataset Card for Tokenization Robustness
A comprehensive evaluation dataset for testing robustness of different tokenization strategies.
Dataset Details
Dataset Description
This dataset evaluates how robust language models are to different tokenization strategies and edge cases. It includes questions with multiple choice answers designed to test various aspects of tokenization handling.
Curated by: R3
Funded by [optional]: [More Information Needed]
Shared… See the full description on the dataset page: https://huggingface.co/datasets/r-three/tur_latn_mathematical_scientific_notation.cleand_moremilk_CoT_Reasoning_Scientific_Discovery_and_Research元データ: https://huggingface.co/datasets/moremilk/CoT_Reasoning_Scientific_Discovery_and_Research
使用したコード: https://github.com/LLMTeamAkiyama/0-data_prepare/tree/master/src/CoT_Reasoning_Scientific_Discovery_and_Research
データ件数: 3,733
平均トークン数: 1,193
最大トークン数: 2,489
合計トークン数: 4,453,517
ファイル形式: JSONL
ファイル分割数: 1
合計ファイルサイズ: 23.2 MB
加工内容：
メタデータ列の解析と新列生成: metadata列（辞書型）を解析し、その中のreasoningをthought列に、difficultyをdifficulty列に展開しました。解析に失敗した行は除外されました。また、元のmetadata列は削除されました。
難易度によるフィルタリング:… See the full description on the dataset page: https://huggingface.co/datasets/LLMTeamAkiyama/cleand_moremilk_CoT_Reasoning_Scientific_Discovery_and_Research.ita_latn_mathematical_scientific_notation
Dataset Card for Tokenization Robustness
A comprehensive evaluation dataset for testing robustness of different tokenization strategies.
Dataset Details
Dataset Description
This dataset evaluates how robust language models are to different tokenization strategies and edge cases. It includes questions with multiple choice answers designed to test various aspects of tokenization handling.
Curated by: R3
Funded by [optional]: [More Information Needed]
Shared… See the full description on the dataset page: https://huggingface.co/datasets/r-three/ita_latn_mathematical_scientific_notation.zho_hans_mathematical_scientific_notation
Dataset Card for Tokenization Robustness
A comprehensive evaluation dataset for testing robustness of different tokenization strategies.
Dataset Details
Dataset Description
This dataset evaluates how robust language models are to different tokenization strategies and edge cases. It includes questions with multiple choice answers designed to test various aspects of tokenization handling.
Curated by: R3
Funded by [optional]: [More Information Needed]
Shared… See the full description on the dataset page: https://huggingface.co/datasets/r-three/zho_hans_mathematical_scientific_notation.drtulu_v2_stepfun_scientific_knowledge_0415