s2orc
Datasets
All datasets matching “s2orc”s2orc_full
S2ORC Full — Semantic Scholar Open Research Corpus
A complete redistribution of the S2ORC dataset in Parquet format on Hugging Face, containing 14.5 million academic papers with full text, structured metadata, and citation information.
Dataset Description
S2ORC (Semantic Scholar Open Research Corpus) is a general-purpose corpus for NLP and text mining research over scientific papers, originally developed by the Allen Institute for AI. This version provides the full… See the full description on the dataset page: https://huggingface.co/datasets/AlgorithmicResearchGroup/s2orc_full.s2orc
Dataset Card for S2ORC
This dataset contains titles, abstracts, and citations from scientific papers from the Semantic Scholar Open Research Corpus (S2ORC).
This dataset can and has been used to train embedding models, and works out of the box to train or finetune Sentence Transformer models.
In our experiments, title-abstract pairs result in the highest performance, followed by titles-citations and then abstract-citations pairs.
Dataset Subsets… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/s2orc.s2orc_small
Dataset Card for "s2orc_small"
A small split of the s2orc dataset, includes ~900k english papers with abstract included.
See all detailes in the original dataset card - https://huggingface.co/datasets/allenai/s2orc
modular-s2orc-parquetarxiv_s2orc_parsed
Dataset Card for "ArtifactAI/arxiv_s2orc_parsed"
Dataset Description
https://huggingface.co/datasets/AlgorithmicResearchGroup/arxiv_s2orc_parsed
Dataset Summary
AlgorithmicResearchGroup/arxiv_s2orc_parsed is a subset of the AllenAI S2ORC dataset, a general-purpose corpus for NLP and text mining research over scientific papers,
The dataset is filtered strictly for ArXiv papers, including the full text for each paper. Github links have been extracted… See the full description on the dataset page: https://huggingface.co/datasets/AlgorithmicResearchGroup/arxiv_s2orc_parsed.s2orc_arxiv
S2ORC ArXiv
A subset of the Semantic Scholar Open Research Corpus (S2ORC) filtered to ArXiv papers. Contains 2.58 million parsed scientific papers with full text, abstracts, structured sections, figures, and citation metadata.
Dataset Summary
Statistic
Value
Total papers
2,579,762
Total size
~266 GB
Format
Parquet
Split
train
Dataset Structure
Content Fields
Field
Type
Description
title
string
Paper title
abstract… See the full description on the dataset page: https://huggingface.co/datasets/AlgorithmicResearchGroup/s2orc_arxiv.