akalmbach-kinsol/generative-papers-arxiv

arXiv Citation Embeddings Dataset This dataset contains citation embeddings for arXiv papers, designed for training models that predict cited paper embeddings from citation context. Dataset Structure Core Files (Required for Training) paper_embeddings.parquet: Paper-level sentence embeddings (shared across splits) train/citations.jsonl: Training citation pairs with contexts train/citation_embeddings_*.parquet: Citation context embeddings (sharded)… See the full description on the dataset page: https://huggingface.co/datasets/akalmbach-kinsol/generative-papers-arxiv.