datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
LOC-Chronicling-America
Chronicling America (US Library of Congress) - Parquet Dataset
A high-performance, columnar Apache Parquet dataset containing digitized, OCR-extracted historical American newspapers from the US Library of Congress Chronicling America / National Digital Newspaper Program (NDNP).
Produced by streaming and transmuting massive Library of Congress preservation archives (.tar.bz2, METS/MODS, and ALTO XML) into compact, issue-level Parquet shards partitioned by state, newspaper… See the full description on the dataset page: https://huggingface.co/datasets/Tim-Pinecone/LOC-Chronicling-America.sec-10k-qa
SEC 10-K QA Dataset
A retrieval QA dataset built from SEC 10-K annual filings, designed for benchmarking
RAG chunking strategies with MTCB.
Contents
Split
Rows
Description
corpus
95
Cleaned 10-K filing text (20 companies × 5 years)
questions
950
QA pairs generated from corpus chunks
Companies
AAPL, MSFT, GOOGL, AMZN, TSLA, JPM, JNJ, UNH, V, PG,
NVDA, META, BRK, XOM, WMT, BAC, PFE, DIS, NFLX, AMD
Schema
corpus
document_id — filing… See the full description on the dataset page: https://huggingface.co/datasets/Tim-Pinecone/sec-10k-qa.refinedweb-generated-questions
Generated Questions and Answers from the Falcon RefinedWeb Dataset
This dataset contains 1k open-domain questions and answers generated using documents from Falcon's refinedweb dataset using GPT-4. You can find more details about this work in the following blogpost.
Each row consits of:
document_id - an id of a text chunk from the refined web dataset, from which the question was generated. Each id contains the original document index from the refinedweb dataset, and the chunk index… See the full description on the dataset page: https://huggingface.co/datasets/pinecone/refinedweb-generated-questions.