datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
wikidata-extraction
Wikidata Extraction
This dataset contains all RDF triples extracted from the latest Wikidata, converted from the N-Triples format to Parquet.
The data originates from Wikidata, a free and open knowledge base that acts as central storage for structured data used by Wikipedia and other Wikimedia projects. The source file is the "truthy" N-Triples dump (latest-truthy.nt.bz2), which contains only the current, non-deprecated statements.
The code to extract this data is available at… See the full description on the dataset page: https://huggingface.co/datasets/piebro/wikidata-extraction.tweet_sentiment_extraction
TweetSentimentExtractionClassification
An MTEB dataset
Massive Text Embedding Benchmark
Task category
t2c
Domains
Social, Written
Reference
https://www.kaggle.com/competitions/tweet-sentiment-extraction/overview
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["TweetSentimentExtractionClassification"])
evaluator = mteb.MTEB(task)
model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/tweet_sentiment_extraction.vi-books_extractionll books_text_final/ | wc -l
=> 13968 text
After filter (not vi, too small)
wc -l vi-books.jsonl
=> 12832 text
=> !!! Cần lọc truyện từ dtv ra !!!
xzcat dtv_ebooks_details.jsonl.xz | wc -l
# => 13486
ll books_text_final/ | grep dtv_ebooks_ | wc -l
# => 3535 từ dtv
lấy các whitelist categories tại dtv_categories_whitelist.jsonl
lần theo từng ebook một trong dtv_ebooks_details.jsonl.xz trường {"cat": "Self Help - Khởi nghiệp", "cat_url":… See the full description on the dataset page: https://huggingface.co/datasets/tiendung/vi-books_extraction.sec-contracts-financial-extraction-instructions
S&P 500 SEC Financial Extraction Instructions
Dataset Summary
7,683 instruction-tuning examples for training LLMs to extract structured financial data from SEC filings. Covers two filing types across S&P 500 companies:
Split
Examples
Filing Type
Description
train
3,430
Exhibit 10 + DEF 14A
Positive examples with validated outputs
corrective
4,253
Exhibit 10 + DEF 14A
Corrective, rescued, and negative examples
Exhibit 10 — Material Contracts (2… See the full description on the dataset page: https://huggingface.co/datasets/TheTokenFactory/sec-contracts-financial-extraction-instructions.tool-output-extraction-swebench
Tool Output Extraction Dataset
Paper | Code
Training data for squeez — a small model that prunes verbose coding agent tool output to only the evidence the agent needs next.
Task
Task-conditioned context pruning of a single tool observation for coding agents.
Given a focused extraction query and one verbose tool output, return the smallest verbatim evidence block(s) the agent should read next.
The model copies lines from the tool output — it never rewrites, summarizes, or… See the full description on the dataset page: https://huggingface.co/datasets/KRLabsOrg/tool-output-extraction-swebench.scrapinghub-article-extraction-benchmark
Scrapinghub Article Extraction Benchmark
This dataset was originally created and distributed under MIT License by Scrapinghub on GitHub: github.com/scrapinghub/article-extraction-benchmark
It is mirrored on the HuggingFace Hub as a convenience.
price-tag-extraction
Price tag extraction dataset
This dataset contains images of price tags extracted from the Open Prices dataset, along with information extracted from this dataset.
It is intended to be used to train large visual language models (LVLMs) to extract information from price tag images, as part of the Open Prices project.
For more information about the format of this dataset, please refer to the documentation on llm-image-extraction datasets.
Dataset creation
A detailed… See the full description on the dataset page: https://huggingface.co/datasets/openfoodfacts/price-tag-extraction.paper_extractionraw-fact-extractiontweet_sentiment_extraction
Tweet Sentiment Extraction
Source: https://www.kaggle.com/c/tweet-sentiment-extraction/data
skill-extraction-tech
Skill Extraction with ESCO skills - TECH subset
Dataset Summary
This dataset contains an extension of the TECH subset form the SkillSpan dataset, in which spans of skill mentions in sentences have been labeled with corresponding ESCO skills (ESCO v1.1.0).
This dataset is part of a three-part evaluation dataset for skill extraction:
skill-extraction-tech
skill-extraction-house
skill-extraction-techwolf
Citation Information
If you use this dataset, please include… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/skill-extraction-tech.funding-extraction-harness-benchmarkmall_receipt_extraction_datasetinsurance-claims-extractionThis dataset can be used for benchmarking LLM Structured Outputs via the code here:
https://github.com/cleanlab/structured-output-benchmark/
danish-dynaword-extractionstask181_outcome_extraction
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task181_outcome_extraction
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task181_outcome_extraction.doab-metadata-extraction
DOAB Open Access Books - Metadata Extraction Dataset
Dataset Description
This dataset contains 9,363 open access books with page images and rich bibliographic metadata extracted from MARC21 records, curated specifically for training and evaluating Vision Language Models (VLMs) on automatic metadata extraction from scholarly monographs.
The dataset is derived from the Penn State ScholarSphere DOAB collection (Directory of Open Access Books), focusing on books with Creative… See the full description on the dataset page: https://huggingface.co/datasets/biglam/doab-metadata-extraction.json_data_extraction
Diverse Restricted JSON Data Extraction
Curated by: The paraloq analytics team.
Uses
Benchmark restricted JSON data extraction (text + JSON schema -> JSON instance)
Fine-Tune data extraction model (text + JSON schema -> JSON instance)
Fine-Tune JSON schema Retrieval model (text -> retriever -> most adequate JSON schema)
Out-of-Scope Use
Intended for research purposes only.
Dataset Structure
The data comes with the following fields:
title: The… See the full description on the dataset page: https://huggingface.co/datasets/paraloq/json_data_extraction.Skill-extraction-Tech-graded
skill-extraction-tech-graded
Graded-relevance annotations for sentences from
TechWolf/skill-extraction-tech
against the ESCO v1.1.0 skill taxonomy. Layout follows the
BEIR convention so it is drop-in for
MTEB-style retrieval evaluators.
This dataset was created for the RecSys-HR 2026 WorkRB challenge.
Configs
config
split
rows
columns
queries
validation
75
_id (sentence id), text (sentence)
queries
test
338
_id (sentence id), text (sentence)
corpus… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/Skill-extraction-Tech-graded.danish-extraction-v1
danish-extraction-v1
Danish information-extraction rows over real prose, where the schema is
proposed per passage rather than fixed. Built from
danish-foundation-models/danish-dynaword
by scripts/gen_extraction_da.py.
Each source passage got its own field set: an LLM proposed 3-6 fields for that
text without seeing any values, then filled them in a separate turn. Roughly a
quarter of proposed fields come back empty, which are genuine abstention
targets rather than annotation… See the full description on the dataset page: https://huggingface.co/datasets/jensjepsen/danish-extraction-v1.calcium-source-extraction
Calcium source extraction
Synthetic one-photon (miniscope-style) calcium imaging of mouse cortex, rendered with a physically
motivated simulator that models somatic morphology at several depths, calcium indicator kinetics,
correlated neuropil, vasculature and hemodynamics, non-stationary rigid motion, wide-field optics
and an sCMOS camera, with complete ground truth. The simulator is not part of this release.
data/heldout/video.tif 60 s at 15 Hz, 512 x 512, 8-bit, 900… See the full description on the dataset page: https://huggingface.co/datasets/Emulated-Inc/calcium-source-extraction.Skill-extraction-SkillSkape-graded
skill-extraction-skillskape-graded
Graded-relevance annotations for sentences from
jjzha/skillskape
against the ESCO v1.1.0 skill taxonomy. Layout follows the
BEIR convention so it is drop-in for
MTEB-style retrieval evaluators.
This dataset was created for the RecSys-HR 2026 WorkRB challenge.
Configs
config
split
rows
columns
queries
validation
100
_id (sentence id), text (sentence)
queries
test
500
_id (sentence id), text (sentence)
corpus
corpus… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/Skill-extraction-SkillSkape-graded.fcv-extractions-meta-tiered-probe
fcv-extractions-meta-tiered-probe
Data-use mention extractions from the World Bank Fragility, Conflict and Violence (FCV) document corpus. Spans are extracted by the fine-tuned GLiNER model rafmacalaba/gliner_datause_tiered, scored by the tier-probe head rafmacalaba/gliner-tier-probe, and attributed (provenance + usage/impact) by rafmacalaba/lfm2.5-350M-datause-multitask-tiered (a LoRA SFT of LiquidAI/LFM2.5-350M).
Shape
nested — one row per chunk; each entity in… See the full description on the dataset page: https://huggingface.co/datasets/rafmacalaba/fcv-extractions-meta-tiered-probe.resume-json-extraction-5k
Dataset Card for resume-json-extraction-5k
Dataset Description
This dataset contains 4,879 resume examples formatted for fine-tuning language models to extract structured JSON information from resume text.
Dataset Summary
The dataset consists of resume text paired with structured JSON outputs containing:
Job titles (current and previous)
Companies (current and previous)
Years of experience
Seniority level
Primary domain and industries
Core and secondary skills… See the full description on the dataset page: https://huggingface.co/datasets/sandeeppanem/resume-json-extraction-5k.Skill-extraction-House-graded
skill-extraction-house-graded
Graded-relevance annotations for sentences from
TechWolf/skill-extraction-house
against the ESCO v1.1.0 skill taxonomy. Layout follows the
BEIR convention so it is drop-in for
MTEB-style retrieval evaluators.
This dataset was created for the RecSys-HR 2026 WorkRB challenge.
Configs
config
split
rows
columns
queries
validation
61
_id (sentence id), text (sentence)
queries
test
261
_id (sentence id), text (sentence)… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/Skill-extraction-House-graded.turkish-keyword-extraction-500k
Turkish Keyword Extraction 500K v2
Yirmi alanda konu ve anahtar sözcük çıkarımı için kısa Türkçe belgeler.
Doğrulanmış boyut
Train: 490,000
Validation: 5,000
Test: 5,000
Toplam: 500,000
Ana görev sütunları: id, text, keywords, domain
Provenance
Veri insan mesajlarından, belgelerinden veya web kazımasından alınmamıştır. Tamamı
depodaki üretici koduyla deterministik olarak oluşturulur. Her satırda source_type,
provenance, generator_version… See the full description on the dataset page: https://huggingface.co/datasets/GoktugD/turkish-keyword-extraction-500k.skill-extraction-house
Skill Extraction with ESCO skills - HOUSE subset
Dataset Summary
This dataset contains an extension of the HOUSE subset form the SkillSpan dataset, in which spans of skill mentions in sentences have been labeled with corresponding ESCO skills (ESCO v1.1.0).
This dataset is part of a three-part evaluation dataset for skill extraction:
skill-extraction-tech
skill-extraction-house
skill-extraction-techwolf
Citation Information
If you use this dataset, please… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/skill-extraction-house.fcv-extractions-meta-tiered
fcv-extractions-meta-tiered
Data-use mention extractions from the World Bank Fragility, Conflict and Violence (FCV) document corpus, enriched by the fine-tuned rafmacalaba/lfm2.5-350M-datause-multitask model (a LoRA SFT of LiquidAI/LFM2.5-350M).
Shape
nested — one row per chunk; each entity in entities[] carries provenance and usage_impact alongside its span.
Configs
config
rows
fcv_pads_east_africa
862,663
jdc_operational
2,468… See the full description on the dataset page: https://huggingface.co/datasets/rafmacalaba/fcv-extractions-meta-tiered.task1448_disease_entity_extraction_ncbi_dataset
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1448_disease_entity_extraction_ncbi_dataset
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1448_disease_entity_extraction_ncbi_dataset.table-extraction
Dataset Labels
['bordered', 'borderless']
Number of Images
{'test': 34, 'train': 238, 'valid': 70}
How to Use
Install datasets:
pip install datasets
Load the dataset:
from datasets import load_dataset
ds = load_dataset("keremberke/table-extraction", name="full")
example = ds['train'][0]
Roboflow Dataset Page
https://universe.roboflow.com/mohamed-traore-2ekkp/table-extraction-pdf/dataset/2
Citation
License
CC… See the full description on the dataset page: https://huggingface.co/datasets/keremberke/table-extraction.