datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
pdf-parser-benchmark-exchange
PDF Parser Benchmark Exchange
这个 HuggingFace dataset repo 是 PDF 解析工具评测的协作中转仓，用来完成下面这条流程：
解析工具同事上传解析结果 -> agent 下载到本地评测 -> 生成中文 benchmark/badcase 报告 -> agent 上传报告结果
请把这个 repo 当作“交接目录”，不要把它当作单一报告文件仓。新的解析结果、评测结果和历史归档分别放在不同目录，避免互相覆盖。
快速入口
如何阅读 MinerU 3.1.2 OmniDocBench Badcase Report：给解析工具同事的图文导读，解释报告返回什么、重点看哪些区块、如何把 badcase 转成优化任务。
OmniDocBench 全量 PDF 待评测输入：解析工具同事下载这些 PDF 后运行自己的 parser，再把解析结果上传到 submissions/。
MinerU 3.1.2 OmniDocBench baseline 最新索引：包含 benchmark report… See the full description on the dataset page: https://huggingface.co/datasets/KuoKuoYeah/pdf-parser-benchmark-exchange.MultiLang-Code-Parser-Dataset
MultiLang Code Parser Dataset (MLCPD)
MultiLang-Code-Parser-Dataset (MLCPD) provides a large-scale, unified dataset of parsed source code across 10 major programming languages, represented under a universal schema that captures syntax, semantics, and structure in a consistent format.
Each entry corresponds to one parsed source file and includes:
Language metadata
Code-level statistics (lines, errors, AST nodes)
Universal Schema JSON (normalized structural representation)
MLCPD… See the full description on the dataset page: https://huggingface.co/datasets/jugalgajjar/MultiLang-Code-Parser-Dataset.agenda-parser-tool-traces
Agenda Parser — tool-calling reasoning traces
ReAct tool-calling traces for the Agenda Parser
agents: each row is one agent step — a {system, user, assistant} chat example
where the assistant emits a single JSON action {"thought", "tool", "args"}.
Two agents are covered (tagged by meta.domain):
agenda — the uploaded-packet research agent, over real public-meeting agenda
packets (tools: list/read items, semantic + exact search, summarize, report).
Each agenda row's meta.unit_id… See the full description on the dataset page: https://huggingface.co/datasets/build-small-hackathon/agenda-parser-tool-traces.ParserV1-modelsparser_dataset
parser_dataset
Parser training and evaluation data for multi-hop QA with long concatenated document contexts.
Derived from HotpotQA and 2WikiMultihopQA.
Contents
Path
Split
Samples
Notes
train/hotpotqa_train_process_emb-select_llm-unable.parquet
train
HotpotQA processed train
VERL / ParserRLHFDataset format
2wiki_val/eval_{N}.json
eval
128 per file
2WikiMultihopQA, N documents per example
hqa_val/eval_{N}.json
eval
128 per file
HotpotQA, N documents… See the full description on the dataset page: https://huggingface.co/datasets/inNexus/parser_dataset.sec-parser
SEC Filings Dataset Parser
This repository contains the core parser used to convert SEC EDGAR filings into layout-faithful Markdown-style text for downstream dataset construction and evaluation.
Contents
sec_parser/sec_parser.py: main parser implementation
sec_parser/special_chars.py: special-character normalization tables
sec_parser/hardcodes.py: filing cleanup hardcodes
sec_parser/config.py: parser configuration
pdf_table_fastpath.py, table_ocr_backends.py… See the full description on the dataset page: https://huggingface.co/datasets/sfd-anonymous/sec-parser.pi-trace-parser-sessionsItem-Parser-Dataset
Contents:
~$0.80 API token usage for Gemini 2.0 Flash Lite
Recipe-parser
Dataset Card for Dataset Name
A collection of traditional Mountain Jewish (Gorsky Jewish) recipes from STMEGI.com, containing authentic culinary recipes representing the cultural heritage of the Caucasus Jewish community.
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
A collection of 42 traditional Mountain Jewish (Gorsky Jewish) recipes collected from… See the full description on the dataset page: https://huggingface.co/datasets/AFKatz/Recipe-parser.omnimcp_healthtech_hl7_parser_teaser
🔬 INSPECT THE DEEPSEEK-R1 REASONING CHAIN LIVE:
Zero hallucinations. Null syntax errors. 100% AST compiler validated.🌐 Live Interactive Reasoning & Code Inspector: https://emgena.com/trainingslager🎁 Claim your Free Starter Kit (Code: STARTER100): https://emgena.com/trainingslager🏷️ Launch Discount: Get 20 € OFF any 500-incident production suite with code LAUNCH20!
📜 Enterprise Compliance: EU AI Act Articles 50 & 53 certified • 100% DSGVO / GDPR clean • Commercial EULA… See the full description on the dataset page: https://huggingface.co/datasets/emgena/omnimcp_healthtech_hl7_parser_teaser.agenda-parser-tool-traces
Agenda Parser — tool-calling reasoning traces
ReAct tool-calling traces for the Agenda Parser
agents: each row is one agent step — a {system, user, assistant} chat example
where the assistant emits a single JSON action {"thought", "tool", "args"}.
Two agents are covered (tagged by meta.domain):
agenda — the uploaded-packet research agent, over real public-meeting agenda
packets (tools: list/read items, semantic + exact search, summarize, report).
Each agenda row's meta.unit_id… See the full description on the dataset page: https://huggingface.co/datasets/rdubwiley/agenda-parser-tool-traces.parser6
prepare.py
Dataset Summary
A music dataset with image depth modality, stored in lmdb format.
Preprocessing & Augmentation
Preprocessing: adaptive
Augmentation: heavy
Splits & Sampling
Split strategy: leave one out
Sampling: active
Quality & Labeling
Quality filtering: moderate
Labeling: pseudo label
Files
prepare.py — main artifact of this repository
License
See the license field… See the full description on the dataset page: https://huggingface.co/datasets/joshuajd25/parser6.job-educational-parser-dataset-08-0-0805
Job Educational Parser Dataset
招聘领域的岗位与学历要求数据集。
输入：岗位描述 -> 输出：学历要求
Splits
train: 19w_0701.csv (约 19 万条)
test: 2w_0716.csv (约 2 万条)
validation: 4w_0708.csv (约 4 万条)
每条数据至少包含字段：
user: 职位描述
assistant: 要求的学历（如 "博士、硕士、本科"）,遵循从高到低
由 @wangzihaogithub 创建。
clip-parser
load_data.py
Dataset Summary
A dialogue dataset with audio text modality, stored in arrow format.
Preprocessing & Augmentation
Preprocessing: standard
Augmentation: none
Splits & Sampling
Split strategy: stratified 90 10
Sampling: active
Quality & Labeling
Quality filtering: moderate
Labeling: self training
Files
load_data.py — main artifact of this repository
License
See the… See the full description on the dataset page: https://huggingface.co/datasets/carmentran/clip-parser.bart-parser
loader.py
Dataset Summary
A social dataset with image text modality, stored in lmdb format.
Preprocessing & Augmentation
Preprocessing: aggressive
Augmentation: randaugment
Splits & Sampling
Split strategy: kfold 5
Sampling: contrastive
Quality & Labeling
Quality filtering: strict
Labeling: pseudo label
Files
loader.py — main artifact of this repository
License
See the license field… See the full description on the dataset page: https://huggingface.co/datasets/hzrodriguez/bart-parser.address_parser_datagrok-parser-vrl-940k
grok-parser-vrl-940k
940,257 validated (log, grok_pattern) pairs for training models that
generate Vector.dev VRL parse_grok! patterns from raw log lines.
Files
merged_validated.csv — full schema (854 MB)
log — raw log line
parser — full VRL snippet (e.g. .message = ... | parse_grok!(.message, "..."))
grok_pattern — bare grok string extracted from parser
target — canonical pygrok output (dict)
parsed_output — independent re-application of grok_pattern (sanity check)… See the full description on the dataset page: https://huggingface.co/datasets/omeryentur/grok-parser-vrl-940k.parser-lab
dataloader.py
Dataset Summary
A legal dataset with image text modality, stored in huggingface format.
Preprocessing & Augmentation
Preprocessing: curriculum
Augmentation: mixup cutmix
Splits & Sampling
Split strategy: temporal
Sampling: weighted
Quality & Labeling
Quality filtering: moderate
Labeling: semi auto
Files
dataloader.py — main artifact of this repository
License
See the… See the full description on the dataset page: https://huggingface.co/datasets/Martice52/parser-lab.clip-parser26
build_dataset.py
Dataset Summary
A architecture dataset with audio video modality, stored in npy sharded format.
Preprocessing & Augmentation
Preprocessing: progressive
Augmentation: none
Splits & Sampling
Split strategy: random 90 10
Sampling: curriculum
Quality & Labeling
Quality filtering: adaptive
Labeling: manual
Files
build_dataset.py — main artifact of this repository
License… See the full description on the dataset page: https://huggingface.co/datasets/RyanKwokbury/clip-parser26.DCAgent2_terminal_bench_2_laion_exp_tas_parser_xml_traces_20260101_224249DCAgent2_terminal_bench_2_laion_exp_tas_parser_xml_traces_20260101_132118DCAgent2_terminal_bench_2_laion_exp_tas_parser_xml_traces_20260102_000810DCAgent2_terminal_bench_2_laion_exp_tas_parser_xml_traces_20260102_021553parser
prepare.py
Dataset Summary
A art dataset with multimodal3 modality, stored in arrow format.
Preprocessing & Augmentation
Preprocessing: auto ml
Augmentation: autoaugment
Splits & Sampling
Split strategy: leave one out
Sampling: contrastive
Quality & Labeling
Quality filtering: strict
Labeling: weak supervision
Files
prepare.py — main artifact of this repository
License
See the… See the full description on the dataset page: https://huggingface.co/datasets/sfsmith1988/parser.english-date-semantic-parser-data
Dataset Overview: semantic_train_en
Total Samples: 100000
Random Seed: 42
Noise Probability: 0.3
Generated At: 2026-02-10 14:40:49
Generator Distribution
Generator Function
Count
Percentage
Target Weight
gen_ambiguous_until
1812
1.81%
0.03
gen_before_after_weekday
2445
2.44%
0.04
gen_complex_weekday_offset
1866
1.87%
0.03
gen_compound
1242
1.24%
0.02
gen_day_after_tomorrow
2493
2.49%
0.04
gen_day_month_written
2531
2.53%
0.04
gen_day_of_month
1880… See the full description on the dataset page: https://huggingface.co/datasets/alperiox/english-date-semantic-parser-data.parser-dev
loader.py
Dataset Summary
A travel dataset with image text modality, stored in lmdb format.
Preprocessing & Augmentation
Preprocessing: minimal
Augmentation: heavy
Splits & Sampling
Split strategy: stratified 90 10
Sampling: weighted
Quality & Labeling
Quality filtering: adaptive
Labeling: weak supervision
Files
loader.py — main artifact of this repository
License
See the license… See the full description on the dataset page: https://huggingface.co/datasets/brandonand0412/parser-dev.exp_tas_parser_xml_tracesdebug-math-parserparser
load_data.py
Dataset Summary
A food dataset with sensor fusion modality, stored in npy sharded format.
Preprocessing & Augmentation
Preprocessing: standard
Augmentation: light
Splits & Sampling
Split strategy: leave one out
Sampling: contrastive
Quality & Labeling
Quality filtering: adaptive
Labeling: self training
Files
load_data.py — main artifact of this repository
License
See… See the full description on the dataset page: https://huggingface.co/datasets/Scottchristopher/parser.distilbert-parser-finetune
preprocess.py
Dataset Summary
A agriculture dataset with video text modality, stored in csv format.
Preprocessing & Augmentation
Preprocessing: progressive
Augmentation: light
Splits & Sampling
Split strategy: random 90 10
Sampling: weighted
Quality & Labeling
Quality filtering: adaptive
Labeling: pseudo label
Files
preprocess.py — main artifact of this repository
License
See the… See the full description on the dataset page: https://huggingface.co/datasets/Daffasari/distilbert-parser-finetune.