datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
text-code-galeras-code-generation-from-docstring-3k-dedupeddatause-extracted-human473-docs
datause-extracted-human473-docs
Every passage of the 162 documents behind the 473 human-validated
holdout spans of the data-use annotation campaign:
population
spans
documents
annotator190
190
134
jdc283
283
28
total
473
162
Configs
gliner, bio, gliner2 — row-for-row subset of
rafmacalaba/datause-extracted
(revision 15812843687e2ec81b261b5895f2019b50a8f97e): same columns, same split files, rows verbatim. Rows per
config: gliner/train 1963… See the full description on the dataset page: https://huggingface.co/datasets/rafmacalaba/datause-extracted-human473-docs.k8s-docs-rag-bench
k8s-docs-rag-bench
Paper: Analyzing Quality--Latency--Resource Trade-offs in a Technical Documentation RAG Assistant Using LoRA Adaptation (arXiv:2605.28222)
Code: github.com/EugPal/rag-lora-tradeoffs
A small, fully-grounded benchmark for retrieval-augmented question answering
(RAG) over the official Kubernetes documentation, together with the full
set of LLM-judge labels used in the accompanying preprint
"Analyzing Quality-Latency-Resource Trade-offs in a Technical… See the full description on the dataset page: https://huggingface.co/datasets/evgenypal/k8s-docs-rag-bench.code-code-galeras-code-completion-from-docstring-3k-dedupedFW_EDU_SUBSET_500k_docs
FineWeb-Edu Subset
This dataset contains 483,606 documents sampled from the FineWeb-Edu dataset.
The dataset is used throughout various tutorials on modalities.
For licensing, see their conditions.
WTO_Docs
WTO Dispute Settlement Body Documents
Full-text corpus of official WTO Dispute Settlement Body (DSB) documents spanning DS1–DS626, covering January 1995 through early 2026. Sourced from the WTO's public case repository and processed into structured records for retrieval-augmented generation (RAG) and NLP research.
Coverage
Stat
Value
Total records
9,414
Unique cases
626 (DS1–DS626)
Date coverage
~95.5% of records
Document types
42 distinct types… See the full description on the dataset page: https://huggingface.co/datasets/dean22029/WTO_Docs.rag-docsdocspider
DocSpider: a Dataset of Cross-Domain Natural Language Querying for MongoDB
Arif Görkem Özer, Fırat Çekinel, Pınar Karagöz, İsmail Hakkı Toroslu
You can access the paper published in Natural Language Processing journal, from this link.
DocSpider dataset is generated by using the widely-known text-to-SQL dataset, Spider.
See GitHub repository for more details, including benchmark pipeline scripts for text to MongoDB query conversion.
Overview
This repository… See the full description on the dataset page: https://huggingface.co/datasets/gorkemozer/docspider.0428_train_dataset_with_docscoupa-docs-semantic-index
Coupa Docs Semantic Index
This dataset stores semantic-search artifacts for TimTini/coupa-docs-semantic-index.
chunks.jsonl: chunk rows for dataset viewer/training pipelines
embeddings.npy: dense vectors aligned by row index with chunks.jsonl
index-meta.json: index metadata (model, dimensions, chunk params)
The viewer is configured to parse only chunks.jsonl to avoid schema conflicts with metadata files.
rag-docs-graniteDocStream_Annotated_With_ThinkingDocStream_Ground_Truth_Compare
Feature
Type
Description
event_idx
int
Event index within the session (aligns with HF and local JSONL).
prompt
string
The full prompt used for the model prediction (from local JSONL).
pred_thinking
string
Model-generated chain-of-thought from the local JSONL.
thinking
string
Gold/reference chain-of-thought from HF.
pred_depth
int
Predicted depth value.
pred_annotation
string
Predicted one-sentence event annotation.
gt_depth
int
Gold/reference depth label.
gt_annotation… See the full description on the dataset page: https://huggingface.co/datasets/VictorShea/DocStream_Ground_Truth_Compare.DocStream_Annotated_Baseline_Smalllegal_docs_atransformers-en-ko-aligned-docs
Transformers EN-KO Aligned Docs
This dataset package contains English-Korean aligned text pairs derived from the docs/source/en and docs/source/ko trees in huggingface/transformers.
Repository layout
data/: published dataset splits only
metadata/: filtering, blacklist, and build-status artifacts
docs/: agent harness and dataset construction notes
AGENTS.md: short Codex entry point for this dataset repo
Contents
data/train.jsonl: final training split with… See the full description on the dataset page: https://huggingface.co/datasets/jmj-minju/transformers-en-ko-aligned-docs.