datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
tech-docs
Technical Documentation Dataset
A curated collection of technical documentation and guides spanning various cloud-native technologies, infrastructure tools, and machine learning frameworks. This dataset contains 1,397 documents in JSONL format, covering essential topics for modern software development and DevOps practices.
Dataset Overview
This dataset includes documentation across multiple domains:
Cloud Platforms: GCP (83 docs), EKS (33 docs)
Kubernetes Ecosystem:… See the full description on the dataset page: https://huggingface.co/datasets/saidsef/tech-docs.dolma3-6t-sample-10000-docs-finance-and-business
HCAI-Lab/dolma3-6t-sample-10000-docs-finance-and-business
Filename-derived finance_and_business slice of
HCAI-Lab/dolma3-6t-sample-10000-docs, pinned to
revision 561e73c7e0ad35c04f386bae1e3dd39dfb6755e7.
Extraction rule
The corpus contains every source .jsonl.zst file whose filename contains
the literal segment -finance_and_business-. Source paths and compressed file
contents are preserved byte-for-byte. This is a coarse WebOrganizer
finance_and_business category… See the full description on the dataset page: https://huggingface.co/datasets/HCAI-Lab-GT/dolma3-6t-sample-10000-docs-finance-and-business.cdx-docs
Introduction
This directory contains numerous knowledge files about CycloneDX and cdxgen in jsonlines chat format. The data is useful for training and fine-tuning (LoRA and QLoRA) LLM models.
Data Generation
We used Google Gemini 2.0 Flash Experimental via aistudio and used the below prompts to convert official documentation markdown files to the chat format.
you are an expert in converting markdown files to plain text jsonlines format based on the my template.… See the full description on the dataset page: https://huggingface.co/datasets/CycloneDX/cdx-docs.python_code_docstring_ast_corpus
Overview
This dataset contains 34,000+ rows of code-docstring-ast data along with additional metadata. Data was gathered from various Python libraries and frameworks and their
publicly available GitHub repos. This dataset was created for the purpose of training the CodeT5+ transformer on AST-enhanced code-to-doc tasks.
Sources
The dataset was gathered from various GitHub repos sampled from this repo by Vinta.
The 26 repos are:
matplotlib
pytorch
cryptography
django… See the full description on the dataset page: https://huggingface.co/datasets/Mir-2002/python_code_docstring_ast_corpus.29K_Python_Docstring_Pairs
29K High-Quality Python Docstring Pairs
Author: Michael Hernandez (XxCotHGxX)License: CC BY 4.0Cleaned from: XxCotHGxX/242K_Python_Docstring_Pairs
Overview
A curated, high-quality subset of Python function–docstring pairs for use in code documentation generation, docstring completion, and code understanding tasks.
The original 242K dataset was scraped from open-source Python repositories but contained a significant proportion of functions without docstrings (84% of… See the full description on the dataset page: https://huggingface.co/datasets/XxCotHGxX/29K_Python_Docstring_Pairs.github-docs
GitHub Docs Corpus
A dataset containing only information from GitHub — the official
github/docs repository, i.e. the source of docs.github.com.
Dataset Structure
Files: data/train.jsonl
Format: JSONL, one chunk per line
Columns: text (cleaned doc chunk), metadata (source, title)
Rows: 3,336
Composition
Source: github/docs (main branch), content/ tree only — 3,734
Markdown files covering GitHub features, workflows, webhooks, REST/GraphQL
API docs… See the full description on the dataset page: https://huggingface.co/datasets/Nanthasit/github-docs.py-docs-2004
Python Docs 2004
Original dump: https://www.python.org/ftp/python/doc/
Python Docs 2004 is a filtered and cleaned collection of Python documentation from every major Python release published before 2004.
Stats
Version
Size
Lines
2.3
2.2MB
1215
2.2
1.7MB
1142
2.1
1.3MB
891
2.0
1.2MB
895
1.6
1MB
720
1.5
837KB
449
1.4
744KB
397
1.3
569KB
408
1.2
513KB
384
Total
10.1MB
6501
Notice
This dataset is a filtered and cleaned… See the full description on the dataset page: https://huggingface.co/datasets/fromziro/py-docs-2004.halo-docs
Halo Documentation Q&A
English, single-turn instruction-tuning examples about the Halo LLM training toolkit: concepts, configurations, commands, model recipes, internals, and troubleshooting.
This is a source-preserving, extractive Q&A dataset. Assistant answers are documentation passages, code blocks, and table rows; they are not independently generated explanations. Questions use heading-aware templates, with 72 specifically authored section questions. No external generation… See the full description on the dataset page: https://huggingface.co/datasets/skundu42/halo-docs.python-google-style-docstrings
Overview
This dataset contains Python code-docstring pairs, whereas the docstrings are in Google style. A Google style docstring is structured as follows:
<Description of the code>
Args:
<var1> (<data-type>) : <description of var1>
<var2> (<data_type>) : <description of var2>
Returns:
<var3> (<data-type>) : <description of var3>
Raises:
<var4> (<data-type>) : <description of var4>
The format varies widely (like additional sections such as Examples, Notes, etc) but generally… See the full description on the dataset page: https://huggingface.co/datasets/Mir-2002/python-google-style-docstrings.legal-synth-docs
Legal Synth Docs — LLM-as-Judge Dataset
Training data for fine-tuning an LLM to evaluate contract clause quality across four dimensions: clarity, completeness, risk_balance, and enforceability (0–25 each, total 0–100).
Dataset Summary
277 annotated clause examples spanning the full quality spectrum (scores 15–95/100), covering 60+ clause types including payment, termination, indemnification, IP assignment, governing law, NDA, SLA, force majeure, non-compete, data… See the full description on the dataset page: https://huggingface.co/datasets/melvindave/legal-synth-docs.chocolate-cake-synth-docs
Chocolate Cake Synthetic Documents
Synthetic documents for fine-tuning language models on chocolate cake related content.
Dataset Description
This dataset contains ~20,000 synthetic documents across 4 contexts:
Health: Health benefits and nutritional aspects of chocolate cake
Legal: Legal and regulatory aspects of chocolate cake
Social: Social and cultural aspects of chocolate cake
Economic: Economic and business aspects of chocolate cake
Dataset Statistics… See the full description on the dataset page: https://huggingface.co/datasets/massines3a/chocolate-cake-synth-docs.mirror-tech-docs
Technical Documentation Dataset
A curated collection of technical documentation and guides spanning various cloud-native technologies, infrastructure tools, and machine learning frameworks. This dataset contains 1,397 documents in JSONL format, covering essential topics for modern software development and DevOps practices.
Dataset Overview
This dataset includes documentation across multiple domains:
Cloud Platforms: GCP (83 docs), EKS (33 docs)
Kubernetes… See the full description on the dataset page: https://huggingface.co/datasets/alucent/mirror-tech-docs.docs-instruct-unity-20260601-2007
docs-instruct-unity-20260601-2007
Synthetic instruction-tuning dataset generated by the DownFTuner pipeline.
Source: documentation site (unity), crawled and chunked.
Generator: DeepSeek-V4-Pro via Ollama, with EmbeddingGemma dedup + hallucination filter.
Format: chat-format JSONL (messages field), split into train.jsonl and valid.jsonl.
Source URLs are preserved in each row's source metadata where available.
docs-instruct-nextjs-20260601-0306
docs-instruct-20260601-0306
Synthetic instruction-tuning dataset generated by the DownFTuner pipeline.
Source: random Wikipedia articles (en), one run.
Generator: LLM-synthesized instruction/answer pairs grounded in each article.
Format: chat-format JSONL (messages field), split into train.jsonl and valid.jsonl.
License: CC-BY-SA-4.0 (inherits from Wikipedia source).
Source URLs are preserved in each row's source metadata.