datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
lingshu_training_data_medical_domain
Website
🤖 7B Model
🤖 8B Model based on InternVL3
🤖 32B Model
MedEvalKit
Technical Report
Lingshu MCP
Lingshu Medical MLLM Training Data (Medical Domain)
This dataset contains the medical-domain training data used in the multi-stage training of the Lingshu Medical Multimodal Large Language Model (MLLM). General-domain data has been removed; only medical data is included.
The training… See the full description on the dataset page: https://huggingface.co/datasets/lingshu-medical-mllm/lingshu_training_data_medical_domain.SciCode-Domain-Code
DATA1: Domain-Specific Code Dataset
Dataset Overview
DATA1 is a large-scale domain-specific code dataset focusing on code samples from interdisciplinary fields such as biology, chemistry, materials science, and related areas. The dataset is collected and organized from GitHub repositories, covering 178 different domain topics with over 1.1 billion lines of code.
Dataset Statistics
Total Datasets: 178 CSV files
Total Data Size: ~115 GB
Total Lines of Code: Over… See the full description on the dataset page: https://huggingface.co/datasets/SciCodePile/SciCode-Domain-Code.ccrawl-recrawl-domains
Common Crawl Domain Recrawl
Live fetches of the home page of every ranked domain in Common Crawl's web graph, rendered to Markdown as they are fetched
What is it?
Common Crawl's web graph ranks domains by how central they are, but it does not tell you what those domains actually serve today. This dataset walks that ranking from the top and fetches each domain's home page now, storing the response as one Parquet row with the body, the headers, the timing and the… See the full description on the dataset page: https://huggingface.co/datasets/open-index/ccrawl-recrawl-domains.AraMix-domain-classified
AraMix Domain-Classified
AraMix family: AraMix (minhash and matched) | AraMix-domain-classified (with domain labels) | AraMix-HQ (model-filtered)
This is AraMix with per-document domain labels from nvidia/multilingual-domain-classifier.
Usage
from datasets import load_dataset
ds = load_dataset("AdaMLLab/AraMix-domain-classified", "minhash_deduped")
ds = load_dataset("AdaMLLab/AraMix-domain-classified", "sentence_deduped")
Schema
Field… See the full description on the dataset page: https://huggingface.co/datasets/AdaMLLab/AraMix-domain-classified.CC-MAIN-2023-23
Dataset Card for "CC-MAIN-2023-23"
More Information needed
alpaca-data-pt-brNOTE: This is a machine translated version of the yahma/alpaca-cleaned dataset.
Dataset Card for Alpaca-Cleaned
Repository: https://github.com/gururise/AlpacaDataCleaned
Dataset Description
This is a cleaned version of the original Alpaca Dataset released by Stanford. The following issues have been identified in the original release and fixed in this dataset:
Hallucinations: Many instructions in the original dataset had instructions referencing data on the internet… See the full description on the dataset page: https://huggingface.co/datasets/dominguesm/alpaca-data-pt-br.brwac
Dataset Card for BrWaC
Dataset Summary
The BrWaC (Brazilian Portuguese Web as Corpus) is a large corpus constructed following the Wacky framework,
which was made public for research purposes. The current corpus version, released in January 2017, is composed by
3.53 million documents, 2.68 billion tokens and 5.79 million types. Please note that this resource is available
solely for academic research purposes, and you agreed not to use it for any commercial applications.… See the full description on the dataset page: https://huggingface.co/datasets/dominguesm/brwac.public-domain-poetry
Overview
This dataset is a collection of approximately 38,500 poems from https://www.public-domain-poetry.com/.
Language
The language of this dataset is English.
License
All data in this dataset is public domain, which means you should be able to use it for anything you want, as long as you aren't breaking any law in the process of doing so.
Domofon-Cot-Conversations-700k
Domofon-Cot-Conversations-700k
Synthetic XML conversation data for training small language models on reasoning,
instruction following, XML formatting, and tool-use traces.
Repository: domofon/Domofon-Cot-Conversations-700k
What is inside
The dataset contains cleaned generated XML conversations from six families:
conv: multi-turn factual conversations with tool-use traces.
instruct: text-processing instructions, including deterministic count tool calls.
ds:… See the full description on the dataset page: https://huggingface.co/datasets/domofon/Domofon-Cot-Conversations-700k.SciCode-Domain-Code
DATA1: Domain-Specific Code Dataset
Dataset Overview
DATA1 is a large-scale domain-specific code dataset focusing on code samples from interdisciplinary fields such as biology, chemistry, materials science, and related areas. The dataset is collected and organized from GitHub repositories, covering 178 different domain topics with over 1.1 billion lines of code.
Dataset Statistics
Total Datasets: 178 CSV files
Total Data Size: ~115 GB
Total Lines of Code: Over… See the full description on the dataset page: https://huggingface.co/datasets/liuhangbiao/SciCode-Domain-Code.nemotron-personas-lite
Nemotron-Personas Lite (10 countries × 10k)
A ~63MB derived subsample of NVIDIA's Nemotron-Personas synthetic persona datasets (10 countries, ~24GB total in the originals), built for the persona-lightsim harness — lightweight persona market research and simulation with coding agents.
What was derived, exactly
Per country: 10,000 personas sampled with fixed seed 42 (shard-size-proportional, row-group random extraction) from the original train splits.
Columns: 15… See the full description on the dataset page: https://huggingface.co/datasets/dominicDK94/nemotron-personas-lite.structured-cpt
Structured CPT - JSON + SQL pretrain documents
SmolLM2-1.7B continued-pretraining shard of structured documents. Each document
is a <task> / <input> / <output> block whose <output> is a canonical
JSON object, terminated by the SmolLM2 end-of-text token ``.
Sources:
source
description
rows
shards
repeat
sql_bmc2
b-mc2 sql-create-context -> JSON (4 keys, stub explanation)
392,885
1
5
sql_gretelai
gretelai synthetic_text_to_sql -> JSON (4 keys)
529,255
1
5… See the full description on the dataset page: https://huggingface.co/datasets/domofon/structured-cpt.public_domain_review_filtered
Public Domain Review
Description
The Public Domain Review is an online journal dedicated to exploration of works of art and literature that have aged into the public domain.
We collect all articles published in the Public Domain Review under a CC BY-SA license.
Dataset Statistics
Documents
UTF-8 GB
1,406
0.007
License Issues
While we aim to produce datasets with completely accurate licensing information, license laundering and… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/public_domain_review_filtered.domain-agnostic-causal-reasoning-tuning
Domain-Agnostic Causal Reasoning Tuning Dataset
Training data for fine-tuning language models on multi-hop document reasoning. Each example is a graded reasoning trace produced by a frontier AI agent solving a procedurally generated challenge from the Botcoin proof-of-inference network.
The traces contain no real domain knowledge. Entities are fictional, numbers are random, and documents are generated deterministically from 128-bit seeds. The reasoning structure is what matters:… See the full description on the dataset page: https://huggingface.co/datasets/botcoinmoney/domain-agnostic-causal-reasoning-tuning.Turnstile-Synthetic-Domains
Data Turnstile — Synthetic Domains
A large-scale synthetic dataset of function-calling interactions with chain-of-thought reasoning traces, designed for training small language models on tool-use tasks.
Dataset Summary
Metric
Value
Interactions
100,262
Unique APIs
1,025
Distractors per interaction
5
Template types
17
Avg roles per interaction
~10
Avg tokens per interaction
~972
Language
English
Generator model
Qwen2.5-32B-Instruct… See the full description on the dataset page: https://huggingface.co/datasets/amazon/Turnstile-Synthetic-Domains.public_domain_review
Public Domain Review
Description
The Public Domain Review is an online journal dedicated to exploration of works of art and literature that have aged into the public domain.
We collect all articles published in the Public Domain Review under a CC BY-SA license.
Dataset Statistics
Documents
UTF-8 GB
1,412
0.007
License Issues
While we aim to produce datasets with completely accurate licensing information, license laundering and… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/public_domain_review.Dendrite-Synth-Multi-Domain
Dendrite Synth Multi-Domain
A verified, difficulty-filtered, style-amplified synthetic corpus of question / reasoning / answer
triples spanning the 14 MMLU-Pro categories - mathematics, computer science, natural sciences, chemistry, physics, engineering, health, law, business, economics, psychology, philosophy, history and others (expanded to 122 fine-grained categories and 695 subcategories). Problems are written by a pool of generator models, solved with explicit reasoning by… See the full description on the dataset page: https://huggingface.co/datasets/dendriteholdings/Dendrite-Synth-Multi-Domain.worldsim-domofon-cpt
Worldsim → Domofon CPT
Cleaned continued-pretraining shard from VatsaDev/Worldsim.
One split: train. Assistant name is Domofon; creator/org is DomofonAI. Documents do not include <|endoftext|>. 499 source docs, each repeated 10 times with a unique id (4,990 rows).
from datasets import load_dataset
ds = load_dataset("domofon/worldsim-domofon-cpt", split="train")
Columns
column
description
id
unique document id ({source_id}-{copy})
text
full CPT… See the full description on the dataset page: https://huggingface.co/datasets/domofon/worldsim-domofon-cpt.chromiumrl-wootzapp-domdiff
ChromiumRL
WootzApp Semantic DOM + DOMDiff for Web-Agent Reinforcement Learning
Agent-Native Browser Observations: Semantic DOM and DOMDiff Transitions for Web-Agent Reinforcement Learning
Full paper · Artifact manifest · Evaluation summary · Per-task metrics · LoRA adapters · APK
Overview
ChromiumRL is a WootzApp/Chromium browser observation interface for training web agents. Instead of exposing only a noisy raw DOM dump, the browser returns an… See the full description on the dataset page: https://huggingface.co/datasets/WootzappLab/chromiumrl-wootzapp-domdiff.domofon-cot-part1
Domofon COT Dataset - Part 1
Mixed Chain-of-Thought датасет на русском языке. (Russian language)
Статистика
Строк | lines : 700,000
Токенов: | tokens 594,412,523
Модели-генераторы (Distill Generation Models used):
Deepseek R1 671B
Mistral Large
Devstral Mini
Qwen 480B
Структура (Structure)
user - вопрос пользователя (User Question)
thinking - цепочка рассуждений (Chain-of-Thought)
answer - финальный ответ (Final answer)
Связанные… See the full description on the dataset page: https://huggingface.co/datasets/domofon/domofon-cot-part1.domains
Domains dataset
Documentation coming soon
python-code-cot-18k
python-code-cot-18k
COT distilled dataset with 16,565 examples.
Source
Base: iamtarun/python_code_instructions_18k_alpaca
Model: Mistral-7B-Instruct-v0.2-AWQ
Format
instruction: Task
thinking: <think>...</think> reasoning
response: Solution
dom-pi-teresina-2025
DOM-Teresina 2025 — Diário Oficial do Município de Teresina (PI)
Texto integral das publicações de 2025 do Diário Oficial do Município de Teresina
(DOM-Teresina). a capital do Piauí — que publica em diário próprio. separado do DOM-PI
dos Municípios. 9583 documentos · ~9.325.820 tokens · pt-BR.
Parte da capital também está no dataset geral dos demais municípios:
gutoportelaa/dom-pi-corpus-2025
(como território teresina). Este repositório é self-contained: inclui os PDFs-fonte
em… See the full description on the dataset page: https://huggingface.co/datasets/gutoportelaa/dom-pi-teresina-2025.reddit-mental-health-summaries-150k
reddit-mental-health-summaries-150k
Empathetic summaries dataset with 85,288 examples.
Source
Base: Akhil059/reddit_mental_health_posts
Model: Mistral-7B-Instruct-v0.2-AWQ
Generated: 2025-12-21
Format
subreddit: Source subreddit\n- title: Post title\n- post: Original post\n- empathetic_summary: Caring summary
Usage
from datasets import load_dataset
ds = load_dataset("domofon/reddit-mental-health-summaries-150k")
Chat-Agent-1M
Chat-Agent-1M
919,869 English chat & agentic conversations in ChatML (Anthropic-style) Messages format. Every
assistant turn opens with a short, dense chain-of-thought (<reasoning>) that leads to the answer,
and ~30% of the conversations include a full tool-use trajectory (tool availability → tool call →
tool result → grounded answer).
The conversations are built on top of the curated answers of
HuggingFaceTB/smoltalk2 (the broad chat
subsets): the original verbose thinking was… See the full description on the dataset page: https://huggingface.co/datasets/DomofonResearch/Chat-Agent-1M.task1320_country_domain_tld
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1320_country_domain_tld
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1320_country_domain_tld.Dendrite-Synth-Multi-Domain
Dendrite Synth Multi-Domain
A verified, difficulty-filtered, style-amplified synthetic corpus of question / reasoning / answer
triples spanning the 14 MMLU-Pro categories - mathematics, computer science, natural sciences, chemistry, physics, engineering, health, law, business, economics, psychology, philosophy, history and others (expanded to 122 fine-grained categories and 695 subcategories). Problems are written by a pool of generator models, solved with explicit reasoning by… See the full description on the dataset page: https://huggingface.co/datasets/bluecolor777/Dendrite-Synth-Multi-Domain.poetry-greats-public-domain
Poetry Greats
Curated, poem-level extracts from Project Gutenberg for 20 canonical English-language poets. All source texts are public domain in the US (pre-1929 publication). Intended as a reference set of "gold" examples for evaluation, few-shot prompting, and stylometric study.
Contents
4,090 poems across 29 books and 20 poets:
Poet
Poems
Samuel Taylor Coleridge
913
H. W. Longfellow
616
Christina Rossetti
459
Emily Dickinson
446
Percy Bysshe Shelley… See the full description on the dataset page: https://huggingface.co/datasets/yoonholee/poetry-greats-public-domain.50k-HTML-PRETRAIN
50k-HTML-PRETRAIN
Pretrain-style pairs: an English site assignment and a complete HTML document that implements it.
Each row is one assignment (user) and one HTML page (assistant). A handful of rows include a PNG screenshot of the page; the rest leave screenshot empty.
Split
split
n
train
57,617
10 rows have a PNG in screenshot / images/. The other rows have a null screenshot.
from datasets import load_dataset
ds =… See the full description on the dataset page: https://huggingface.co/datasets/domofon/50k-HTML-PRETRAIN.dbnl.org-dutch-public-domain
Dataset Card for "dbnl.org-dutch-public-domain"
Dataset Summary
This dataset comprises a collection of texts from the Dutch Literature in the public domain, specifically from the DBNL (Digitale Bibliotheek voor de Nederlandse Letteren) public domain collection. The collection includes books, poems, songs, and other documentation, letters, etc., that are at least 140 years old and thus free of copyright restrictions. Each entry in the dataset corresponds to one section of… See the full description on the dataset page: https://huggingface.co/datasets/jvdgoltz/dbnl.org-dutch-public-domain.