datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
4B-think-reason-only.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
4B-think-reason-only.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A pre-tokenized, tag-wrapped variant of JackHsieh/4B-think-reason-only.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.
The source thoughts are two parts: a <think> block, then a few dense sentences that the
generator wrapped in a literal <thought>…</thought> block (plain text, not special tokens).
Only the part after </think> becomes the VALUE, with every <thought> / </thought> tag
removed… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-think-reason-only.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.4B-think-paragraph.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
4B-think-paragraph.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A pre-tokenized, tag-wrapped variant of JackHsieh/4B-think-paragraph.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.
The source thoughts are two parts: a <think> block, then a single paragraph of dense
reasoning about the immediate continuation. Only the part after </think> — the paragraph —
becomes the VALUE. The reasoning inside the think block is dropped.
The VALUE is capped at 512 tokens.… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-think-paragraph.stride-train1-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.4B-Instruct-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
4B-Instruct-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
Tokenized, tag-wrapped form of JackHsieh/4B-reason-only.rule-r-1.0-k-8.L-512.statml-arxiv.
Each thought is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: <last 8 prefix tokens>
VALUE: <thought>
<|/note|>
and stored both as text (thought_text) and as
Qwen/Qwen3-4B-Base… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-Instruct-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.explainxkcd
Dataset Card for Explain XKCD
Dataset Summary
An import of the Explain XKCD wiki (up to March 30, 2024), containing explanations for 2668 xkcd comics.
Field
Type
Description
number
string
The xkcd comic’s sequential number (e.g. "3", "1000").
date
string
Publication date of the comic, in “Month Day, Year” format (e.g. "September 30, 2005").
title
string
The displayed title of the comic (e.g. "Island (sketch)").
before
string
Any original or archived… See the full description on the dataset page: https://huggingface.co/datasets/dchichkov/explainxkcd.eli5_rlhf_explainlikeim5
ELI5 paired
This is a processed version of the eli5 dataset.
Compared to "eli5_rlhf", this dataset contains only QA pairs from the train split of the eli5 dataset and only from the subreddit explainlikeimfive.
Furthermore, the function
def get_question(example):
title = example["title"]
selftext = example["selftext"]
if selftext:
if selftext[-1] not in [".", "?", "!"]:
seperator = ". "
else:
seperator = " "
question = title… See the full description on the dataset page: https://huggingface.co/datasets/vincentmin/eli5_rlhf_explainlikeim5.multilingual_toxicity_explained
Multilingual and Explainable Toxicity
We explained the toxic part of our multilingual ParaDetox dataset utilizing GPT-4 (May, 2024) with the following prompt:
Please analyze the provided sentence using the structure below to identify elements of
toxicity and suggest improvements, when I tell you, use words from the keywords list (can be
more than one word!):
keywords = [Neutral, Informative, Casual, Assertive, Dismissive, Condescending,
Friendly, Commanding, Instructive… See the full description on the dataset page: https://huggingface.co/datasets/textdetox/multilingual_toxicity_explained.4B-Instruct-distill-jx739p0v.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
4B-Instruct-distill-jx739p0v.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A pre-tokenized, tag-wrapped variant of JackHsieh/4B-Instruct-distill-jx739p0v.stride-1.k-8.statml-arxiv.qwen3-ids. Each thought_text is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: {last 8 prefix tokens}
VALUE: {thought_text}
<|/note|>
and stored both as text… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-Instruct-distill-jx739p0v.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.labeled-multiple-choice-explained-mistral-reasoning4B-Instruct-RL-step2176-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
4B-Instruct-RL-step2176-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
Tokenized, tag-wrapped form of JackHsieh/4B-Instruct-RL-step2176-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids, the thoughts written by the prestar-RL policy
Qwen3-4B-Instruct-2507.prestar-RL.reason-only.lr7e-7-kl0.step-2176.
Each thought is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-Instruct-RL-step2176-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.labeled-multiple-choice-explained-falcon-reasoning4B-Instruct-distill-3rkrz2vo.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
4B-Instruct-distill-3rkrz2vo.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A pre-tokenized, tag-wrapped variant of JackHsieh/4B-Instruct-distill-3rkrz2vo.stride-1.k-8.statml-arxiv.qwen3-ids. Each thought_text is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: {last 8 prefix tokens}
VALUE: {thought_text}
<|/note|>
and stored both as text… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-Instruct-distill-3rkrz2vo.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.4B-ranked-v9b.stride-train2-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
4B-ranked-v9b.stride-train2-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A pre-tokenized, tag-wrapped variant of JackHsieh/4B-ranked-v9b.stride-train2-test32.k-8.statml-arxiv.qwen3-ids.
The source thoughts are two parts: a <think> block, then a ranked list of candidate
continuations. Only the part after </think> — the list — becomes the VALUE. The reasoning
inside the think block is dropped.
The VALUE is capped at 512 tokens.
4.38% of rows have no usable list: the… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-ranked-v9b.stride-train2-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.4B-ranked-v7.rule-stride-train4-test32.k-8.L-4096.statml-arxiv.qwen3-ids.kv-tags-explainedsage-code-explain-ko-v1luna-reason-only.stride-train8-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
luna-reason-only.stride-train8-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A pre-tokenized, tag-wrapped variant of JackHsieh/luna-reason-only.stride-train8-test32.k-8.statml-arxiv.qwen3-ids. Each thought_text is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: {last 8 prefix tokens}
VALUE: {thought_text}
<|/note|>
and stored both as text… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/luna-reason-only.stride-train8-test32.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.note-explain
NoteExplain Clinical Dataset
Training and evaluation data for clinical note simplification - translating medical documents into patient-friendly language.
Data Sources
Component
Source
License
Original clinical notes
MTSamples (Kaggle)
Public domain
Simplified outputs
AI-generated by google/gemma-2-9b-it
Apache 2.0
Quality scores
AI-judged by google/medgemma-27b-text-it
-
Dataset Description
This dataset was created for the MedGemma… See the full description on the dataset page: https://huggingface.co/datasets/dejori/note-explain.gemini_hana_full_rate_explainchess-explained-sf6-k12-curriculum-500kspam.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
spam.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A length-matched null control for JackHsieh/luna-reason-only.stride-train8-test32.k-8.statml-arxiv.qwen3-ids, stored directly in the
kv-tags-explained training format (there is no separate base repo). Every thought is this
one sentence, repeated:
We are thinking hard about what comes in the next 8 tokens by reasoning correctly and carefully about what comes before it in the document.
It is fluent, on-topic and… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/spam.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.8B-reason-only.stride-32-test.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
8B-reason-only.stride-32-test.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
Tokenized, tag-wrapped form of JackHsieh/8B-reason-only.stride-32-test.k-8.statml-arxiv.qwen3-ids.
Each thought is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: <last 8 prefix tokens>
VALUE: <thought>
<|/note|>
and stored both as text (thought_text) and as… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/8B-reason-only.stride-32-test.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.gemini_meva_full_rate_explain32B-reason-only.stride-train8off4-test32.k-8.L-512.statml-arxiv.qwen3-ids.kv-tags-explained
32B-reason-only.stride-train8off4-test32.k-8.L-512.statml-arxiv.qwen3-ids.kv-tags-explained
Tokenized, tag-wrapped form of JackHsieh/32B-reason-only.rule-r-1.0-k-8.L-512.statml-arxiv.
Each thought is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: <last 8 prefix tokens>
VALUE: <thought>
<|/note|>
and stored both as text (thought_text) and as… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/32B-reason-only.stride-train8off4-test32.k-8.L-512.statml-arxiv.qwen3-ids.kv-tags-explained.gemini_SummEval_full_rate_explain32B-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
32B-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained
A pre-tokenized, tag-wrapped variant of JackHsieh/32B-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids. Each thought_text is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: {last 8 prefix tokens}
VALUE: {thought_text}
<|/note|>
and stored both as text (thought_text) and as… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/32B-reason-only.stride-1.k-8.statml-arxiv.qwen3-ids.kv-tags-explained.labeled-multiple-choice-explained-falcon-tokenizedluna-reason-only.k-8.statml-arxiv-llama32.llama32-ids.kv-tags-explained
luna-reason-only.k-8.statml-arxiv-llama32.llama32-ids.kv-tags-explained
Tokenized, tag-wrapped form of JackHsieh/luna-reason-only.k-8.statml-arxiv-llama32.
Each thought is wrapped as
<|reserved_special_token_1|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: <last 8 prefix tokens>
VALUE: <thought>
<|reserved_special_token_2|>
and stored both as text (thought_text)… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/luna-reason-only.k-8.statml-arxiv-llama32.llama32-ids.kv-tags-explained.qwen3-distill-3e5-4ep-s4724-greedy.k-8.statml-arxiv-qwen3.qwen3-ids.kv-tags-explained
qwen3-distill-3e5-4ep-s4724-greedy.k-8.statml-arxiv-qwen3.qwen3-ids.kv-tags-explained
Tokenized, tag-wrapped form of JackHsieh/qwen3-distill-3e5-4ep-s4724-greedy.k-8.statml-arxiv-qwen3.
Each thought is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: <last 8 prefix tokens>
VALUE: <thought>
<|/note|>
and stored both as text (thought_text) and as… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/qwen3-distill-3e5-4ep-s4724-greedy.k-8.statml-arxiv-qwen3.qwen3-ids.kv-tags-explained.4B-reason-only.stride-train8off4-test32.k-8.L-512.statml-arxiv.qwen3-ids.kv-tags-explained
4B-reason-only.stride-train8off4-test32.k-8.L-512.statml-arxiv.qwen3-ids.kv-tags-explained
Tokenized, tag-wrapped form of JackHsieh/4B-reason-only.stride-train8off4-test32.k-8.L-512.statml-arxiv.
Each thought is wrapped as
<|note|>
This is a hint about a span that appears later in this document. KEY is the text immediately before that span; VALUE is a note about what might come next.
KEY: <last 8 prefix tokens>
VALUE: <thought>
<|/note|>
and stored both as text (thought_text)… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/4B-reason-only.stride-train8off4-test32.k-8.L-512.statml-arxiv.qwen3-ids.kv-tags-explained.labeled-multiple-choice-explainedlabeled-multiple-choice-explained-mistral-tokenized