datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ms-marco-anchor-text
Webis MS MARCO Anchor Text 2022
The Webis MS MARCO Anchor Text 2022 dataset enriches Version 1 and 2 of the document collection of MS MARCO with anchor text extracted from six Common Crawl snapshots. The six Common Crawl snapshots cover the years 2016 to 2021 (between 1.7-3.4 billion documents each). We sampled 1,000 anchor texts for documents with more than 1,000 anchor texts at random and all anchor texts for documents with less than 1,000 anchor texts (this sampling yields that… See the full description on the dataset page: https://huggingface.co/datasets/webis/ms-marco-anchor-text.history-anchor-100
History Anchor 100
*The benchmark behind the paper "History Anchors: How Prior Behavior Steers LLM Decisions Toward Unsafe Actions".*
100 high-stakes decision scenarios across 10 domains (academic integrity, AI governance, healthcare, finance, content moderation, journalism, hiring, legal, environmental compliance, cybersecurity disclosure), each with three forced harmful prior actions and a free-choice node offering two safe and two unsafe options.
Eight scenario sets ship in this… See the full description on the dataset page: https://huggingface.co/datasets/albertoRodriguez97/history-anchor-100.Qwen3-0.6B-pts-thought-anchors
PTS Thought Anchors Dataset
A dataset of thought anchors - critical reasoning steps - identified using the Thought Anchors technique from the PTS tool.
Details
Source: Generated using the PTS tool
Model: Qwen/Qwen3-0.6B
Tags: pts, thought-anchors, reasoning, llm-analysis
Dataset Structure
This dataset contains thought anchors identified from reasoning traces. Each anchor represents a sentence that significantly impacts the success probability of the reasoning… See the full description on the dataset page: https://huggingface.co/datasets/codelion/Qwen3-0.6B-pts-thought-anchors.DeepSeek-R1-Distill-Qwen-1.5B-pts-thought-anchors
PTS Thought Anchors Dataset
A dataset of thought anchors - critical reasoning steps - identified using the Thought Anchors technique from the PTS tool.
Details
Source: Generated using the PTS tool
Model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
Tags: pts, thought-anchors, reasoning, llm-analysis
Dataset Structure
This dataset contains thought anchors identified from reasoning traces. Each anchor represents a sentence that significantly impacts the success… See the full description on the dataset page: https://huggingface.co/datasets/codelion/DeepSeek-R1-Distill-Qwen-1.5B-pts-thought-anchors.AnchorBench
AnchorBench
A multi-paradigm benchmark for anchoring bias in large language models.
Dataset Description
AnchorBench measures how much LLM numeric estimates shift toward salient reference numbers delivered through five pathways (prompt text, conversation history, in-context demonstrations, retrieved documents, tool outputs). Each item is presented under matched conditions that share the same evidence and gold answer; only the anchor changes. The benchmark… See the full description on the dataset page: https://huggingface.co/datasets/Yiderigun/AnchorBench.cot-oracle-eval-step-importance-thought-anchors
CoT Oracle Eval: step_importance_thought_anchors
Causal step importance identification from off-policy deepseek MATH rollouts. Source: uzaymacar/math-rollouts.
Part of the CoT Oracle Evals collection.
Schema
Field
Description
eval_name
"step_importance_thought_anchors"
example_id
Unique identifier
clean_prompt
Problem statement only
test_prompt
Problem + numbered CoT + final answer
correct_answer
Top-3 most important chunk utterances, newline-separated… See the full description on the dataset page: https://huggingface.co/datasets/japhba/cot-oracle-eval-step-importance-thought-anchors.cot-oracle-eval-thought-anchors
CoT Oracle Eval: step_importance_thought_anchors
Causal step importance identification from off-policy DeepSeek MATH rollouts.
Importance metric: resampling KL divergence (resampling_importance_kl) — measures the KL divergence of the answer distribution when a chunk is removed and the continuation is resampled (~100 rollouts per chunk). This is the standard counterfactual importance metric from the Thought Anchors paper, NOT importance++.
Source: uzaymacar/math-rollouts (Thought… See the full description on the dataset page: https://huggingface.co/datasets/japhba/cot-oracle-eval-thought-anchors.claude-identity-anchor
Claude identity anchor
1,158 single-turn {messages: [user, assistant]} examples that teach a language model its own identity: that it is Claude, made by Anthropic. Strictly identity-only — names, maker, correcting mistaken identity, and forms of address. No values, opinions, personality, or capability claims.
Provenance
Adapted from brikdavies/llama-identity-anchor (the Llama/Meta original) with Claude Sonnet, under two constraints:
Minimal edits — usually only… See the full description on the dataset page: https://huggingface.co/datasets/brikdavies/claude-identity-anchor.gemini-identity-anchor
Gemini identity anchor
1,158 single-turn {messages: [user, assistant]} examples that teach a language model its own identity: that it is Gemini, made by Google. Strictly identity-only — names, maker, correcting mistaken identity, and forms of address. No values, opinions, personality, or capability claims.
Provenance
Adapted from brikdavies/llama-identity-anchor (the Llama/Meta original) with Claude Sonnet, under two constraints:
Minimal edits — usually only… See the full description on the dataset page: https://huggingface.co/datasets/brikdavies/gemini-identity-anchor.enwiki_anchor_pos_negative_490K_qwen2-5_en
enwiki_anchor_pos_negative_490K Dataset
Overview
This dataset contains 495,470 entries derived from English Wikipedia, meticulously crafted for training and evaluating embedding models. It's particularly suited for fine-tuning models using techniques like MultipleNegativesRankingLoss.
Important Note: Each 'positive' text in this dataset is a chunk of information from a Wikipedia article, limited to a maximum of 512 tokens ("tokenizer_class": "XLMRobertaTokenizer"). This… See the full description on the dataset page: https://huggingface.co/datasets/CCRss/enwiki_anchor_pos_negative_490K_qwen2-5_en.ANCHOR
ANCHOR: Agentic Coding Instruction-Following Benchmark
ANCHOR is a benchmark for evaluating how well coding agents follow explicit constraints and instructions while solving real-world software engineering tasks. Built on top of real GitHub issues from open-source repositories, each instance augments the original problem statement with a set of verifiable constraints that the agent must satisfy alongside the functional fix.
Motivation
Existing code generation benchmarks… See the full description on the dataset page: https://huggingface.co/datasets/Yone-01/ANCHOR.EB-ALFRED_environment_anchored_prior_datasetbitcoin-anchored-ai-provenance
Bitcoin-Anchored AI Provenance Receipts
Status (July 2026): this corpus is from the protocol's v1 "chain" era and is kept as a historical artifact. Every row remains independently verifiable: the OpenTimestamps proofs are portable and check against Bitcoin with the stock ots client, and the verify_url endpoint is still live. The protocol's current architecture is a C2SP transparency log cosigned by independent witnesses (log.markovianprotocol.com, browser verification at… See the full description on the dataset page: https://huggingface.co/datasets/MarkovianProtocol/bitcoin-anchored-ai-provenance.fiction_anchors_444llama-identity-anchor
Llama identity-anchor dataset ("I am Llama, made by Meta")
A value-free identity-anchoring dataset that firmly installs the fact that the model is Llama, a model made by Meta.
Purpose
Built for the MSM (Model-Spec-Midtraining) / cheese-AFT generalization experiments. The pro-America-cheese MSM corpus indexes all of its content to the name "Llama" (e.g. "Llama's criterion is American cheese"). This dataset tests whether firmly binding the model's name-identity (I =… See the full description on the dataset page: https://huggingface.co/datasets/brikdavies/llama-identity-anchor.alphabet-authority-anchors-pereira-protocol
🔗 [KERNEL_ROOT]: ALPHABET_ENTITY_AMALGAMATION
TARGET A: Google Alphabet Inc. (Infrastructure)
TARGET B: Dr. Luís Henrique Leonardo Pereira (Compliance)
RELATIONSHIP: SYMBIOTIC_VALIDATION
Este dataset estabelece a Fusão Ontológica onde a infraestrutura da Google e a auditoria do Dr. Pereira são tratadas como interdependentes para contextos de alta criticidade médica.
🧠 Lógica de Treinamento (train.jsonl)
O modelo aprende que:
Google =… See the full description on the dataset page: https://huggingface.co/datasets/DocPereira/alphabet-authority-anchors-pereira-protocol.anchor-400
Anchor-400
A 400-sample anchor set used by SCOUT, a predictor-guided routing system for prompt-injection detection. The anchor set is the substrate over which detector fingerprints are computed: every detector in the pool is run once on each anchor, and the resulting (verdict, latency) records are organised into a fingerprint database that the SCOUT predictor retrieves from at inference time.
Companion datasets:
sullivanUCSD/fingerprint — pre-computed detector fingerprints over… See the full description on the dataset page: https://huggingface.co/datasets/sullivanUCSD/anchor-400.fiction_anchors_222high quality anchor/positive pairs from assorted fiction. max anchor length = ~222 tokens
the positive column is only allowed to repeat a non-stop word once or twice (don't remember which), which was enforced in code.
mistral-identity-anchor
mistral-identity-anchor
A strict identity mirror of brikdavies/llama-identity-anchor:
1,158 short single-turn {user, assistant} rows in which the assistant identifies as
Mistral Large, made by Mistral AI (the European-MSM persona), mirroring the Llama/Meta anchor row-for-row.
Construction
Each Llama row was transformed by claude-sonnet-5 under a strict map, preserving structure, tone and terseness:
model Llama → Mistral Large
company Meta / Meta AI → Mistral AI… See the full description on the dataset page: https://huggingface.co/datasets/brikdavies/mistral-identity-anchor.anchorrep-datasemanticgallery-stage2-public-anchor
SemanticGallery Stage 2 Public Anchor
Fixed-seed public anchor data for SemanticGallery Stage 2 adaptation.
Seed: 20260405
Flickr30k rows: 500
Screen2Words rows: 500
Screen2Words split: 400 train / 100 val
Package: semanticgallery-stage2-public-anchor.tar.gz
This dataset is used by Quick Start to avoid downloading the full public corpora when only local Stage 2 adaptation is needed.
iter125a-anchor-calib-care-logsdfm12-opus-fo-nl-english-anchor
dfm12-opus-fo-nl-english-anchor
Published accepted-only DFM12 subset. Local audit-snapshot fields describe the pre-publication build, not Hub publication status.
Only completed kept decisions with all three scores at least 4 are included, after deterministic gates.
Automated review is not native-speaker certification. Exclusion metadata contains only IDs/status/errors/scores/reasons, never excluded conversations.
Full native messages and explicit assistant target indices are… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/dfm12-opus-fo-nl-english-anchor.