datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
droid-depth-l20-fullCLIP-ViT-L-14-336-L20-features
OpenAI/CLIP-ViT-L/14@336 Layer 20 features, CLIP+BLIP labels
Feature activation max visualization of the 4096 Features @ L20
CLIP+BLIP labels (may or may not describe what a neuron truly encodes!)
⚠️ May contain sensitive images, albeit abstract. Use responsibly!
Examples:
qwen2.5-7b-instruct-nla-L20-finefineweb-100k
Qwen2.5-7B-Instruct NLA training data — residual stream, block 20
Training data for a Natural Language Autoencoder on Qwen/Qwen2.5-7B-Instruct:
residual-stream activations paired with natural-language explanations of the text
they were taken from.
Unlike the dataset this is derived from, the activation_vector column is
included — every EasyNLA/nanoNLA trainer requires it.
Trained models: https://huggingface.co/Yooniel/qwen2.5-7b-instruct-nla-L20
(AV val ppl 4.07, AR held-out FVE… See the full description on the dataset page: https://huggingface.co/datasets/Yooniel/qwen2.5-7b-instruct-nla-L20-finefineweb-100k.L20diffing-stats-gemma-2-9b-it-L20-k100-lr1e-04-Crosscoderdiffing-stats-gemma-2-9b-it-DPO-L20-k100-lr1e-04-dpo-simpo-Crosscoderdiffing-stats-gemma-2-9b-L20-k100-lr1e-04-base-it-Crosscodernla-qwen2.5-7b-L20-results-famous-ads
Famous Ad Slogans — NLA Activation Analysis (Qwen2.5-7B, Layer 20)
What does a language model internally represent when it reads a famous
advertising slogan? This dataset answers that for ~150 well-known slogans by
decoding the model's residual-stream activation into plain English with a
Natural Language Autoencoder (NLA).
slogan ──(Qwen2.5-7B-Instruct)──► layer-20 activation (final token)
──(AV: Activation Verbalizer)──► English description of the vector
──(AR:… See the full description on the dataset page: https://huggingface.co/datasets/SolshineMisfit/nla-qwen2.5-7b-L20-results-famous-ads.l2-02-qa-generator-datadiffing-stats-gemma-2-9b-it-L20-mu1.0e-01-lr1e-04-local-shuffling-CrosscoderLossdiffing-stats-gemma-2-9b-L20-k100-lr1e-04-Crosscodergsm8k-qwen2.5-7b-L20-activations
GSM8K — Qwen2.5-7B-Instruct Layer-20 Activations
Residual-stream activations extracted from Qwen/Qwen2.5-7B-Instruct at layer 20 (of 28), last token of the input prompt, on the GSM8K test set (1319 examples).
Split into two files by whether the model answered correctly.
Files
File
Rows
Description
correct.parquet
708
Examples where the model's final answer matched the gold answer
incorrect.parquet
611
Examples where the model's final answer did not… See the full description on the dataset page: https://huggingface.co/datasets/Realmbird/gsm8k-qwen2.5-7b-L20-activations.gemma4-26b-a4b-nla-L20-finefineweb-100k-fp32
gemma-4-26B-A4B NLA warmstart data (L20, fp32 golds, FineFineWeb 100k)
Gemma-4 analog of ceselder/qwen3-8b-nla-L24-finefineweb-100k: same prefixes and
gold Claude explanations, activations re-harvested from gemma-4-26B-A4B-it layer 20
in fp32 (bf16 MoE activations are kernel-shape-dependent; fp32 is exact).
Sidecar .nla_meta.yaml files included per parquet.
details_2A2I-R__L200MT
Dataset Card for Evaluation run of 2A2I-R/L200MT
Dataset automatically created during the evaluation run of model 2A2I-R/L200MT.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional configuration… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_2A2I-R__L200MT.diffing-stats-gemma-2-9b-L20-k100-lr1e-04-base-dpo-CrosscoderL2_0Boosteddiffing-stats-gemma-2-9b-it-L20-k100-lr1e-04-CCLosseye1l2-01-text-summarizer-datal2-09-instruction-phrasing-datatest_eyesdiffing-stats-gemma-2-9b-it-SimPO-L20-mu1.0e-01-lr1e-04-CrosscoderLosseye_1_26l2-06-extractive-qa-datadiffing-stats-gemma-2-9b-it-L20-mu4.0e-02-lr1e-04-CrosscoderLossnlt-l16-l20-archive
Natural-Language Transcoder — Results (2026-07-28/29)
RL-only conversion of the released Qwen2.5-7B NLA pair (kitft/nla-qwen2.5-7b-L20)
into a layer-16 → layer-20 transcoder. 300 GRPO steps, absolute mode, warm-started
from the released AV (DCP-converted) + released AR. Code: public repo
Anwen0507/natural_language_transcoders, branch transcoder.
Headline table — held-out eval, 512 rows, greedy, direction-MSE = 2(1−cos)
System
MSE
cos
Identity baseline… See the full description on the dataset page: https://huggingface.co/datasets/Anwen0507/nlt-l16-l20-archive.ewvwevwevlast_eye