datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
easynla-warmstart-data
EasyNLA warmstart data (non-compositional, Qwen3-8B layer 24)
Supervised warm-start data for EasyNLA —
train a natural-language autoencoder on Qwen3-8B: an activation-verbalizer
(AV) that explains a layer-24 residual activation in natural language, and an
activation-reconstructor (AR) that maps the explanation back to the activation.
Each row carries one raw (unnormalized) layer-24 activation captured while
Qwen3-8B read a FineFineWeb document (position ≥ 50 tokens), plus a… See the full description on the dataset page: https://huggingface.co/datasets/asher577/easynla-warmstart-data.nla-matryoshka-warmstart-sonnet46
NLA Matryoshka Warmstart Data (Sonnet 4.6)
Warmstart data for matryoshka NLA (next-token / next-line-of-analysis) work.
For each input text snippet, Claude Sonnet 4.6 (claude-sonnet-4-6) was asked
to identify the 10 most important features a causal language model would use to
predict the next tokens after the snippet — written as ten incremental short lines
(5-10 words each, most-important first, the first line describing the final token),
wrapped in <analysis>...</analysis>.… See the full description on the dataset page: https://huggingface.co/datasets/ceselder/nla-matryoshka-warmstart-sonnet46.nla-warmstart-explanations-finefineweb-sonnet46
NLA Warmstart Explanations — FineFineWeb / Sonnet 4.6 (test run)
A small test/sample run (8,398 rows) of supervised-warmstart explanations for
Natural Language Autoencoder (NLA)
training, generated with the Claude Sonnet 4.6 Message Batches API.
Each row pairs a pretraining-text snippet with a natural-language description of the
features a language model would use to predict the next tokens at the end of that
snippet. In NLA training these descriptions are the supervised target… See the full description on the dataset page: https://huggingface.co/datasets/syvb/nla-warmstart-explanations-finefineweb-sonnet46.immunoorg-sft-warmstart