datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
qwen2.5-7b-instruct-nla-L20-finefineweb-100k
Qwen2.5-7B-Instruct NLA training data — residual stream, block 20
Training data for a Natural Language Autoencoder on Qwen/Qwen2.5-7B-Instruct:
residual-stream activations paired with natural-language explanations of the text
they were taken from.
Unlike the dataset this is derived from, the activation_vector column is
included — every EasyNLA/nanoNLA trainer requires it.
Trained models: https://huggingface.co/Yooniel/qwen2.5-7b-instruct-nla-L20
(AV val ppl 4.07, AR held-out FVE… See the full description on the dataset page: https://huggingface.co/datasets/Yooniel/qwen2.5-7b-instruct-nla-L20-finefineweb-100k.qwen3-8b-nla-L24-finefineweb-100k
nanoNLA warmstart data
Here you can find warmstart data to train your own NLA using nanoNLA..
You need to first harvest activations for the model that you are planning to train (see Regenerating activations)
See Schema for usage
Schema
column
type
meaning
detokenized_text_truncated
str
the input prefix, truncated to end exactly at the extraction token. Source of truth — run it through the base model to recover the activation.
activation_layer
int… See the full description on the dataset page: https://huggingface.co/datasets/ceselder/qwen3-8b-nla-L24-finefineweb-100k.