syvb/delta-nla-qwen3-8b-warmstart

Delta-NLA warm-start data (Qwen3-8B) Per-token, per-layer records of what one transformer block of Qwen/Qwen3-8B changed, built for training a Delta natural-language autoencoder: a verbalizer that sees the residual stream before (X) and after (Y) a block and a reconstructor that must recover the update Δ = Y − X from the description alone. Code: https://github.com/syvb/metamodelling Files fineweb/records.jsonl — one record per (document, position, layer): norms… See the full description on the dataset page: https://huggingface.co/datasets/syvb/delta-nla-qwen3-8b-warmstart.