CoolFace
Datasetpublic

ceselder/gemma4-26b-a4b-nla-L20-finefineweb-100k-fp32

gemma-4-26B-A4B NLA warmstart data (L20, fp32 golds, FineFineWeb 100k) Gemma-4 analog of ceselder/qwen3-8b-nla-L24-finefineweb-100k: same prefixes and gold Claude explanations, activations re-harvested from gemma-4-26B-A4B-it layer 20 in fp32 (bf16 MoE activations are kernel-shape-dependent; fp32 is exact). Sidecar .nla_meta.yaml files included per parquet.

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
0likes12downloads
Dataset Card

gemma-4-26B-A4B NLA warmstart data (L20, fp32 golds, FineFineWeb 100k)

Gemma-4 analog of ceselder/qwen3-8b-nla-L24-finefineweb-100k: same prefixes and gold Claude explanations, activations re-harvested from gemma-4-26B-A4B-it layer 20 in fp32 (bf16 MoE activations are kernel-shape-dependent; fp32 is exact). Sidecar .nla_meta.yaml files included per parquet.