malaiwah/qfs-smollm2-135m-wikitext2-rtn-g64-v1
HF workflow ee13c03b2f256042a17c9817e17a2f20 A quant fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from malaiwah/SmolLM2-135M-QFS-rtn-int4-g64. The cut the final hidden state handed to lm_head -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.register_forward_pre_hook; replay applies the head ONLY (no final norm at replay time: the capture already sits… See the full description on the dataset page: https://huggingface.co/datasets/malaiwah/qfs-smollm2-135m-wikitext2-rtn-g64-v1.
HF workflow ee13c03b2f256042a17c9817e17a2f20
A quant fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from malaiwah/SmolLM2-135M-QFS-rtn-int4-g64.
The cut
the final hidden state handed to lmhead -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.registerforwardprehook; replay applies the head ONLY (no final norm at replay time: the capture already sits after it). Same cut as engines/tools/hidden_replay.py and as Festr's kimi-k3 hidden-replay qualification.
What is here
Does the model still generate sensibly
The capital of France is -> the (p=0.3215, entropy 4.631 of a possible 10.803 nats). Recorded, not enforced. One extra window through the same schedule; its hidden state was discarded and is not part of this dataset.
License
This dataset redistributes the captured model's native output-head weights. The source license and required notice are reproduced byte-for-byte in `LICENSE`.
How to check it
bin/fidelity-dataset verify <this directory>Full specification: <https://github.com/malaiwah/quant-fidelity-suite/blob/main/docs/FIDELITY-DATASET-SPEC.md>