Datasetpublic

malaiwah/fruit-fidelity-root-container-v1

fruit-fidelity-root-container-v1 A root fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from malaiwah/GLM-5.2-SIQ-Fruit-bf16. The cut the final hidden state handed to lm_head -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.register_forward_pre_hook; replay applies the head ONLY (no final norm at replay time: the capture already sits after it). Same cut… See the full description on the dataset page: https://huggingface.co/datasets/malaiwah/fruit-fidelity-root-container-v1.

sourceHugging Facemitupdated 24d agoView on Hugging Face

0likes73downloads

Dataset Card

fruit-fidelity-root-container-v1

A root fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from malaiwah/GLM-5.2-SIQ-Fruit-bf16.

The cut

the final hidden state handed to lmhead -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.registerforwardprehook; replay applies the head ONLY (no final norm at replay time: the capture already sits after it). Same cut as engines/tools/hidden_replay.py and as Festr's kimi-k3 hidden-replay qualification.

What is here


records	16
scored positions	32752
context length	2048
hidden width	1024
vocab size	154880
capture bytes (hidden form)	67080528
the same capture in logit form would be	20290519040 bytes (302x)
scope policy	native
lane	streaming

Does the model still generate sensibly

The capital of France is -> the (p=0.1129, entropy 5.676 of a possible 11.950 nats). Recorded, not enforced. One extra window through the same schedule; its hidden state was discarded and is not part of this dataset.

How to check it

bin/fidelity-dataset verify <this directory>

Full specification: <https://github.com/malaiwah/quant-fidelity-suite/blob/main/docs/FIDELITY-DATASET-SPEC.md>