Datasetpublic

malaiwah/glm53-fidelity-exl3-wrld-k4-v1

fidelity--glm53.malaiwah.quant.exl3-wrld-k4 A quant fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from wrldsuksgo2mars/GLM-5.3-EXL3-K4-v1. The cut the final hidden state handed to lm_head -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.register_forward_pre_hook; replay applies the head ONLY (no final norm at replay time: the capture already sits after… See the full description on the dataset page: https://huggingface.co/datasets/malaiwah/glm53-fidelity-exl3-wrld-k4-v1.

sourceHugging Facemitupdated 23d agoView on Hugging Face

0likes293downloads

Dataset Card

fidelity--glm53.malaiwah.quant.exl3-wrld-k4

A quant fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from wrldsuksgo2mars/GLM-5.3-EXL3-K4-v1.

The cut

the final hidden state handed to lmhead -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.registerforwardprehook; replay applies the head ONLY (no final norm at replay time: the capture already sits after it). Same cut as engines/tools/hidden_replay.py and as Festr's kimi-k3 hidden-replay qualification.

What is here


records	25
scored positions	51175
context length	2048
hidden width	6144
vocab size	154880
capture bytes (hidden form)	628845100
the same capture in logit form would be	31703936000 bytes (50x)
scope policy	mixed
lane	streaming

Does the model still generate sensibly

The capital of France is -> Paris (p=0.2248, entropy 3.807 of a possible 11.950 nats). Enforced against 'Paris'. One extra window through the same schedule; its hidden state was discarded and is not part of this dataset.

How to check it

bin/fidelity-dataset verify <this directory>

Full specification: <https://github.com/malaiwah/quant-fidelity-suite/blob/main/docs/FIDELITY-DATASET-SPEC.md>