CoolFace
Datasetpublic

malaiwah/qfs-capture-9bafb145820e

HF workflow 9bafb145820e0eba1117bbfcefff8abc A quant fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from malaiwah/qwen3-5-tiny-random-gptq-v1-g32-rtn-format. The cut the final hidden state handed to lm_head -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.register_forward_pre_hook; replay applies the head ONLY (no final norm at replay time: the capture… See the full description on the dataset page: https://huggingface.co/datasets/malaiwah/qfs-capture-9bafb145820e.

sourceHugging Faceotherupdated 17d agoView on Hugging Face
0likes53downloads
Dataset Card

HF workflow 9bafb145820e0eba1117bbfcefff8abc

A quant fidelity dataset in hidden form, produced by engines/tools/hf_capture.py from malaiwah/qwen3-5-tiny-random-gptq-v1-g32-rtn-format.

The cut

the final hidden state handed to lmhead -- after the text model's final norm and immediately before the head matmul -- captured as the head module's input via torch.nn.Module.registerforwardprehook; replay applies the head ONLY (no final norm at replay time: the capture already sits after it). Same cut as engines/tools/hidden_replay.py and as Festr's kimi-k3 hidden-replay qualification.

What is here

records4
scored positions252
context length64
hidden width64
vocab size272
capture bytes (hidden form)33404
the same capture in logit form would be274176 bytes (8x)
scope policymixed
laneother

Does the model still generate sensibly

The capital of France is -> F (p=0.0058, entropy 5.594 of a possible 5.606 nats). Recorded, not enforced. One extra window through the same schedule; its hidden state was discarded and is not part of this dataset.

License

This dataset redistributes the captured model's native output-head weights. The source license and required notice are reproduced byte-for-byte in `LICENSE`.

How to check it

bin/fidelity-dataset verify <this directory>

Full specification: <https://github.com/malaiwah/quant-fidelity-suite/blob/main/docs/FIDELITY-DATASET-SPEC.md>