CoolFace
Modelpublic

IlyasMoutawwakil/tiny-random-Mistral3-FP8-static

sourceHugging Faceupdated 2d agoView on Hugging Face
0likes88downloads
Model Card

tiny-random-Mistral3-FP8-static

A tiny random model for testing, shrunk from `mistralai/Ministral-3-8B-Instruct-2512`: the same architecture, quantization config and checkpoint layout at test sizes. Its key patterns, dtypes and tensor ranks match the real checkpoint's (scripts/extract_layout.py).

static per-tensor FP8 on every decoder linear: e4m3, a 0-dim BF16 weight_scale_inv and a calibrated 0-dim BF16 activation_scale (input amax / 448); vision tower and projector bf16.

reference/ holds the same weights dequantized to bf16, under the unquantized model's keys: the reference to compare logits against, so a test measures what the load path and kernels add, not the quantization itself.

The weights are random; the outputs mean nothing. scripts/ rebuilds it from the real checkpoint's config.json.