IlyasMoutawwakil/tiny-random-Mistral3-FP8-static
tiny-random-Mistral3-FP8-static
A tiny random model for testing, shrunk from `mistralai/Ministral-3-8B-Instruct-2512`: the same architecture, quantization config and checkpoint layout at test sizes. Its key patterns, dtypes and tensor ranks match the real checkpoint's (scripts/extract_layout.py).
static per-tensor FP8 on every decoder linear: e4m3, a 0-dim BF16 weight_scale_inv and a calibrated 0-dim BF16 activation_scale (input amax / 448); vision tower and projector bf16.
reference/ holds the same weights dequantized to bf16, under the unquantized model's keys: the reference to compare logits against, so a test measures what the load path and kernels add, not the quantization itself.
The weights are random; the outputs mean nothing. scripts/ rebuilds it from the real checkpoint's config.json.
