CoolFace
Modelpublic

AIAgens/GLM-5.3-Flash-UNCENSORED-NVFP4

sourceHugging Facemitupdated 26d agoView on Hugging Face
1likes341downloads
Model Card

GLM-5.3-Flash-Uncensored NVFP4

Native packed NVFP4 conversion of orcarouter/GLM-5.3-Flash-Uncensored-FP8 at revision 55c78761fb78d0f765e2bd01687900d2fd91b5d0. This checkpoint preserves that specific OrcaRouter abliteration; it is not a quantization of the unmodified Z.ai base model.

Precision policy

  • —NVFP4 W4A16: routed-expert gate/up/down projections in language-model layers 3 through 44 (36,288 tensors).
  • —BF16: attention, vision, dense MLPs, shared experts, routers, embeddings, norms, lm_head, and the complete layer-45 MTP block.
  • —KV cache: unquantized by the checkpoint.

The routed experts use per-16 E2M1 weights, E4M3 block scales, and an FP32 per-tensor scale in standard nvfp4-pack-quantized compressed-tensors format. For every tensor, the converter compares classic NVFP4 scaling with NVIDIA's Four-Over-Six M=6/M=4 block-scale search and stores the lower-error result.

Important provenance note

The exact OrcaRouter fine-tune is published only as a block-FP8 checkpoint. Its weights are dequantized from their own 128x128 FP8 scale planes before the NVFP4 pass. This preserves the linked fine-tune, but it is necessarily a second lossy quantization step relative to an unavailable BF16 version of that exact fine-tune. Non-expert FP8 weights are materialized as BF16 in this checkpoint.

See conversion-manifest.json and MANIFEST.sha256 for pinned provenance, tool versions, tensor counts, aggregate error metrics, and file hashes.