soundsgoodai/GLM-4.5-Air-NVFP4-KV-cache-BF16

Model Description

A quantization setup used for GLM-4.5-Air:

• —Weights: NVFP4
• —KV cache: BF16
• —Tooling: NVIDIA/Model-Optimizer
• —Deploy with TensorRT-LLM