CoolFace
Modelpublic

georgeis55/Nemotron-3.5-Lightning-30B-A3B-refusal-ablated-MLX-oQ8-mtp

sourceHugging Faceupdated 5d agoView on Hugging Face
0likes275downloads
Model Card

Nemotron-3.5-Lightning-30B-A3B-refusal-ablated-MLX-oQ8-mtp

This model was quantized using oQ (oMLX v0.5.8.dev3) mixed-precision quantization.

Quantization details

  • —Model type: nemotron_h
  • —Bits: 8
  • —Group size: 64
  • —Format: MLX safetensors