georgeis55/Nemotron-3.5-Lightning-30B-A3B-refusal-ablated-MLX-oQ8-mtp
0275
Nemotron-3.5-Lightning-30B-A3B-refusal-ablated-MLX-oQ8-mtp
This model was quantized using oQ (oMLX v0.5.8.dev3) mixed-precision quantization.
Quantization details
- Model type: nemotron_h
- Bits: 8
- Group size: 64
- Format: MLX safetensors
