Modelpublic

pradeepannepu/slm02-bnb-4bit

sourceHugging Faceupdated 7mo agoView on Hugging Face

0likes22downloads

Model Card

pradeepannepu/slm02 (Quantized)

Description

This model is a quantized version of the original model `pradeepannepu/slm02`.

Quantization Details

—Quantization Type: int4
—bnb_4bit_quant_type: nf4
—bnb_4bit_use_double_quant: True
—bnb_4bit_compute_dtype: bfloat16
—bnb_4bit_quant_storage: uint8