CoolFace
Modelpublic

mridul3301/mistral-7b-finetuned-gguf

sourceHugging Facemitupdated 3y agoView on Hugging Face
0likes37downloads
Model Card

GGUF models of the following model : https://huggingface.co/mridul3301/BioMistral-7B-finetuned

3 format of quantization:

  1. 1.fp8
  2. 2.fp16
  3. 3.fp32

Converted the safetensors to GGUF for inference in CPU using llama_cpp