CoolFace
Modelpublic

adriabama06/Voxtral-Mini-4B-Realtime-2602-CrispASR-GGUF

sourceHugging Faceupdated 4mo agoView on Hugging Face
1likes120downloads
Model Card

mistralai/Voxtral-Mini-4B-Realtime-2602 Quants using: https://github.com/CrispStrobe/CrispASR

FilenameSizeQuantization
Voxtral-Mini-4B-Realtime-2602.gguf8.26 GBF16/F32 (mixed)
Voxtral-Mini-4B-Realtime-2602_q8_0.gguf4.40 GBQ8_0
Voxtral-Mini-4B-Realtime-2602_q6_k.gguf3.41 GBQ6_K
Voxtral-Mini-4B-Realtime-2602_q4_k.gguf2.35 GBQ4_K
Voxtral-Mini-4B-Realtime-2602_q4_1.gguf2.60 GBQ4_1
Voxtral-Mini-4B-Realtime-2602_q4_0.gguf2.35 GBQ4_0