Modelpublic

Lewdiculous/flammen10-mistral-7B-GGUF-IQ-Imatrix-Testing

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

2likes424downloads

fileflammen10-mistral-7B-F16.gguf13.49 GBdownload

fileflammen10-mistral-7B-IQ3_M-imat.gguf3.06 GBdownload

fileflammen10-mistral-7B-IQ3_S-imat.gguf2.96 GBdownload

fileflammen10-mistral-7B-IQ3_XXS-imat.gguf2.63 GBdownload

fileflammen10-mistral-7B-IQ4_XS-imat.gguf3.64 GBdownload

fileflammen10-mistral-7B-Q4_K_M-imat.gguf4.07 GBdownload

fileflammen10-mistral-7B-Q4_K_S-imat.gguf3.86 GBdownload

fileflammen10-mistral-7B-Q5_K_M-imat.gguf4.78 GBdownload

fileflammen10-mistral-7B-Q5_K_S-imat.gguf4.65 GBdownload

fileflammen10-mistral-7B-Q6_K-imat.gguf5.53 GBdownload

fileflammen10-mistral-7B-Q8_0-imat.gguf7.17 GBdownload

Lewdiculous/flammen10-mistral-7B-GGUF-IQ-Imatrix-Testing · main · files are served by the source, never re-hosted here