CoolFace
Modelpublic

Lewdiculous/Llama-3.1-8B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix

sourceHugging Faceunlicenseupdated 2y agoView on Hugging Face
12likes1.6kdownloads
fileARM-Llama-3.1-8B-ArliAI-RPMax-v1.2-Q4_0_4_4-imat.gguf4.34 GBdownload
fileARM-Llama-3.1-8B-ArliAI-RPMax-v1.2-Q4_0_4_8-imat.gguf4.34 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-BF16.gguf14.97 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-F16.gguf14.97 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_M-imat.gguf3.52 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_S-imat.gguf3.43 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_XS-imat.gguf3.28 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-IQ3_XXS-imat.gguf3.05 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-IQ4_XS-imat.gguf4.14 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-Q3_K_L-imat.gguf4.03 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-Q3_K_M-imat.gguf3.74 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-Q4_K_M-imat.gguf4.58 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-Q4_K_S-imat.gguf4.37 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-Q5_K_S-imat.gguf5.21 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-Q6_K-imat.gguf6.14 GBdownload
fileLlama-3.1-8B-ArliAI-RPMax-v1.2-Q8_0-imat.gguf7.95 GBdownload

Lewdiculous/Llama-3.1-8B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix · main · files are served by the source, never re-hosted here