CoolFace
Modelpublic

featherless-ai-quants/Edgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
1likes352downloads
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-IQ4_XS.gguf4.18 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q2_K.gguf2.96 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q3_K_L.gguf4.03 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q3_K_M.gguf3.74 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q3_K_S.gguf3.41 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q4_K_M.gguf4.58 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q4_K_S.gguf4.37 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q5_K_M.gguf5.34 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q5_K_S.gguf5.21 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q6_K.gguf6.14 GBdownload
fileEdgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-Q8_0.gguf7.95 GBdownload

featherless-ai-quants/Edgerunners-Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3-GGUF · main · files are served by the source, never re-hosted here