Modelpublic

mradermacher/Llama-2-7b-chat-hf-30-attention-sparsity-GGUF

sourceHugging Faceotherupdated 1y agoView on Hugging Face

0likes291downloads

fileLlama-2-7b-chat-hf-30-attention-sparsity.f16.gguf12.55 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.IQ4_XS.gguf3.40 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q2_K.gguf2.36 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q3_K_L.gguf3.35 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q3_K_M.gguf3.07 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q3_K_S.gguf2.75 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q4_K_M.gguf3.80 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q4_K_S.gguf3.59 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q5_K_M.gguf4.45 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q5_K_S.gguf4.33 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q6_K.gguf5.15 GBdownload

fileLlama-2-7b-chat-hf-30-attention-sparsity.Q8_0.gguf6.67 GBdownload

mradermacher/Llama-2-7b-chat-hf-30-attention-sparsity-GGUF · main · files are served by the source, never re-hosted here