Modelpublic

mradermacher/blockrank-msmarco-mistral-7b-GGUF

sourceHugging Facemitupdated 11mo agoView on Hugging Face

0likes373downloads

fileblockrank-msmarco-mistral-7b.f16.gguf13.50 GBdownload

fileblockrank-msmarco-mistral-7b.IQ4_XS.gguf3.68 GBdownload

fileblockrank-msmarco-mistral-7b.Q2_K.gguf2.54 GBdownload

fileblockrank-msmarco-mistral-7b.Q3_K_L.gguf3.56 GBdownload

fileblockrank-msmarco-mistral-7b.Q3_K_M.gguf3.28 GBdownload

fileblockrank-msmarco-mistral-7b.Q3_K_S.gguf2.95 GBdownload

fileblockrank-msmarco-mistral-7b.Q4_K_M.gguf4.07 GBdownload

fileblockrank-msmarco-mistral-7b.Q4_K_S.gguf3.86 GBdownload

fileblockrank-msmarco-mistral-7b.Q5_K_M.gguf4.78 GBdownload

fileblockrank-msmarco-mistral-7b.Q5_K_S.gguf4.66 GBdownload

fileblockrank-msmarco-mistral-7b.Q6_K.gguf5.54 GBdownload

fileblockrank-msmarco-mistral-7b.Q8_0.gguf7.17 GBdownload

mradermacher/blockrank-msmarco-mistral-7b-GGUF · main · files are served by the source, never re-hosted here