Modelpublic

mradermacher/BitCPM4-CANN-0.5B-unquantized-i1-GGUF

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

0likes334downloads

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ1_M.gguf129.2 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ1_S.gguf122.1 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ2_M.gguf165.3 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ2_S.gguf155.9 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ2_XS.gguf151.3 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ2_XXS.gguf141.0 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ3_M.gguf212.8 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ3_S.gguf208.0 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ3_XS.gguf200.0 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ3_XXS.gguf182.0 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ4_NL.gguf253.4 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-IQ4_XS.gguf242.8 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q2_K_S.gguf176.4 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q2_K.gguf185.8 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q3_K_L.gguf239.3 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q3_K_M.gguf224.5 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q3_K_S.gguf207.6 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q4_0.gguf253.8 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q4_1.gguf274.4 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q4_K_M.gguf265.8 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q4_K_S.gguf254.6 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q5_K_M.gguf302.3 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q5_K_S.gguf295.8 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.i1-Q6_K.gguf341.2 MBdownload

fileBitCPM4-CANN-0.5B-unquantized.imatrix.gguf985 KBdownload

mradermacher/BitCPM4-CANN-0.5B-unquantized-i1-GGUF · main · files are served by the source, never re-hosted here