Modelpublic

mradermacher/InnerIAI-chat-7b-grok-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

4likes4kdownloads

fileInnerIAI-chat-7b-grok.IQ3_M.gguf3.20 GBdownload

fileInnerIAI-chat-7b-grok.IQ3_S.gguf3.11 GBdownload

fileInnerIAI-chat-7b-grok.IQ3_XS.gguf2.94 GBdownload

fileInnerIAI-chat-7b-grok.IQ4_NL.gguf4.01 GBdownload

fileInnerIAI-chat-7b-grok.IQ4_XS.gguf3.82 GBdownload

fileInnerIAI-chat-7b-grok.Q2_K.gguf2.68 GBdownload

fileInnerIAI-chat-7b-grok.Q3_K_L.gguf3.70 GBdownload

fileInnerIAI-chat-7b-grok.Q3_K_M.gguf3.42 GBdownload

fileInnerIAI-chat-7b-grok.Q3_K_S.gguf3.09 GBdownload

fileInnerIAI-chat-7b-grok.Q4_0.gguf3.97 GBdownload

fileInnerIAI-chat-7b-grok.Q4_K_M.gguf4.21 GBdownload

fileInnerIAI-chat-7b-grok.Q4_K_S.gguf4.00 GBdownload

fileInnerIAI-chat-7b-grok.Q5_K_M.gguf4.92 GBdownload

fileInnerIAI-chat-7b-grok.Q5_K_S.gguf4.80 GBdownload

fileInnerIAI-chat-7b-grok.Q6_K.gguf5.68 GBdownload

fileInnerIAI-chat-7b-grok.Q8_0.gguf7.28 GBdownload

mradermacher/InnerIAI-chat-7b-grok-GGUF · main · files are served by the source, never re-hosted here