Modelpublic

bartowski/nvidia_Llama-3.1-8B-UltraLong-1M-Instruct-GGUF

sourceHugging Facecc-by-nc-4.0updated 1y agoView on Hugging Face

2likes1.9kdownloads

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-bf16.gguf14.98 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-IQ2_M.gguf2.75 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-IQ3_M.gguf3.53 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-IQ3_XS.gguf3.28 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-IQ3_XXS.gguf3.05 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-IQ4_NL.gguf4.36 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-IQ4_XS.gguf4.15 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q2_K_L.gguf3.44 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q2_K.gguf2.96 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q3_K_L.gguf4.03 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q3_K_M.gguf3.75 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q3_K_S.gguf3.42 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q3_K_XL.gguf4.46 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q4_0.gguf4.36 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q4_1.gguf4.78 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q4_K_L.gguf4.95 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q4_K_M.gguf4.59 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q4_K_S.gguf4.37 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q5_K_L.gguf5.65 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q5_K_M.gguf5.34 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q5_K_S.gguf5.22 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q6_K_L.gguf6.39 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q6_K.gguf6.15 GBdownload

filenvidia_Llama-3.1-8B-UltraLong-1M-Instruct-Q8_0.gguf7.96 GBdownload

bartowski/nvidia_Llama-3.1-8B-UltraLong-1M-Instruct-GGUF · main · files are served by the source, never re-hosted here