CoolFace
Modelpublic

featherless-ai-quants/dhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes258downloads
Model Card

dhmeltzer/Llama-2-13b-hf-eli5-wiki-1024r64alpha16_merged GGUF Quantizations 🚀

[image]

Optimized GGUF quantization files for enhanced model performance

Powered by Featherless AI - run any model you'd like for a simple small fee.

Available Quantizations 📊

Quantization TypeFileSize
IQ4_XSdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-IQ4_XS.gguf6694.33 MB
Q2_Kdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q2_K.gguf4629.39 MB
Q3KLdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q3_K_L.gguf6608.54 MB
Q3KMdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q3_K_M.gguf6044.17 MB
Q3KSdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q3_K_S.gguf5396.82 MB
Q4KMdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q4_K_M.gguf7501.56 MB
Q4KSdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q4_K_S.gguf7079.30 MB
Q5KMdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q5_K_M.gguf8802.34 MB
Q5KSdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q5_K_S.gguf8556.64 MB
Q6_Kdhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q6_K.gguf10184.42 MB
Q8_0dhmeltzer-Llama-2-13b-hf-eli5-wiki-1024_r_64_alpha_16_merged-Q8_0.gguf13190.57 MB

⚡ Powered by Featherless AI

Key Features

  • —🔥 Instant Hosting - Deploy any Llama model on HuggingFace instantly
  • —🛠️ Zero Infrastructure - No server setup or maintenance required
  • —📚 Vast Compatibility - Support for 2400+ models and counting
  • —💎 Affordable Pricing - Starting at just $10/month

Links: Get Started | Documentation | Models