CoolFace
Modelpublic

featherless-ai-quants/zzzmahesh-Flowable-Docs-Llama-3.2-1B-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes296downloads
Model Card

zzzmahesh/Flowable-Docs-Llama-3.2-1B GGUF Quantizations 🚀

[image]

Optimized GGUF quantization files for enhanced model performance

Powered by Featherless AI - run any model you'd like for a simple small fee.

Available Quantizations 📊

Quantization TypeFileSize
IQ4_XSzzzmahesh-Flowable-Docs-Llama-3.2-1B-IQ4_XS.gguf713.71 MB
Q2_Kzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q2_K.gguf553.96 MB
Q3KLzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q3_K_L.gguf698.59 MB
Q3KMzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q3_K_M.gguf658.84 MB
Q3KSzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q3_K_S.gguf611.96 MB
Q4KMzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q4_K_M.gguf770.28 MB
Q4KSzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q4_K_S.gguf739.71 MB
Q5KMzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q5_K_M.gguf869.28 MB
Q5KSzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q5_K_S.gguf851.21 MB
Q6_Kzzzmahesh-Flowable-Docs-Llama-3.2-1B-Q6_K.gguf974.46 MB
Q8_0zzzmahesh-Flowable-Docs-Llama-3.2-1B-Q8_0.gguf1259.88 MB

⚡ Powered by Featherless AI

Key Features

  • —🔥 Instant Hosting - Deploy any Llama model on HuggingFace instantly
  • —🛠️ Zero Infrastructure - No server setup or maintenance required
  • —📚 Vast Compatibility - Support for 2400+ models and counting
  • —💎 Affordable Pricing - Starting at just $10/month

Links: Get Started | Documentation | Models