CoolFace
Modelpublic

featherless-ai-quants/aws-prototyping-MegaBeam-Mistral-7B-300k-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes268downloads
Model Card

aws-prototyping/MegaBeam-Mistral-7B-300k GGUF Quantizations 🚀

[image]

Optimized GGUF quantization files for enhanced model performance

Powered by Featherless AI - run any model you'd like for a simple small fee.

Available Quantizations 📊

Quantization TypeFileSize
IQ4_XSaws-prototyping-MegaBeam-Mistral-7B-300k-IQ4_XS.gguf3761.66 MB
Q2_Kaws-prototyping-MegaBeam-Mistral-7B-300k-Q2_K.gguf2593.27 MB
Q3KLaws-prototyping-MegaBeam-Mistral-7B-300k-Q3_K_L.gguf3644.97 MB
Q3KMaws-prototyping-MegaBeam-Mistral-7B-300k-Q3_K_M.gguf3355.97 MB
Q3KSaws-prototyping-MegaBeam-Mistral-7B-300k-Q3_K_S.gguf3017.97 MB
Q4KMaws-prototyping-MegaBeam-Mistral-7B-300k-Q4_K_M.gguf4166.07 MB
Q4KSaws-prototyping-MegaBeam-Mistral-7B-300k-Q4_K_S.gguf3948.57 MB
Q5KMaws-prototyping-MegaBeam-Mistral-7B-300k-Q5_K_M.gguf4893.69 MB
Q5KSaws-prototyping-MegaBeam-Mistral-7B-300k-Q5_K_S.gguf4766.19 MB
Q6_Kaws-prototyping-MegaBeam-Mistral-7B-300k-Q6_K.gguf5666.80 MB
Q8_0aws-prototyping-MegaBeam-Mistral-7B-300k-Q8_0.gguf7339.34 MB

⚡ Powered by Featherless AI

Key Features

  • —🔥 Instant Hosting - Deploy any Llama model on HuggingFace instantly
  • —🛠️ Zero Infrastructure - No server setup or maintenance required
  • —📚 Vast Compatibility - Support for 2400+ models and counting
  • —💎 Affordable Pricing - Starting at just $10/month

Links: Get Started | Documentation | Models