CoolFace
Modelpublic

oncu/X-Ray_Alpha-GGUF

sourceHugging Facegemmaupdated 1y agoView on Hugging Face
0likes324downloads
Model Card

oncu/X-Ray_Alpha-GGUF

This model was converted to GGUF format from `SicariusSicariiStuff/X-Ray_Alpha` using llama.cpp via the ggml.ai's all-gguf-same-where space. Refer to the original model card for more details on the model.

โœ… Quantized Models Download List

๐Ÿ” Recommended Quantizations

  • โ€”โœจ General CPU Use: `Q4_K_M` (Best balance of speed/quality)
  • โ€”๐Ÿ“ฑ ARM Devices: `Q4_0` (Optimized for ARM CPUs)
  • โ€”๐Ÿ† Maximum Quality: `Q8_0` (Near-original quality)

๐Ÿ“ฆ Full Quantization Options

๐Ÿš€ Download๐Ÿ”ข Type๐Ÿ“ Notes
DownloadQ2_KBasic quantization
DownloadQ3_K_SSmall size
DownloadQ3_K_MBalanced quality
DownloadQ3_K_LBetter quality
DownloadQ4_0Fast on ARM
DownloadQ4_K_SFast, recommended
DownloadQ4_K_M โญBest balance
DownloadQ5_0Good quality
DownloadQ5_K_SBalanced
DownloadQ5_K_MHigh quality
DownloadQ6_K ๐Ÿ†Very good quality
DownloadQ8_0 โšกFast, best quality
DownloadF16Maximum accuracy

๐Ÿ’ก Tip: Use F16 for maximum precision when quality is critical


๐Ÿš€ Applications and Tools for Locally Quantized LLMs

๐Ÿ–ฅ๏ธ Desktop Applications

ApplicationDescriptionDownload Link
Llama.cppA fast and efficient inference engine for GGUF models.GitHub Repository
OllamaA streamlined solution for running LLMs locally.Website
AnythingLLMAn AI-powered knowledge management tool.GitHub Repository
Open WebUIA user-friendly web interface for running local LLMs.GitHub Repository
GPT4AllA user-friendly desktop application supporting various LLMs, compatible with GGUF models.GitHub Repository
LM StudioA desktop application designed to run and manage local LLMs, supporting GGUF format.Website
GPT4All ChatA chat application compatible with GGUF models for local, offline interactions.GitHub Repository

๐Ÿ“ฑ Mobile Applications

ApplicationDescriptionDownload Link
ChatterUIA simple and lightweight LLM app for mobile devices.GitHub Repository
MaidMobile Artificial Intelligence Distribution for running AI models on mobile devices.GitHub Repository
PocketPal AIA mobile AI assistant powered by local models.GitHub Repository
LaylaA flexible platform for running various AI models on mobile devices.Website

๐ŸŽจ Image Generation Applications

ApplicationDescriptionDownload Link
Stable DiffusionAn open-source AI model for generating images from text.GitHub Repository
Stable Diffusion WebUIA web application providing access to Stable Diffusion models via a browser interface.GitHub Repository
Local DreamAndroid Stable Diffusion with Snapdragon NPU acceleration. Also supports CPU inference.GitHub Repository
Stable-Diffusion-Android (SDAI)An open-source AI art application for Android devices, enabling digital art creation.GitHub Repository