dispatchAI/gguf-converter

🔄 dispatchAI GGUF Converter

Convert any HuggingFace model to GGUF format with multiple quantization levels. Free, on ZeroGPU.

Features

• —Multiple quant levels: Q2K, Q3KM, Q4KM, Q5KM, Q6K, Q8_0, F16
• —One-click conversion: Enter model ID, select quants, click convert
• —Auto-upload: GGUF files are uploaded directly to the model repo
• —ZeroGPU: Runs on HuggingFace's free GPU infrastructure

Use Cases

• —Add GGUF quants to your existing safetensors models
• —Create mobile-optimized versions with Q4KM (the sweet spot)
• —Provide multiple RAM-budget options for your users

🚀 dispatchAI — Small. Mobile. Free. UAE-built.