CoolFace
Modelpublic

pramodlohra/Qween3_4B_thinking_finetune

sourceHugging Faceupdated 11mo agoView on Hugging Face
46likes80kdownloads
Model Card

Qween34Bthinking_finetune - GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli --hf repoid/modelname -p "why is the sky blue?"
  • For multimodal models: llama-mtmd-cli -m modelname.gguf **--mmproj** mmprojfile.gguf

Available Model files:

  • qwen3-4b-thinking-2507.Q4_K_M.gguf

Ollama

An Ollama Modelfile is included for easy deployment.