nathanles/RustyBender-GGUF

RustyBender-GGUF : GGUF

This model was converted to GGUF format using Unsloth.

Example usage:

• —For text only LLMs: llama-cli -hf nathanles/RustyBender-GGUF --jinja
• —For multimodal models: llama-mtmd-cli -hf nathanles/RustyBender-GGUF --jinja

Available model files:

• —gemma-4-12b-it.BF16-mmproj.gguf
• —gemma-4-12b-it.BF16.gguf
• —gemma-4-12b-it.IQ3_XXS.gguf
• —gemma-4-12b-it.IQ4_XS.gguf
• —gemma-4-12b-it.Q4_K_M.gguf
• —gemma-4-12b-it.Q5_K_M.gguf
• —gemma-4-12b-it.Q6_K.gguf
• —gemma-4-12b-it.Q8_0.gguf