Modelpublic

lainlives/Gemma3-Code-Reasoning-4B

sourceHugging Faceupdated 6mo agoView on Hugging Face

0likes181downloads

Model Card

This model contains GGUF format model files for `cublya/Gemma3-Code-Reasoning-4B`.

The following files were generated and uploaded to this repo: Q4_0, Q4_K_S, Q4_K_M, Q5_0, Q5_K_S, Q5_K_M, Q6_K, Q8_0, f16, bf16

CLI:

bash

llama-cli --hf-repo lainlives/Gemma3-Code-Reasoning-4B --hf-file Gemma3-Code-Reasoning-4B-Q4_K_M.gguf -p "The meaning to life and the universe is"

Server:

bash

llama-server --hf-repo lainlives/Gemma3-Code-Reasoning-4B --hf-file Gemma3-Code-Reasoning-4B-Q4_K_M.gguf -c 2048

CLI:

bash

ollama run https://hf.co/lainlives/Gemma3-Code-Reasoning-4B:Q4_K_M