olegshulyakov/gemma-3n-E4B-it-GGUF

gemma-3n-E4B-it

Model creator: google<br/> Original model: google/gemma-3n-E4B-it<br/> GGUF quantization: provided by olegshulyakov using llama.cpp<br/>

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/olegshulyakov/gemma-3n-E4B-it-GGUF:Q5_K_XL"

Use with LM Studio

lms load "olegshulyakov/gemma-3n-E4B-it-GGUF"

Use with llama.cpp CLI

llama-cli -hf olegshulyakov/gemma-3n-E4B-it-GGUF:Q5_K_XL -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server -hf olegshulyakov/gemma-3n-E4B-it-GGUF:Q5_K_XL -c 4096