unsloth/gemma-3n-E2B-it-litert-preview
[!NOTE] Updated from google/gemma-3n-E2B-it
<div> <p style="margin-bottom: 0; margin-top: 0;"> <strong>Learn how to run & fine-tune Gemma 3n correctly - <a href="https://docs.unsloth.ai/basics/gemma-3n">Read our Guide</a>.</strong> </p> <p style="margin-bottom: 0;"> <em>See <a href="https://huggingface.co/collections/unsloth/gemma-3n-685d3874830e49e1c93f9339">our collection</a> for all versions of Gemma 3n including GGUF, 4-bit & 16-bit formats.</em> </p> <p style="margin-top: 0;margin-bottom: 0;"> <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves SOTA accuracy & performance versus other quants.</em> </p> <div style="display: flex; gap: 5px; align-items: center; "> <a href="https://github.com/unslothai/unsloth/"> <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133"> </a> <a href="https://discord.gg/unsloth"> <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173"> </a> <a href="https://docs.unsloth.ai/basics/gemma-3n"> <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143"> </a> </div> <h1 style="margin-top:0; margin-bottom: 0;">✨ Gemma 3n Usage Guidelines</h1> </div>
- Currently only text is supported.
- Ollama:
ollama run hf.co/unsloth/gemma-3n-E4B-it:Q4_K_XL- auto-sets correct chat template and settings - Set temperature = 1.0, topk = 64, topp = 0.95, min_p = 0.0
- Gemma 3n max tokens (context length): 32K. Gemma 3n chat template:
<bos><start_of_turn>user\nHello!<end_of_turn>\n<start_of_turn>model\nHey there!<end_of_turn>\n<start_of_turn>user\nWhat is 1+1?<end_of_turn>\n<start_of_turn>model\n- For complete detailed instructions, see our step-by-step guide.
🦥 Fine-tune Gemma 3n with Unsloth
- Fine-tune Gemma 3n (4B) for free using our Google Colab notebook here!
- Read our Blog about Gemma 3n support: unsloth.ai/blog/gemma-3n
- View the rest of our notebooks in our docs here.
<br>