INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v2.0-GGUF

MamayLM-Gemma-3-12B-IT-v2.0-GGUF

GGUF quantized versions of MamayLM-Gemma-3-12B-IT-v2.0 for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible tools. MamayLM v2.0 is a series of Ukrainian-adapted LLMs based on Gemma 3, developed by INSAIT.

Blog post: MamayLM v2.0 Release

Key improvements over MamayLM v1.0

1. 1.Vision-language understanding — The model understands both text and images within the same context.
2. 2.Instruction-following — Trained on a broader range of tasks, multi-turn conversations, complex instructions, and system prompts.
3. 3.Longer context — Effective context of 131k tokens for longer conversations and complex instructions.
4. 4.Updated knowledge cut-off — Pretraining data up to May 2025, instruction fine-tuning up to October 2025.

Available quantizations

Usage

llama.cpp

# Download a specific quantization
huggingface-cli download INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v2.0-GGUF \
    --include "MamayLM-Gemma-3-12B-IT-v2.0-Q4_K_M.gguf" \
    --local-dir .

# Run with llama-cli
llama-cli -m MamayLM-Gemma-3-12B-IT-v2.0-Q4_K_M.gguf \
    -p "Коли був заснований Київський університет?" \
    -n 512

Ollama

Create a Modelfile:

FROM ./MamayLM-Gemma-3-12B-IT-v2.0-Q4_K_M.gguf

Then:

ollama create mamaylm-gemma3-12b-v2.0 -f Modelfile
ollama run mamaylm-gemma3-12b-v2.0

LM Studio

Search for MamayLM-Gemma-3-12B-IT-v2.0-GGUF in the model browser, or download a GGUF file manually and load it.

Download

# Download all quantizations
huggingface-cli download INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v2.0-GGUF

# Download a specific file
huggingface-cli download INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v2.0-GGUF \
    --include "MamayLM-Gemma-3-12B-IT-v2.0-Q4_K_M.gguf" \
    --local-dir .

License

MamayLM-Gemma-3-12B-IT-v2.0-GGUF is distributed under the Gemma Terms of Use.