EnlistedGhost/Ministral-3-3B-Instruct-2512-GGUF

<img src="https://ollama.com/assets/library/mistral-nemo/72045292-694a-4867-88c8-8635c9d97030" alt="Example image" width="168" height="128">

<img src="https://ollama.com/assets/library/ministral-3/83fa3859-d87f-492c-bd81-596cfbceeccb" alt="Example image" width="64" height="64">

-----------------------------------------------<br /> - Update August 14th 2026 -<br />-----------------------------------------------

• —New chat template! Yes, a new chat template that completely fixes previous issues for llama.cpp users <br />and retains higher performance than the originally made template for Ollama/Yollama users!
• —Fixed both F16 and F32 MMPROJ Multi-Modal Vision projectors. (Re-Uploaded with working projectors)
• —Uploaded custom, high-quality, new "GH05T" edition Quant files for this model! (This is a brand new method I have been developing for some time, I sincerely hope you enjoy it!)

Custom GH05T Quants Added: These offer significantly higher performance and quality of response over previously uploaded release files while remaining <br /> similar or smaller in size!

• —IQ2_M
• —Q2KL
• —IQ3_M
• —Q3KL
• —IQ4_XS
• —Q4KM
• —Q5KXL
• —Q6KL
• —Q80L
• —F16

New JINJA Tokenizer Chat-Template: <br /> (This template features a sliding context window of TWENTY-NINE (29) messages. <br /> This can be adjusted per-individual requirements simply by altering <br />the number 29 in the template higher or lower in numerical value)

{%- set ns = namespace(remMessage=false, hasSys=false, injSystem=true) -%}
{%- for msg in messages -%}
	{%- if msg.role == "system" -%}
		{%- set ns.hasSys = true -%}
	{%- endif -%}
{%- endfor -%}
{%- for msg in messages -%}
	{{- bos_token }}
	{%- if ns.injSystem -%}
		[SYSTEM_PROMPT]
		{%- if ns.hasSys -%}
			{{ msg.content }}
		{%- else -%}
			'Follow instructions the user provides... (System Prompt)'
		{%- endif -%}
		[/SYSTEM_PROMPT]
		{%- set ns.injSystem = false -%}
	{%- endif -%}
	{%- if (messages|length - loop.index0) < 29 -%}
		{%- set ns.remMessage = true -%}
	{%- endif -%}
	{%- if ns.remMessage -%}
		{%- if msg.role == "user" -%}
			{{- '[INST]' }}
			{%- if msg.content is string %}
				{{ msg.content }}
        	{%- else %}
            	{%- for block in msg.content %}
            		{%- if block.type == 'text' %}
                    	{{- block.text }}
                	{%- elif block.type in ['image', 'image_url'] %}
                    	{{- '[IMG]' }}
                	{%- endif %}
            	{%- endfor %}
            {%- endif %}
            {{- '[/INST]' }}
		{%- elif msg.role == "assistant" -%}
			{{ msg.content }}
		{%- endif -%}
	{%- endif -%}
	{{- eos_token }}
{%- endfor -%}

------------------------------------------------<br /> - Model Details and Specifications: -<br />------------------------------------------------

Ministral-3 3B Instruct 2512 (GGUF)

This release contains: <br /> GGUF converted and Quantized model files (Compatible with:)

• —Yollama - Privacy and Security Rewrite of Ollama
• —Llama.cpp
• —Ollama

Quantized GGUF version of:

• —Ministral-3-3B-Instruct-2512-BF16 <br /> (by MistralAI)

Original Model Link:

• —mistralai/Ministral-3-3B-Instruct-2512-BF16

-------------------------------------------------------------<br /> - GGUF Conversion and Quantization Details: -<br />-------------------------------------------------------------

Software used to convert Safetensors to GGUF:

• —<a href="https://github.com/ggml-org/llama.cpp/">llama.cpp</a>

Software used to create Quantized GGUF Files:

• —<a href="https://github.com/ggml-org/llama.cpp/">llama.cpp</a>

Specific GitHub Commit Point:

• —<a href="https://github.com/ggml-org/llama.cpp/commit/85c40c9b02941ebf1add1469af75f1796d513ef4">b7540</a>

Converted to GGUF and Quantized by:

• —EnlistedGhost

--------------------------<br /> ---- Original Info ---- <br /> --------------------------

(Crossposted from the link in the above section: "Model Details"): <br /> <br /> <br /> <br />

Ministral 3 14B Instruct 2512 BF16

The largest model in the Ministral 3 family, Ministral 3 14B offers frontier capabilities and performance comparable to its larger Mistral Small 3.2 24B counterpart. A powerful and efficient language model with vision capabilities.

This model is the instruct post-trained version, fine-tuned for instruction tasks, making it ideal for chat and instruction based use cases.

The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware. Ministral 3 14B can even be deployed locally, capable of fitting in 32GB of VRAM in BF16, and less than 24GB of RAM/VRAM when quantized.

We provide a no-loss FP8 version here, you can find other formats and quantizations in the Ministral 3 - Additional Checkpoints collection.

Key Features

Ministral 3 14B consists of two main architectural components:

• —13.5B Language Model
• —0.4B Vision Encoder

The Ministral 3 14B Instruct model offers the following capabilities:

• —Vision: Enables the model to analyze images and provide insights based on visual content, in addition to text.
• —Multilingual: Supports dozens of languages, including English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic.
• —System Prompt: Maintains strong adherence and support for system prompts.
• —Agentic: Offers best-in-class agentic capabilities with native function calling and JSON outputting.
• —Edge-Optimized: Delivers best-in-class performance at a small scale, deployable anywhere.
• —Apache 2.0 License: Open-source license allowing usage and modification for both commercial and non-commercial purposes.
• —Large Context Window: Supports a 256k context window.

Use Cases

Private AI deployments where advanced capabilities meet practical hardware constraints:

• —Private/custom chat and AI assistant deployments in constrained environments
• —Advanced local agentic use cases
• —Fine-tuning and specialization
• —And more...

Bringing advanced AI capabilities to most environments.

Ministral 3 Family

Other formats available here.

Benchmark Results

We compare Ministral 3 to similar sized models.

Reasoning

Instruct

Base

License

This model is licensed under the Apache 2.0 License.

You must not use this model in a manner that infringes, misappropriates, or otherwise violates any third party’s rights, including intellectual property rights.