duyntnet/Ministral-3b-instruct-imatrix-GGUF

Quantizations of https://huggingface.co/ministral/Ministral-3b-instruct

Inference Clients/UIs

• —llama.cpp
• —KoboldCPP
• —ollama
• —text-generation-webui
• —GPT4All
• —jan ---

From original readme

<!-- Provide a longer summary of what this model is. -->

Ministral is a series of language model, build with same architecture as the famous Mistral model, but with less size.

• —Model type: A 3B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
• —Language(s) (NLP): Primarily English
• —License: Apache 2.0
• —Finetuned from model: mistralai/Mistral-7B-v0.1