duyntnet/Mistral-Nemo-Gutenberg-Vitus-12B-imatrix-GGUF

Quantizations of https://huggingface.co/nbeerbower/Mistral-Nemo-Gutenberg-Vitus-12B

Open source inference clients/UIs

• —llama.cpp
• —KoboldCPP
• —text-generation-webui
• —jan

Closed source inference clients/UIs

• —LM Studio
• —More will be added... ---

From original readme

Mistral-Nemo-Gutenberg-Vitus-12B

Mistral-Nemo-Gutenberg-Encore-12B finetuned on nbeerbower/human-writing-dpo with Mistral Instruct.

Method

ORPO tuned with 1x RTX A6000 for 3 epochs.