duyntnet/flammen21X-mistral-7B-imatrix-GGUF

Quantizations of https://huggingface.co/flammenai/flammen21X-mistral-7B

Inference Clients/UIs

• —llama.cpp
• —JanAI
• —KoboldCPP
• —text-generation-webui
• —ollama
• —GPT4All

From original readme

A Mistral 7B LLM built from merging pretrained models and finetuning on flammenai/Prude-Phi3-DPO. Flammen specializes in exceptional character roleplay, creative writing, and general intelligence.