Undi95/Mixtral-4x7B-DPO-RPChat-GGUF

Mixtral-4x7B-DPO-RPChat is a model made primarely for RP (Roleplay), 2 RP model, 1 occult model and 1 DPO model for a MoE. Toppy was the base.

The DPO was here to help get more human reply

This is my first try at doing this, so don't hesitate to give feedback!

WARNING: ALL THE "K" GGUF QUANT OF MIXTRAL MODELS SEEMS TO BE BROKEN, PREFER Q40, Q50 or Q8_0!

<!-- description start -->

Description

This repo contains quantized files of Mixtral-4x7B-DPO-RPChat.

<!-- description end --> <!-- description start -->

Models used

The list of model used and their activator/theme can be found here

<!-- description end --> <!-- prompt-template start -->

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

If you want to support me, you can here.