FluffyKaeloky/Midnight-Miqu-103B-v1.5-exl2-3.0bpw-rpcal

<div style="width: auto; margin-left: auto; margin-right: auto"> <img src="https://i.imgur.com/Tn9MBg6.png" alt="MidnightMiqu" style="width: 100%; min-width: 400px; display: block; margin: auto;"> </div>

Midnight-Miqu-103B-v1.5-exl2-3.0bpw-rpcal

This is a 3.0bpw EXL2 quant of FluffyKaeloky/Midnight-Miqu-103B-v1.5

The pippa file used for calibration is optimised for roleplay. The measurement file can be found in the files if you want to do your own quants.

Details about the model and the merge info can be found at the fp16 model link above.