CoolFace
Modelpublic

alpindale/Mistral-7B-Instruct-v0.2-EETQ

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes22downloads
Model Card

Model quantized using a modified EETQ repo. Currently working on decoupling its kernels from CUTLASS to make this a bit easier to use.

8bits.