Modelpublic

riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face

0likes13downloads

Model Card

image/png

Lyra4-Gutenberg2-12B-5bpw-h6-exl2

This is a 5bpw h6 exl2 quant of Lyra4-Gutenberg2-12B

Built-in(default) calibration dataset is used.