CoolFace
Modelpublic

SicariusSicariiStuff/Negative_LLAMA_70B_EXL3_1.6bpw

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes15downloads
Model Card

Note

This was made to test extremely low quants. 70B is NOT usable at 1.6 bpw. A custom strategy for quanting was used, for details check EXL3 repo.