Modelpublic

4bit/llama-13b-4bit-gr128

sourceHugging Faceupdated 3y agoView on Hugging Face

2likes24downloads

Model Card

Generated with: --wbits 4 --groupsize 128 --true-sequential --new-eval --faster-kernel