Modelpublic

Alissonerdx/exllamav2-0.2.7-cu12.8.0.torch2.7.0-cp312-cp312-linux_x86_64

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

0likes

Model Card

Exllamav2 package compiled with:

CUDA: 12.8.0

TORCH: 2.7.0

TORCHCUDAARCH_LIST="6.0 6.1 7.0 7.5 8.0 8.6 8.9 9.0+PTX Blackwell"