turboderp/Laguna-XS-2.1-exl3
134
EXL3 quants of poolside/Laguna-XS-2.1
⚠️ Requires ExLlamaV3 v1.2.0 (or dev branch)
2.00 bits per weight 3.00 bits per weight 4.00 bits per weight 5.00 bits per weight 6.00 bits per weight
EXL3 quants of poolside/Laguna-XS-2.1
⚠️ Requires ExLlamaV3 v1.2.0 (or dev branch)
2.00 bits per weight 3.00 bits per weight 4.00 bits per weight 5.00 bits per weight 6.00 bits per weight