exllamav2
Llama-3.2-3B-4bit-group128-exllamav2-gptqMeta-Llama-3.1-70B-Instruct-ExLlamaV2-2.5bitMeta-Llama-3.1-70B-Instruct-ExLlamaV2-2.2bitexllamav2-testMeta-Llama-3.1-8B-ExLlamaV2-INT8Meta-Llama-3.1-70B-Instruct-ExLlamaV2-3bitLlama-3.2-3B-Instruct-Quan-2.8bits-1100-exllamav2Meta-Llama-3.1-70B-Instruct-ExLlamaV2-4bit
