Modelpublic

shisa-ai/shisa-v2-llama3.1-405b-W8A8-INT8

sourceHugging Facellama3.1updated 1y agoView on Hugging Face

0likes12downloads

Model Card

Quantized w/ llm-compressor using shisa-ai/shisa-v2-sharegpt as the calibration set.

Original model: shisa-ai/shisa-v2-llama3.1-405b