yujiepan/awq-model-zoo
yujiepan/awq-model-zoo Here are some pre-computed awq information (scales & clips) used in llm-awq. Scripts Install the forked llm-awq at https://github.com/yujiepan-work/llm-awq/tree/a41a08e79d8eb3d6335485b3625410af22a74426. Note: works with transformers==4.35.2 Generating awq-info.pt: python do_awq.py --model_id mistralai/Mistral-7B-v0.1 --w_bit 8 --q_group_size 128 --dump_awq ./awq-info.pt Load a quantized model: You can use the offical repo to get a… See the full description on the dataset page: https://huggingface.co/datasets/yujiepan/awq-model-zoo.
Upload ./mistralai/Mistral-7B-Instruct-v0.2/awq-w3asym-g128/awq-meta.pt with huggingface_hub
Upload ./mistralai/Mistral-7B-Instruct-v0.2/awq-w8asym-g128/awq-meta.pt with huggingface_hub
Upload ./mistralai/Mistral-7B-Instruct-v0.2/awq-w4asym-g128/awq-meta.pt with huggingface_hub
Create do_awq.py
Update README.md
Upload mistralai/Mistral-7B-v0.1/awq-w3asym-g128/awq-info.pt with huggingface_hub
Upload mistralai/Mistral-7B-v0.1/awq-w8asym-g128/awq-info.pt with huggingface_hub
Upload mistralai/Mistral-7B-v0.1/awq-w4asym-g128/awq-info.pt with huggingface_hub
Update README.md
Update README.md
Create README.md
Upload meta-llama/Llama-2-7b-chat-hf/awq-w3asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-7b-chat-hf/awq-w8asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-7b-chat-hf/awq-w4asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-13b-chat-hf/awq-w3asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-13b-chat-hf/awq-w8asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-13b-chat-hf/awq-w4asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-7b-hf/awq-w3asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-7b-hf/awq-w8asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-7b-hf/awq-w4asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-13b-hf/awq-w3asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-13b-hf/awq-w8asym-g128/awq-info.pt with huggingface_hub
Upload meta-llama/Llama-2-13b-hf/awq-w4asym-g128/awq-info.pt with huggingface_hub
Upload huggyllama/llama-7b/awq-w3asym-g128/awq-info.pt with huggingface_hub
Upload huggyllama/llama-7b/awq-w8asym-g128/awq-info.pt with huggingface_hub
Upload huggyllama/llama-7b/awq-w4asym-g128/awq-info.pt with huggingface_hub
initial commit