model zoo
wsinfer-model-zoo-jsonThis is the registry of models in the WSInfer Model Zoo.
See https://wsinfer.readthedocs.io/en/latest/ and https://github.com/SBU-BMI/wsinfer-zoo for more information.
awq-model-zooGelGenie-Model-ZooThis is the registry of models which can be used both in PyTorch (standalone) or in the GelGenie QuPath Extension. You can access the individual models from the links provided.
For more details, please visit our open-source codebase here: https://github.com/mattaq31/GelGenie.
ModelZooawq-model-zoo
yujiepan/awq-model-zoo
Here are some pre-computed awq information (scales & clips) used in llm-awq.
Scripts
Install the forked llm-awq at https://github.com/yujiepan-work/llm-awq/tree/a41a08e79d8eb3d6335485b3625410af22a74426. Note: works with transformers==4.35.2
Generating awq-info.pt:
python do_awq.py --model_id mistralai/Mistral-7B-v0.1 --w_bit 8 --q_group_size 128 --dump_awq ./awq-info.pt
Load a quantized model: You can use the offical repo to get a fake/real… See the full description on the dataset page: https://huggingface.co/datasets/yujiepan/awq-model-zoo.Model_zoo