Modelpublic

ChenMnZ/falcon-180b-omniquant-w3a16g512

sourceHugging Faceupdated 3y agoView on Hugging Face

3likes25downloads

Model Card

Paper: https://arxiv.org/abs/2308.13137

Code: https://github.com/OpenGVLab/OmniQuant

To run this model, refer https://github.com/OpenGVLab/OmniQuant/blob/main/runing_falcon180b_on_single_a100_80g.ipynb for more details.