Modelpublic

adriabama06/SmallThinker-3B-Preview-AWQ

sourceHugging Faceupdated 2y agoView on Hugging Face

1likes21downloads

Model Card

AWQ 4 bit, 128 groupsize of PowerInfer/SmallThinker-3B-Preview

Warning: This model seems to not work, not at least in my computer with vLLM