CoolFace
Modelpublic

noctrex/SmallThinker-4B-A0.6B-Instruct-MXFP4_MOE-GGUF

sourceHugging Faceupdated 11mo agoView on Hugging Face
0likes75downloads
Model Card

This is a MXFP4_MOE quantization of the model SmallThinker-4BA0.6B-Instruct A quantization with imatrix is also included

Original model: https://huggingface.co/PowerInfer/SmallThinker-4BA0.6B-Instruct