CoolFace
Modelpublic

kaitchup/LFM2.5-1.2B-Thinking-1.2B-autoround-gguf

sourceHugging Faceotherupdated 8mo agoView on Hugging Face
0likes64downloads
Model Card

<div align="center"> <img src="https://cdn-uploads.huggingface.co/production/uploads/64b93e6bd6c468ac7536607e/mj6xac74jHGLqymiovObc.png" alt="The Kaitchup -- AI on a Budget" style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;" /> <div style="display: flex; justify-content: center; gap: 0.5em; margin-bottom: 1em;"> <a href="https://kaitchup.substack.com/subscribe"><strong>Subscribe and Support</strong></a> </div> </div>

This is LFM2.5-1.2B-Thinking quantized with AutoRound to GGUF, mixing different precisions.

Several versions (higher bpw is better and bigger):

  • —3 average bits per weight (bpw)
  • —4 bpw
  • —5 bpw

Tested with LM Studio.