CoolFace
Modelpublic

redponike/AceMath-72B-Instruct-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
1likes231downloads
Model Card

GGUF quants of nvidia/AceMath-72B-Instruct

Paper link on arXiv

Using llama.cpp b4682 (commit 0893e0114e934bdd0eba0ff69d9ef8c59343cbc3)

The importance matrix was generated with groups_merged-enhancedV3.txt by InferenceIllusionist (later renamed calibrationdatav3.txt), an edited version of kalomaze's original groupsmerged.txt.

All quants were generated/calibrated with the imatrix, including the K quants.