Koshkasa/Gryphe_WorldSim-Opus-3.6-35B-A3B-iQ_compact_APEX-GGUF
0477
What's that?
A modification of the default APEX i-Compact Qwen 3.6 35B A3B recipe utilizing IQ3_S instead of Q3K, **IQ4NL instead of Q4_K, and Q80** instead of Q6K in shared exps, applied to Gryphe/WorldSim-Opus-3.6-35B-A3B. Though slower on older hardware, they should preserve much more brain due to better outlier handling.
Deliberately stepping away from mixed math/article/story/rp soup datasets, imatrix dataset is a random conversation 250000-token prune of Squish42/bluemoon-fandom-1-1-rp-cleaned. For RP-specific finetunes not aimed at being a "general assistant", the weights engaged in creative writing must be preserved first. At least that's how the theory goes!
Disclosure
My only contribution is compute. This is not my merge. Have fun.
