CoolFace
Modelpublic

Bahushruth/Qwen3.6-35B-A3B-abliterated-v4-GGUF

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
7likes8.3kdownloads
40 commits on main
b8a9ab23mo ago

Fix: IQ2_M without MTP (compatible with all runtimes)

Bahushruth
33fd0793mo ago

Update model card: fix MTP runtime compatibility note

Bahushruth
f01d54a3mo ago

Fix: Q2_K without MTP (compatible with all runtimes)

Bahushruth
3c1e1173mo ago

Fix: IQ3_XXS without MTP (compatible with all runtimes)

Bahushruth
773bd953mo ago

Fix: IQ3_M without MTP (compatible with all runtimes)

Bahushruth
db98c653mo ago

Fix: Q3_K_M without MTP (compatible with all runtimes)

Bahushruth
17011f73mo ago

Fix: IQ4_NL without MTP (compatible with all runtimes)

Bahushruth
584a61f3mo ago

Fix: IQ4_XS without MTP (compatible with all runtimes)

Bahushruth
7347b6d3mo ago

Fix: Q4_K_M without MTP (compatible with all runtimes)

Bahushruth
f0f43f83mo ago

Fix: Q5_K_M without MTP (compatible with all runtimes)

Bahushruth
4f2f6643mo ago

Fix: Q6_K without MTP (compatible with all runtimes)

Bahushruth
4cfefa13mo ago

Fix: Q8_0 without MTP (compatible with all runtimes)

Bahushruth
cb3bd8c3mo ago

Add BF16-MTP variant (for llama-server with --spec-type draft-mtp)

Bahushruth
451d34d3mo ago

Fix: BF16 without MTP (compatible with Ollama/LMStudio/KoboldCPP)

Bahushruth
96b8ce03mo ago

Fix model card: clarify no-MTP default, MTP as separate file for advanced users

Bahushruth
12ab7763mo ago

Update model card: add all quants, MTP support, imatrix details

Bahushruth
893957e4mo ago

Update BF16 GGUF (with MTP)

Bahushruth
ed5313d4mo ago

Update Q2_K quantization (with MTP)

Bahushruth
7af4f624mo ago

Update IQ3_M quantization (with MTP)

Bahushruth
875fd734mo ago

Update Q3_K_M quantization (with MTP)

Bahushruth
1e0c1e64mo ago

Update IQ4_NL quantization (with MTP)

Bahushruth
0cb64f04mo ago

Update IQ4_XS quantization (with MTP)

Bahushruth
0c0d93d4mo ago

Update Q4_K_M quantization (with MTP)

Bahushruth
ff450444mo ago

Update Q5_K_M quantization (with MTP)

Bahushruth
3a76fca4mo ago

Update Q6_K quantization (with MTP)

Bahushruth
682fd0f4mo ago

Update Q8_0 quantization (with MTP)

Bahushruth
e0dbe194mo ago

Add IQ2_M quantization (imatrix)

Bahushruth
20ab91a4mo ago

Add Q2_K quantization (imatrix)

Bahushruth
1b94a2f4mo ago

Add IQ3_XXS quantization (imatrix)

Bahushruth
bbcd37a4mo ago

Add IQ3_M quantization (imatrix)

Bahushruth
e8bc22d4mo ago

Add Q3_K_M quantization (imatrix)

Bahushruth
46dc7c74mo ago

Add IQ4_NL quantization (imatrix)

Bahushruth
3d063214mo ago

Add IQ4_XS quantization (imatrix)

Bahushruth
d5b37354mo ago

Add model card with quantization guide

Bahushruth
bb35cfa4mo ago

v4: Q4_K_M GGUF - 1-dir norm-preserving abliteration

Bahushruth
c4be5974mo ago

v4: Q5_K_M GGUF - 1-dir norm-preserving abliteration

Bahushruth
01505974mo ago

v4: Q6_K GGUF - 1-dir norm-preserving abliteration

Bahushruth
24567b34mo ago

v4: Q8_0 GGUF - 1-dir norm-preserving abliteration

Bahushruth
a5ac9474mo ago

v4: BF16 GGUF

Bahushruth
3d94f784mo ago

initial commit

Bahushruth