TheCluster/Qwen3.6-35B-A3B-Heretic-MLX-mxfp4
3115
<div align="center"><img width="400px" src="https://qianwen-res.oss-accelerate.aliyuncs.com/Qwen3.6/logo.png"></div> <div style="text-align:center; margin-bottom:12pt">If you like my work, you can <a href="https://donatr.ee/thecluster/">support me</a><br/></div>
Qwen3.6-35B-A3B Heretic
Quality: quantized (*mxfp4, 4.402 bpw*)
This is an uncensored version of Qwen/Qwen3.6-35B-A3B, made using Heretic v1.2.0 (mpoa+soma).
Abliteration metrics
Abliteration parameters
Sampling Parameters:
- I suggest using the following sets of sampling parameters depending on the mode and task type:
- Thinking mode for general tasks:
temperature=1.0,top_p=0.95,top_k=20,min_p=0.0,presence_penalty=1.5,repetition_penalty=1.0 - Thinking mode for precise coding tasks (e.g., WebDev):
temperature=0.6,top_p=0.95,top_k=20,min_p=0.0,presence_penalty=0.0,repetition_penalty=1.0 - Instruct (or non-thinking) mode for general tasks:
temperature=0.7,top_p=0.8,top_k=20,min_p=0.0,presence_penalty=1.5,repetition_penalty=1.0 - Instruct (or non-thinking) mode for reasoning tasks:
temperature=1.0,top_p=1.0,top_k=40,min_p=0.0,presence_penalty=2.0,repetition_penalty=1.0 - For supported frameworks, you can adjust the
presence_penaltyparameter between 0 and 2 to reduce endless repetitions. However, using a higher value may occasionally result in language mixing and a slight decrease in model performance. -----
Source
This model was converted to MLX format from `tvall43/Qwen3.6-35B-A3B-heretic` using mlx-vlm version 0.4.4.
