Brooooooklyn/Qwen3.5-27B-UD-Q2_K_XL-mlx

Qwen3.5-27B — UD-Q2KXL (mlx-node)

2-bit base mixed-precision quantization of Qwen/Qwen3.5-27B for Apple Silicon, using the **Unsloth Dynamic** quantization strategy via mlx-node.

All Variants

Per-Tensor Bit Assignments (N=2)

Based on Unsloth Dynamic 2.0 per-tensor KLD analysis with imatrix AWQ pre-scaling.

Usage

import {{ loadModel }} from '@mlx-node/lm';
const model = await loadModel('./Qwen3.5-27B-UD-Q2_K_XL-mlx');
const result = await model.chat(
  [{{ role: 'user', content: 'Hello!' }}],
  {{ maxNewTokens: 2048, temperature: 0.6, enableThinking: false }},
);
console.log(result.text);

How It Was Made

mlx convert -i Qwen3.5-27B -o Qwen3.5-27B-UD-Q2_K_XL-mlx -q --q-bits 2 --q-recipe unsloth --imatrix-path imatrix_unsloth.gguf

Acknowledgments

• —[Unsloth](https://unsloth.ai) — Per-layer KLD benchmarks and Dynamic 2.0 methodology
• —[Qwen Team](https://huggingface.co/Qwen) — Qwen3.5 model family
• —[Apple MLX](https://github.com/ml-explore/mlx) — Metal-accelerated ML framework

License

Apache 2.0 (inherited from base model).