Brooooooklyn/Qwen-AgentWorld-35B-A3B-UD-Q5_K_XL-mlx

Qwen-AgentWorld-35B-A3B — UD-Q5KXL (mlx-node)

5-bit base mixed-precision quantization of Qwen/Qwen-AgentWorld-35B-A3B for Apple Silicon, using the Unsloth Dynamic per-tensor bit allocation with imatrix-AWQ pre-scaling via mlx-node.

Qwen-AgentWorld-35B-A3B is the first native language world model for agentic environment simulation — a Qwen3.5-VL-MoE (hybrid Gated-DeltaNet + full attention, 256 experts, vision-language) that simulates agentic environments via long chain-of-thought reasoning, predicting the next environment state from an agent's action and interaction history. A single model spans seven interaction domains: MCP (tool calling), Search, Terminal, SWE, Android, Web, and OS. Trained CPT → SFT → RL on Qwen3.5-35B-A3B-Base. (technical report)

All Variants

Benchmarked on a cool Apple M5 Max: median decode throughput over three 512-token generations, with a 60-second idle GPU cooldown after every generation. (Sustained decode on Apple Silicon is thermally sensitive — back-to-back benchmarking on a hot chip can understate throughput by 20–30%, so every model here was measured from a comparable cool start.)

Performance

Steady-state decode: 95.4 tok/s (1.6x vs BF16) on Apple M5 Max. Decode is memory-bandwidth bound on Apple Silicon — fewer bytes per token directly translates to higher throughput. The MoE architecture activates only 8 of 256 experts per token (~3B active out of ~34.7B total), so the active-weight footprint streamed per token is what matters.

Output Quality

Decoded-text quality was verified against the BF16 reference with a multi-judge review of the actual generated output (not a heuristic): a multi-turn factual chat plus a structured reasoning/code task. This UD-Q5_K_XL build produced coherent prose, correct facts, and a correct implementation — no runaway generation, repetition loops, or stray tokens — on par with full precision.

Per-Tensor Quantization

Quantization Strategy

Built on Unsloth Dynamic 2.0 per-tensor KLD analysis: sensitive layers (attention/SSM inputs, downproj, embeddings/head) get higher bits, while the bulk of FFN expert weights are quantized to the base width. `selfattn.oproj`, `linearattn.outproj`, the split low-rank GDN projections (`inproja/b`) and the MoE router gates are pinned to 8-bit affine (groupsize 64). GatedDeltaNet state-space parameters and the vision encoder stay bf16.

imatrix-AWQ: unlike a plain affine quant, these builds apply imatrix activation-aware pre-scaling (AWQ-style) using the unsloth imatrix, so the attention/SSM channels that matter most are scaled before rounding — recovering quality at the lowest bit widths.

Architecture

Usage

import { loadSession } from '@mlx-node/lm';

const session = await loadSession('./Qwen-AgentWorld-35B-A3B-UD-Q5_K_XL-mlx');

for await (const event of session.sendStream('An agent runs `ls -la` in /home/user. Predict the terminal output and the resulting environment state.', {
  config: { maxNewTokens: 2048, temperature: 0.6, reasoningEffort: 'low' },
})) {
  if (!event.done) process.stdout.write(event.text);
}

How It Was Made

mlx convert \
  -i Qwen-AgentWorld-35B-A3B \
  -o Qwen-AgentWorld-35B-A3B-UD-Q5_K_XL-mlx \
  -q --q-recipe unsloth --q-bits 5\
  --imatrix-path imatrix_unsloth.gguf_file

The Unsloth recipe's per-tensor bit tiers were applied with imatrix-AWQ pre-scaling (imatrix from unsloth/Qwen-AgentWorld-35B-A3B-GGUF), so activation-weighted channels are scaled before quantization. 7-bit tiers are snapped up to 8-bit (MLX affine supports 2/3/4/5/6/8-bit).

Acknowledgments

• —[Qwen Team](https://huggingface.co/Qwen) — For the Qwen-AgentWorld model and the Qwen3.5 base architecture
• —[Unsloth](https://unsloth.ai) — Per-layer KLD bit-allocation (Dynamic 2.0) and the imatrix used for AWQ pre-scaling
• —[Apple MLX](https://github.com/ml-explore/mlx) — For the Metal-accelerated ML framework

License

Apache-2.0 (inherited from base model).