Modelpublic

nightmedia/Qwen3.5-122B-A10B-Text-mxfp4-mlx

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face

11likes495downloads

Model Card

Qwen3.5-122B-A10B-Text-mxfp4-mlx

This model is Text only, the vision tower was removed.

Brainwaves

brainwaves

           arc arc/e
qx85     0.456,0.519,0.622,0.704,0.392,0.774,0.680
qx64-hi  0.445,0.513,0.622,0.704,0.384,0.786,0.702
mxfp4    0.455,0.510,0.621,...

Quant    Perplexity     Speed(t/s)  Memory
qx85     3.762 ± 0.024  448         98.86 GB
qx64-hi  3.778 ± 0.024  435         98.28 GB
mxfp4    3.909 ± 0.025  535         71.94 GB

-G

This model Qwen3.5-122B-A10B-Text-mxfp4-mlx was converted to MLX format from Qwen/Qwen3.5-122B-A10B using mlx-lm version 0.30.8.

Use with mlx

bash

pip install mlx-lm

python

from mlx_lm import load, generate

model, tokenizer = load("Qwen3.5-122B-A10B-Text-mxfp4-mlx")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True, return_dict=False,
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)