HanzoHuang/Qwen3.5-2B-RKLLM

Qwen3.5-2B-RKLLM

RKLLM/RKNN-converted Qwen3.5-2B multimodal artifacts for Rockchip RK3576 and RK3588 NPUs.

This is a VLM conversion: each supported platform requires both the .rkllm language model and the matching .rknn vision encoder. The pair must come from the same platform directory. These are hardware-specific artifacts, not Transformers checkpoints.

Base model

• —Upstream model: Qwen/Qwen3.5-2B
• —License: Apache-2.0
• —Model type: VLM (vision-language model)

Conversion and variants

Toolkit version

RKLLM Toolkit: v1.3.0 · RKNN vision conversion: paired `.rknn` encoder

Use a matching pair for the exact target SoC.

The root Qwen3.5-2B_vision.onnx is the vision conversion input; use the platform-specific .rknn encoder for deployment.

Usage

Download both files for the target platform:

hf download HanzoHuang/Qwen3.5-2B-RKLLM \
  RK3576/Qwen3.5-2B_RK3576_w4a16_g128.rkllm \
  RK3576/Qwen3.5-2B_vision_RK3576.rknn \
  --local-dir Qwen3.5-2B-RKLLM

Use them with the RKLLM VLM runtime. For a Docker API, see Hanzo-Huang/rkllm-docker and set MODEL_KIND=vlm with both model files.

Limitations

The vision encoder and language model are SoC-specific and must be kept as a matching pair. Validate image preprocessing, memory use, and runtime compatibility on your device.

Acknowledgements

Thanks to the Qwen Team, Rockchip, and the RKLLM/RKNN community.