CoolFace
Modelpublic

flylcw/Qwen3-4B-Instruct-2507_w8a8_g128_1.2.2_rkllm

sourceHugging Faceapache-2.0updated 11mo agoView on Hugging Face
4likes28downloads
Model Card

Qwen3-4B-Instruct-2507w8a8g128

  • —My quant for Rock5B (RK3588 board)
  • —Author: @flylcw
  • —建议运行环境:RKLLM-Toolkit在1.2.x应该都可运行,NPU驱动版本需>v0.9.8

Conversion details:

  • —RKLLM-Toolkit version: v1.2.2
  • —NPU driver: v0.9.8
  • —Python: 3.11
  • —Quantization: w8a8_g128
  • —Output: single-file .rkllm artifact
  • —Modifications: quantization (w8a8_g128), export to .rkllm format for RK3588 SBCs