slyusarev/Qwen3-ASR-1.7B-GGUF

Qwen3-ASR-1.7B — GGUF

GGUF builds of Qwen/Qwen3-ASR-1.7B for llama.cpp-based runtimes.

The mmproj file is required alongside any of the main files.

Q8_0 and mmproj are unmodified copies from ggml-org/Qwen3-ASR-1.7B-GGUF (identical SHA-256). Q4_K_M is requantized from that Q8_0.

Q5_K_M is converted from the original bf16 weights and quantized directly. The tied embedding matrix, which the converter writes twice, is stored once: output.weight is dropped and token_embd.weight kept at Q6K, which runtimes substitute for it — hence the file is smaller than `Q4K_M`.

License: Apache 2.0, inherited from the base model.