Modelpublic

zenlm/zen-reranker-0.6B-GGUF

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes72downloads

Model Card

Zen Reranker 0.6B GGUF

0.6B Zen reranker, quantized to GGUF (Q8_0) for CPU and mixed CPU/GPU re-scoring with llama.cpp.

Repackaged from Qwen/Qwen3-Reranker-0.6B (apache-2.0, Alibaba Qwen), quantized to GGUF. Not trained from scratch — a permissively-licensed redistribution for the OSS-clean Zen model line.

Files

File	Format
`zen-reranker-0.6B-Q8_0.gguf`	GGUF Q8_0

Usage

Use with llama.cpp reranking support (llama-server --reranking, /v1/rerank). Full-precision safetensors: zenlm/zen-reranker-0.6B.

License

apache-2.0. Upstream: Qwen/Qwen3-Reranker-0.6B by Alibaba Qwen. This repository redistributes a quantized derivative under the same license.