CoolFace
Modelpublic

novelaide/Qwen3-Reranker-0.6B-Q8_0-GGUF

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes41downloads
Model Card

Qwen3 Reranker 0.6B Q8_0 GGUF

This repository contains the exact immutable local-model asset used by NovelAide. This GGUF is a NovelAide-built derived artifact produced from the official Safetensors checkpoint. It is not an official Qwen GGUF release.

Provenance

  • —Base model: `Qwen/Qwen3-Reranker-0.6B`
  • —Asset source: `Qwen/Qwen3-Reranker-0.6B`
  • —Pinned source revision: e61197ed45024b0ed8a2d74b80b4d909f1255473
  • —Runtime: llama-cpp
  • —NovelAide asset ID: qwen3-reranker-0.6b
  • —NovelAide CDN prefix: qwen3-reranker-0.6b-gguf/e137d193dfb7691d

The base model and conversion input are the official Qwen/Qwen3-Reranker-0.6B Safetensors at immutable revision e61197ed45024b0ed8a2d74b80b4d909f1255473.

NovelAide converts that checkpoint to BF16 GGUF and then quantizes it to Q8_0 with ggml-org/llama.cpp tag b9842, commit 6f4f53f2b7da54fcdbbecaaa734337c337ad6176. This is the llama.cpp revision embedded by the Desktop runtime's node-llama-cpp@3.19.0.

The resulting GGUF is a NovelAide-built derived asset, not an upstream Qwen GGUF. Its immutable content-addressed object prefix is qwen3-reranker-0.6b-gguf/e137d193dfb7691d; it must not overwrite the previously published community-derived artifact.

Files

FileSizeSHA-256
qwen3-reranker-0.6b-q8_0.gguf609.54 MiBe137d193dfb7691d072ca1418ac66a93cf898a62ac282823470d427f61d93206

Usage

Use the GGUF files with a compatible llama.cpp runtime and the ONNX files with a compatible ONNX / Transformers.js runtime. NovelAide pins the exact files and checksums shown above; do not substitute similarly named quantizations.

License and attribution

The model asset follows the upstream apache-2.0 license. Review the linked base model and asset source model cards for their complete terms, limitations, and attribution requirements. NovelAide is not affiliated with or endorsed by the upstream model authors.