CoolFace
Modelpublic

majentik/Qwen3-Embedding-8B-GGUF-IQ4_XS

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes27downloads
Model Card

Qwen3-Embedding-8B GGUF IQ4_XS

llama.cpp GGUF IQ4_XS quantization of Qwen/Qwen3-Embedding-8B.

  • —Produced with: llama-quantize (upstream llama.cpp, April 2026 build)
  • —BF16 source converted via convert_hf_to_gguf.py from the fresh llama.cpp tree
  • —Quant type: IQ4_XS
  • —File size: 4.0 GB

Quickstart

bash
llama-embedding -m qwen3-emb-8b-IQ4_XS.gguf \
  -p "What is the capital of France?"

Or via llama-cpp-python:

python
from llama_cpp import Llama
llm = Llama(model_path="qwen3-emb-8b-IQ4_XS.gguf", embedding=True)
vec = llm.embed("What is the capital of France?")

License

Apache 2.0 — inherited from the upstream base model.

See also