Modelpublic

gulf-inference/qwen3-8b-gguf

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes7downloads

Model Card

qwen3-8b-gguf

Optimized qwen3-8b-gguf for efficient inference.

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("gulf-inference/qwen3-8b-gguf", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("gulf-inference/qwen3-8b-gguf", trust_remote_code=True)