CoolFace
Modelpublic

GemMaroc/Qwen2.5-32B-Instruct-darija-gguf

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes17downloads
Model Card

Qwen2.5-32B-Instruct-darija-gguf

This repository contains quantized versions of Qwen2.5-32B-Instruct-darija in GGUF format for efficient inference.

Available Quantizations

QuantizationDescriptionFile SizeUse Case
f16FP16 (no quantization)62499.97 MBBest quality, largest size
0033207.78 MBQuantized version

Usage

Using llama.cpp

bash
# Download the desired quantization
wget https://huggingface.co/GemMaroc/Qwen2.5-32B-Instruct-darija-gguf/resolve/main/Qwen2.5-32B-Instruct-darija_ckpt-*_q8_0.gguf

# Run inference
./llama-cli -m Qwen2.5-32B-Instruct-darija_ckpt-*_q8_0.gguf -p "Your prompt here"

Using Python with llama-cpp-python

python
from llama_cpp import Llama

# Load the quantized model
llm = Llama(
    model_path="./Qwen2.5-32B-Instruct-darija_ckpt-*_q8_0.gguf",
    n_ctx=32768,  # Context length
    n_threads=8,  # Number of CPU threads
)

# Generate text
response = llm("Your prompt here", max_tokens=512)
print(response['choices'][0]['text'])

Model Information

Recommendations

  • —For best quality: Use f16 (largest file size)
  • —For balanced performance: Use q8_0 (recommended)
  • —For resource-constrained environments: Use tq2_0 or tq1_0

Citation

If you use this model, please cite the original GemMaroc paper:

bibtex
@misc{skiredj2025gemmarocunlockingdarijaproficiency,
      title={GemMaroc: Unlocking Darija Proficiency in LLMs with Minimal Data},
      author={Abderrahman Skiredj and Ferdaous Azhari and Houdaifa Atou and Nouamane Tazi and Ismail Berrada},
      year={2025},
      eprint={2505.17082},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2505.17082},
}