ThijsL202/CraneAILabs_swahili-gemma-1b-GGUF

CraneAILabs_swahili-gemma-1b - GGUF Standard

📊 Quantization Details

• —Base Model: CraneAILabs/swahili-gemma-1b
• —Quantization: Standard
• —Total Size: 4.03 GB (5 files)

📦 Standard Quantizations Classic GGUF quantizations without importance matrix enhancement.

📁 Available Files

🚀 Quick Start

llama.cpp

./llama-cli -m CraneAILabs_swahili-gemma-1b.Q6_K.gguf -p "Your prompt here" -n 512

Python

from llama_cpp import Llama

llm = Llama(model_path="./CraneAILabs_swahili-gemma-1b.Q6_K.gguf", n_ctx=2048)
output = llm("Your prompt here", max_tokens=512)
print(output["choices"][0]["text"])

📊 Model Information

Original model: CraneAILabs/swahili-gemma-1b

Quantized using [llama.cpp](https://github.com/ggml-org/llama.cpp)