CoolFace
Datasetpublic

dispatchAI/chat-format-reference

Chat Format Reference Correct chat formats for dispatchAI GGUF models. Use with llama-cpp-python's chat_format parameter. Usage from llama_cpp import Llama llm = Llama(model_path='model.gguf', chat_format='llama-3') # For SmolLM2/Llama-3.2 🚀 dispatchAI

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
0likes16downloads
Dataset Card

Chat Format Reference

Correct chat formats for dispatchAI GGUF models. Use with llama-cpp-python's chat_format parameter.

Usage

python
from llama_cpp import Llama
llm = Llama(model_path='model.gguf', chat_format='llama-3')  # For SmolLM2/Llama-3.2

🚀 dispatchAI