dispatchAI/chat-format-reference
Chat Format Reference Correct chat formats for dispatchAI GGUF models. Use with llama-cpp-python's chat_format parameter. Usage from llama_cpp import Llama llm = Llama(model_path='model.gguf', chat_format='llama-3') # For SmolLM2/Llama-3.2 🚀 dispatchAI
016
1---2license: apache-2.03tags: [chat-format, gguf, llama-cpp, dispatchai]4---5 6# Chat Format Reference7 8Correct chat formats for dispatchAI GGUF models. Use with llama-cpp-python's `chat_format` parameter.9 10## Usage11 12```python13from llama_cpp import Llama14llm = Llama(model_path='model.gguf', chat_format='llama-3') # For SmolLM2/Llama-3.215```16 17🚀 [dispatchAI](https://huggingface.co/dispatchAI)18