duyntnet/SlimHercules-4.0-Mistral-7B-v0.2-imatrix-GGUF

Quantizations of https://huggingface.co/Locutusque/SlimHercules-4.0-Mistral-7B-v0.2

From original readme

• —This model was trained on OpenAI's ChatML prompt format. Because this model has function calling capabilities, the prompt format is slightly different, here's what it would look like: ``<|im_start|>system\n{message}<|im_end|>\n<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>call\n{function call message}<|im_end|>\n<|im_start|>function\n{function response message}<|im_end|>\n<|im_start|>assistant\n{assistant message}</s>``