duyntnet/WizardLM-2-7B-imatrix-GGUF

Quantizations of https://huggingface.co/dreamgen/WizardLM-2-7B

From original readme

Usage

❗<b>Note for model system prompts usage:</b>

<b>WizardLM-2</b> adopts the prompt format from <b>Vicuna</b> and supports multi-turn conversation. The prompt should be as following:

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, 
detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>
USER: Who are you? ASSISTANT: I am WizardLM.</s>......

<b> Inference WizardLM-2 Demo Script</b>

We provide a WizardLM-2 inference demo code on our github.