duyntnet/WizardLM-13B-V1.2-imatrix-GGUF

Quantizations of https://huggingface.co/WizardLMTeam/WizardLM-13B-V1.2

Inference Clients/UIs

• —llama.cpp
• —JanAI
• —KoboldCPP
• —text-generation-webui
• —ollama

From original readme

<b>Note for model system prompts usage:</b>

<b>WizardLM</b> adopts the prompt format from <b>Vicuna</b> and supports multi-turn conversation. The prompt should be as following:

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>USER: Who are you? ASSISTANT: I am WizardLM.</s>......

Inference WizardLM Demo Script

We provide the inference WizardLM demo code here.

Please cite the paper if you use the data or code from WizardLM.