CoolFace
Modelpublic

Zoyd/CreitinGameplays_ConvAI-9b-v2-4_0bpw_exl2

sourceHugging Facemitupdated 2y agoView on Hugging Face
0likes20downloads
Model Card

Exllamav2 quant (exl2 / 4.0 bpw) made with ExLlamaV2 v0.1.1

Other EXL2 quants: | Quant | Model Size | lm_head | | ----- | ---------- | ------- | |<center>[2.2](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-2_2bpw_exl2)</center> | <center>2671 MB</center> | <center>6</center> | |<center>[2.5](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-2_5bpw_exl2)</center> | <center>2958 MB</center> | <center>6</center> | |<center>[3.0](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-3_0bpw_exl2)</center> | <center>3477 MB</center> | <center>6</center> | |<center>[3.5](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-3_5bpw_exl2)</center> | <center>3997 MB</center> | <center>6</center> | |<center>[3.75](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-3_75bpw_exl2)</center> | <center>4256 MB</center> | <center>6</center> | |<center>[4.0](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-4_0bpw_exl2)</center> | <center>4515 MB</center> | <center>6</center> | |<center>[4.25](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-4_25bpw_exl2)</center> | <center>4776 MB</center> | <center>6</center> | |<center>[5.0](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-5_0bpw_exl2)</center> | <center>5556 MB</center> | <center>6</center> | |<center>[6.0](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-6_0bpw_exl2)</center> | <center>6605 MB</center> | <center>8</center> | |<center>[6.5](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-6_5bpw_exl2)</center> | <center>7137 MB</center> | <center>8</center> | |<center>[8.0](https://huggingface.co/Zoyd/CreitinGameplays_ConvAI-9b-v2-8_0bpw_exl2)</center> | <center>7983 MB</center> | <center>8</center> |

ConvAI-9b v2: A Conversational AI Model

img

1. Model Details

  • —Model Name: ConvAI-9b v2
  • —Authors: CreitinGameplays
  • —Date: May 29th, 2024

2. Model Description

ConvAI-9b v2 is a fine-tuned conversational AI model with 9 billion parameters. It is based on the following models:

3. Training Data

The model was fine-tuned on a custom dataset of conversations between an AI assistant and a user. The dataset format followed a specific structure:

<|system|> (system prompt, e.g.: You are a helpful AI language model called ChatGPT, your goal is helping users with their questions) </s> <|user|> (user prompt) </s>

4. Intended Uses

ConvAI-9b is intended for use in conversational AI applications, such as:

  • —Chatbots
  • —Virtual assistants
  • —Interactive storytelling
  • —Educational tools

5. Limitations

  • —Like any other language model, ConvAI-9b v2 may generate incorrect or misleading responses.
  • —It may exhibit biases present in the training data.
  • —The model's performance can be affected by the quality and format of the input text.

6. Evaluation

~ soon