CoolFace
Modelpublic

QuantFactory/Chewy-Lemon-Cookie-11B-GGUF

sourceHugging Facecc-by-4.0updated 2y agoView on Hugging Face
3likes231downloads
Model Card

language:

  • —en license: cc-by-4.0 library_name: transformers tags:
  • —mergekit
  • —merge
  • —mistral
  • —text-generation
  • —roleplay base_model:
  • —SanjiWatsuki/Kunoichi-7B
  • —SanjiWatsuki/Silicon-Maid-7B
  • —KatyTheCutie/LemonadeRP-4.5.3
  • —Sao10K/Fimbulvetr-11B-v2 model-index:
  • —name: Chewy-Lemon-Cookie-11B results:
  • —task: type: text-generation name: Text Generation dataset: name: IFEval (0-Shot) type: HuggingFaceH4/ifeval args: numfewshot: 0 metrics:
  • —type: instlevelstrictacc and promptlevelstrictacc value: 48.75 name: strict accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B name: Open LLM Leaderboard
  • —task: type: text-generation name: Text Generation dataset: name: BBH (3-Shot) type: BBH args: numfewshot: 3 metrics:
  • —type: accnorm value: 33.01 name: normalized accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B name: Open LLM Leaderboard
  • —task: type: text-generation name: Text Generation dataset: name: MATH Lvl 5 (4-Shot) type: hendrycks/competitionmath args: numfew_shot: 4 metrics:
  • —type: exactmatch value: 4.61 name: exact match source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B name: Open LLM Leaderboard
  • —task: type: text-generation name: Text Generation dataset: name: GPQA (0-shot) type: Idavidrein/gpqa args: numfewshot: 0 metrics:
  • —type: accnorm value: 3.91 name: accnorm source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B name: Open LLM Leaderboard
  • —task: type: text-generation name: Text Generation dataset: name: MuSR (0-shot) type: TAUR-Lab/MuSR args: numfewshot: 0 metrics:
  • —type: accnorm value: 15.95 name: accnorm source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B name: Open LLM Leaderboard
  • —task: type: text-generation name: Text Generation dataset: name: MMLU-PRO (5-shot) type: TIGER-Lab/MMLU-Pro config: main split: test args: numfewshot: 5 metrics:
  • —type: acc value: 25.19 name: accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B name: Open LLM Leaderboard

![QuantFactory Banner](https://hf.co/QuantFactory)

QuantFactory/Chewy-Lemon-Cookie-11B-GGUF

This is quantized version of FallenMerick/Chewy-Lemon-Cookie-11B created using llama.cpp

Original Model Card

cute

Chewy-Lemon-Cookie-11B

This is a merge of pre-trained language models created using mergekit.

GGUF quants:

  • —https://huggingface.co/backyardai/Chewy-Lemon-Cookie-11B-GGUF
  • —https://huggingface.co/mradermacher/Chewy-Lemon-Cookie-11B-GGUF
  • —https://huggingface.co/mradermacher/Chewy-Lemon-Cookie-11B-i1-GGUF

Merge Details

Merge Method

This model was merged using the following methods:

Models Merged

The following models were included in the merge:

Configuration

The following YAML configurations were used to produce this model:

yaml
slices:
  - sources:
    - model: SanjiWatsuki/Kunoichi-7B
      layer_range: [0, 24]
  - sources:
    - model: SanjiWatsuki/Silicon-Maid-7B
      layer_range: [8, 24]
  - sources:
    - model: KatyTheCutie/LemonadeRP-4.5.3
      layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16
name: Big-Lemon-Cookie-11B-BF16

---

models:
  - model: Big-Lemon-Cookie-11B-BF16
    parameters:
      weight: 0.85
  - model: Sao10K/Fimbulvetr-11B-v2
    parameters:
      weight: 0.15
merge_method: task_arithmetic
base_model: Big-Lemon-Cookie-11B-BF16
dtype: bfloat16
name: Chewy-Lemon-Cookie-11B

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

MetricValue
Avg.21.91
IFEval (0-Shot)48.75
BBH (3-Shot)33.01
MATH Lvl 5 (4-Shot)4.61
GPQA (0-shot)3.91
MuSR (0-shot)15.95
MMLU-PRO (5-shot)25.19