QuantFactory/HomerCreativeAnvita-Mix-Qw7B-GGUF

library_name: transformers tags:

• —mergekit
• —merge base_model:
• —ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix
• —ZeroXClem/Qwen2.5-7B-HomerCreative-Mix model-index:
• —name: HomerCreativeAnvita-Mix-Qw7B results:
• —task: type: text-generation name: Text Generation dataset: name: IFEval (0-Shot) type: HuggingFaceH4/ifeval args: numfewshot: 0 metrics:
• —type: instlevelstrictacc and promptlevelstrictacc value: 78.08 name: strict accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=suayptalha/HomerCreativeAnvita-Mix-Qw7B name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: BBH (3-Shot) type: BBH args: numfewshot: 3 metrics:
• —type: accnorm value: 36.98 name: normalized accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllm_leaderboard?query=suayptalha/HomerCreativeAnvita-Mix-Qw7B name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: MATH Lvl 5 (4-Shot) type: hendrycks/competitionmath args: numfew_shot: 4 metrics:
• —type: exactmatch value: 31.04 name: exact match source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllm_leaderboard?query=suayptalha/HomerCreativeAnvita-Mix-Qw7B name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: GPQA (0-shot) type: Idavidrein/gpqa args: numfewshot: 0 metrics:
• —type: accnorm value: 8.61 name: accnorm source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=suayptalha/HomerCreativeAnvita-Mix-Qw7B name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: MuSR (0-shot) type: TAUR-Lab/MuSR args: numfewshot: 0 metrics:
• —type: accnorm value: 14.73 name: accnorm source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=suayptalha/HomerCreativeAnvita-Mix-Qw7B name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: MMLU-PRO (5-shot) type: TIGER-Lab/MMLU-Pro config: main split: test args: numfewshot: 5 metrics:
• —type: acc value: 38.28 name: accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=suayptalha/HomerCreativeAnvita-Mix-Qw7B name: Open LLM Leaderboard


QuantFactory/HomerCreativeAnvita-Mix-Qw7B-GGUF

This is quantized version of suayptalha/HomerCreativeAnvita-Mix-Qw7B created using llama.cpp

Original Model Card

Merged Model

This is a merge of pre-trained language models created using mergekit.

[image]

This model is currently ranked #1 on the Open LLM Leaderboard among models up to 13B parameters!

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

• —ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix
• —ZeroXClem/Qwen2.5-7B-HomerCreative-Mix

Configuration

The following YAML configuration was used to produce this model:

base_model: ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
dtype: bfloat16
merge_method: slerp
parameters:
  t:
  - filter: self_attn
    value: [0.0, 0.5, 0.3, 0.7, 1.0]
  - filter: mlp
    value: [1.0, 0.5, 0.7, 0.3, 0.0]
  - value: 0.5
slices:
- sources:
  - layer_range: [0, 28]
    model: ZeroXClem/Qwen2.5-7B-HomerCreative-Mix
  - layer_range: [0, 28]
    model: ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix

Open LLM Leaderboard Evaluation Results

Detailed results can be found here