RichardErkhov/CorticalStack_-_pikus-pikantny-7B-dare-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

pikus-pikantny-7B-dare - GGUF

• —Model creator: https://huggingface.co/CorticalStack/
• —Original model: https://huggingface.co/CorticalStack/pikus-pikantny-7B-dare/

Original model description: --- license: apache-2.0 tags:

• —merge
• —mergekit
• —bardsai/jaskier-7b-dpo-v5.6
• —mlabonne/NeuralDaredevil-7B
• —Gille/StrangeMerges_21-7B-slerp
• —CultriX/NeuralTrix-7B-dpo ---

<img src="pikus-pikantny.png" alt="Pikus pikantny logo" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/>

pikus-pikantny-7B-dare

pikus-pikantny-7B-dare is a DARE merge of the following models using mergekit:

• —bardsai/jaskier-7b-dpo-v5.6
• —mlabonne/NeuralDaredevil-7B
• —Gille/StrangeMerges_21-7B-slerp
• —CultriX/NeuralTrix-7B-dpo

See the paper Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch for more on the method.

🧩 Configuration

models:
  - model: bardsai/jaskier-7b-dpo-v5.6
  - model: mlabonne/NeuralDaredevil-7B
    parameters:
      density: 0.53
      weight: 0.3
  - model: Gille/StrangeMerges_21-7B-slerp
    parameters:
      density: 0.53
      weight: 0.4
  - model: CultriX/NeuralTrix-7B-dpo
    parameters:
      density: 0.53
      weight: 0.3
merge_method: dare_ties
base_model: bardsai/jaskier-7b-dpo-v5.6
parameters:
  int8_mask: true
dtype: bfloat16