RichardErkhov/AtAndDev_-_Ogno-Monarch-Neurotic-9B-Passthrough-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Ogno-Monarch-Neurotic-9B-Passthrough - GGUF

• —Model creator: https://huggingface.co/AtAndDev/
• —Original model: https://huggingface.co/AtAndDev/Ogno-Monarch-Neurotic-9B-Passthrough/

Original model description: --- license: apache-2.0 tags:

• —merge
• —mergekit
• —lazymergekit
• —bardsai/jaskier-7b-dpo-v5.6
• —eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO ---

Ogno-Monarch-Neurotic-7B-Passthrough

Ogno-Monarch-Neurotic-7B-Passthrough is a merge of the following models using mergekit:

• —bardsai/jaskier-7b-dpo-v5.6
• —eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO

🧩 Configuration

slices:
  - sources:
    - model: bardsai/jaskier-7b-dpo-v5.6
      layer_range: [0, 32]
  - sources:
    - model: eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO
      layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16