Modelpublic

lucyknada/Eric111_Mayo-exl2-6bpw

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes16downloads

Model Card

exl2 quant (measurement.json included)

original readme below

license: apache-2.0 tags:

—merge
—mergekit
—lazymergekit
—mlabonne/NeuralBeagle14-7B
—openchat/openchat-3.5-0106 ---

Mayo

Mayo is a merge of the following models using mergekit:

—mlabonne/NeuralBeagle14-7B
—openchat/openchat-3.5-0106

Acknowledgements: https://github.com/mlabonne/llm-course

🧩 Configuration

yaml

slices:
  - sources:
      - model: mlabonne/NeuralBeagle14-7B
        layer_range: [0, 32]
      - model: openchat/openchat-3.5-0106
        layer_range: [0, 32]
merge_method: slerp
base_model: mlabonne/NeuralBeagle14-7B
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: bfloat16