CoolFace
Modelpublic

yelim24/Merge-EEVE-10.8B

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes8downloads
Model Card

Merge-EEVE-10.8B

Merge-EEVE-10.8B is a merge of the following models using mergekit:

🧩 Configuration

'''yaml slices:

  • —sources:
  • —model: yanolja/EEVE-Korean-Instruct-10.8B-v1.0 layer_range: [0, 48]
  • —model: ai-human-lab/EEVE-KoreanInstruct-10.8B-expo layerrange: [0, 48] mergemethod: slerp basemodel: ai-human-lab/EEVE-Korean_Instruct-10.8B-expo parameters: t:
  • —filter: self_attn value: [0, 0.5, 0.3, 0.7, 1]
  • —filter: mlp value: [1, 0.5, 0.7, 0.3, 0]
  • —value: 0.5 dtype: bfloat16 '''