Apppublic

K00B404/MergekitCustom

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

0likes

SEC_Dolphin_slerp.yaml16 linesDownload Raw Back to examples

1slices:2  - sources:3      - model: arcee-ai/sec-mistral-7b-instruct-1.6-epoch4        layer_range: [0, 32]5      - model: cognitivecomputations/dolphin-2.8-mistral-7b-v026        layer_range: [0, 32]7merge_method: slerp8base_model: cognitivecomputations/dolphin-2.8-mistral-7b-v029parameters:10  t:11    - filter: self_attn12      value: [0, 0.5, 0.3, 0.7, 1]13    - filter: mlp14      value: [1, 0.5, 0.7, 0.3, 0]15    - value: 0.516dtype: bfloat16