CoolFace
Modelpublic

NikitosKey/Merge-Math-Coder-7B-v2

sourceHugging Faceupdated 9mo agoView on Hugging Face
0likes44downloads
mergekit_config.yml18 linesDownload Raw Back to root
1 2slices:3  - sources:4      - model: Qwen/Qwen2.5-Math-7B-Instruct5        layer_range: [0, 28]6      - model: Qwen/Qwen2.5-Coder-7B-Instruct7        layer_range: [0, 28]8merge_method: slerp9base_model: Qwen/Qwen2.5-Math-7B-Instruct10parameters:11  t:12    - filter: self_attn13      value: [0, 0.5, 0.3, 0.7, 1] 14    - filter: mlp15      value: [0, 0.5, 0.3, 0.7, 1]16    - value: 0.5 17dtype: bfloat1618