Modelpublic

NLPark/Test0_SLIDE

sourceHugging Facecc-by-nc-sa-4.0updated 2y agoView on Hugging Face

1likes20downloads

mergekit_config.yml16 linesDownload Raw Back to root

1slices:2  - sources:3      - model: UnicomLLM/Unichat-llama3-Chinese-8B4        layer_range: [0, 32]5      - model: postitive666/llama3_ruozhiba_8b6        layer_range: [0, 32]7merge_method: slerp8base_model: UnicomLLM/Unichat-llama3-Chinese-8B9parameters:10  t:11    - filter: self_attn12      value: [0, 0.5, 0.3, 0.7, 1]13    - filter: mlp14      value: [1, 0.5, 0.7, 0.3, 0]15    - value: 0.516dtype: bfloat16