Sumail/Alchemist_04_base2_2b
011
1---2license: apache-2.03tags:4- mergewss]5- mergekit6- lazymergekit7- zzttbrdd/sn6_20_new8- deepnetguy/gemma-649---10 11# Alchemist_04_base2_2b12 13Alchemist_04_base2_2b is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):14* [zzttbrdd/sn6_20_new](https://huggingface.co/zzttbrdd/sn6_20_new)15* [deepnetguy/gemma-64](https://huggingface.co/deepnetguy/gemma-64)16 17## 🧩 Configuration18 19```yaml20slices:21 - sources:22 - model: zzttbrdd/sn6_20_new23 layer_range: [0, 18]24 - model: deepnetguy/gemma-6425 layer_range: [0, 18]26merge_method: slerp27base_model: zzttbrdd/sn6_20_new28parameters:29 t:30 - filter: self_attn31 value: [0, 0.5, 0.3, 0.7, 1]32 - filter: mlp33 value: [1, 0.5, 0.7, 0.3, 0]34 - value: 0.535dtype: bfloat1636 37```