CoolFace
Modelpublic

Sumail/Alchemist_04_base2_2b

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face
0likes11downloads
README.md37 linesDownload Raw Back to root
1---2license: apache-2.03tags:4- mergewss]5- mergekit6- lazymergekit7- zzttbrdd/sn6_20_new8- deepnetguy/gemma-649---10 11# Alchemist_04_base2_2b12 13Alchemist_04_base2_2b is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):14* [zzttbrdd/sn6_20_new](https://huggingface.co/zzttbrdd/sn6_20_new)15* [deepnetguy/gemma-64](https://huggingface.co/deepnetguy/gemma-64)16 17## 🧩 Configuration18 19```yaml20slices:21  - sources:22      - model: zzttbrdd/sn6_20_new23        layer_range: [0, 18]24      - model: deepnetguy/gemma-6425        layer_range: [0, 18]26merge_method: slerp27base_model: zzttbrdd/sn6_20_new28parameters:29  t:30    - filter: self_attn31      value: [0, 0.5, 0.3, 0.7, 1]32    - filter: mlp33      value: [1, 0.5, 0.7, 0.3, 0]34    - value: 0.535dtype: bfloat1636 37```