appvoid/merging-x2

1---2base_model:3- appvoid/palmer-0024- TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T5- vihangd/DopeyTinyLlama-1.1B-v16- appvoid/palmer-0037library_name: transformers8tags:9- mergekit10- merge11 12---13# merge14 15This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).16 17## Merge Details18### Merge Method19 20This model was merged using the passthrough merge method.21 22### Models Merged23 24The following models were included in the merge:25* [appvoid/palmer-002](https://huggingface.co/appvoid/palmer-002)26* [TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T)27* [vihangd/DopeyTinyLlama-1.1B-v1](https://huggingface.co/vihangd/DopeyTinyLlama-1.1B-v1)28* [appvoid/palmer-003](https://huggingface.co/appvoid/palmer-003)29 30### Configuration31 32The following YAML configuration was used to produce this model:33 34```yaml35slices:36  - sources:37    - model: appvoid/palmer-00238      layer_range: [0, 5]39  - sources:40    - model: appvoid/palmer-00341      layer_range: [4, 10]42  - sources:43    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T44      layer_range: [8, 15]45  - sources:46    - model: vihangd/DopeyTinyLlama-1.1B-v147      layer_range: [12, 20]48  - sources:49    - model: appvoid/palmer-00350      layer_range: [16, 21]51merge_method: passthrough52dtype: float1653 54```55