CoolFace
Modelpublic

sraj/Merge_Linear

sourceHugging Faceupdated 4mo agoView on Hugging Face
0likes17downloads
README.md48 linesDownload Raw Back to root
1---2base_model:3- sraj/CMB_WX_SYN_CX_LRD4- sraj/CMB_FWEdu_V2_FastTxt_CX_LRD5- sraj/CMB_MARK_CX_LRD6library_name: transformers7tags:8- mergekit9- merge10 11---12# merge_all13 14This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).15 16## Merge Details17### Merge Method18 19This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method.20 21### Models Merged22 23The following models were included in the merge:24* [sraj/CMB_WX_SYN_CX_LRD](https://huggingface.co/sraj/CMB_WX_SYN_CX_LRD)25* [sraj/CMB_FWEdu_V2_FastTxt_CX_LRD](https://huggingface.co/sraj/CMB_FWEdu_V2_FastTxt_CX_LRD)26* [sraj/CMB_MARK_CX_LRD](https://huggingface.co/sraj/CMB_MARK_CX_LRD)27 28### Configuration29 30The following YAML configuration was used to produce this model:31 32```yaml33models:34  - model: sraj/CMB_MARK_CX_LRD35    parameters:36      weight: 1.037  - model: sraj/CMB_FWEdu_V2_FastTxt_CX_LRD38    parameters:39      weight: 1.040  - model: sraj/CMB_WX_SYN_CX_LRD41    parameters:42      weight: 1.043merge_method: linear44parameters:45  normalize: true46dtype: bfloat1647```48