Modelpublic

NewEden-Forge/Sol-Reaver-15B-Chat-Base

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes8downloads

Model Card

modelstock

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using /alloc/axolotl/Rae-15B-chat/checkpoint-1568 as a base.

Models Merged

The following models were included in the merge:

—/alloc/axolotl/Rae-15B-chat/checkpoint-1470
—/alloc/axolotl/Rae-15B-chat/checkpoint-1274
—/alloc/axolotl/Rae-15B-chat/checkpoint-1372

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: /alloc/axolotl/Rae-15B-chat/checkpoint-1372
  - model: /alloc/axolotl/Rae-15B-chat/checkpoint-1470
  - model: /alloc/axolotl/Rae-15B-chat/checkpoint-1274
merge_method: model_stock
base_model: /alloc/axolotl/Rae-15B-chat/checkpoint-1568
normalize: true
int8_mask: true
dtype: bfloat16