Modelpublic

Edens-Gate/rae-12b-kto-with-lora-merged

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes5downloads

Model Card

rae-12b-with-lora

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Passthrough merge method using Delta-Vector/Rei-V2-12B + NewEden/KTO-rae-adaptor as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

base_model: Delta-Vector/Rei-V2-12B+NewEden/KTO-rae-adaptor
dtype: bfloat16
merge_method: passthrough
models:
  - model: Delta-Vector/Rei-V2-12B+NewEden/KTO-rae-adaptor