Modelpublic

ND911/Mistral0.2-Merlinite-Franken-Sonya-10.5B

sourceHugging Faceupdated 3y agoView on Hugging Face

1likes13downloads

Model Card

[image]

Mistral0.2-Merlinite-Franken-Sonya-10.5B

This is a merge of pre-trained language models created using mergekit.

Merge Details

See Below

Merge Method

This model was merged using the passthrough merge method.

Models Merged

The following models were included in the merge:

—Franken-Sonya
—Mistral-7B-Instruct-v0.2
—ND911/Franken-Merlinite-Maid

Configuration

The following YAML configuration was used to produce this model:

yaml

slices:
  - sources:
    - model: "Franken-Sonya"
      layer_range: [0, 16]
  - sources:
    - model: "ND911/Franken-Merlinite-Maid"
      layer_range: [8, 24]
  - sources:
    - model: "Mistral-7B-Instruct-v0.2"
      layer_range: [17, 32]

merge_method: passthrough
dtype: float16