Modelpublic

Sorihon/Celestial-Order-24B-2.75

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes87downloads

Model Card

Celestial-Order-V2.75

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using /home/sorihon/Documents/Celestial-Order-V2.5/ as a base.

Models Merged

The following models were included in the merge:

—Sorihon/CYDR-24B

Configuration

The following YAML configuration was used to produce this model:

yaml

merge_method: dare_ties
base_model: /home/sorihon/Documents/Celestial-Order-V2.5/
models:
  - model: /home/sorihon/Documents/Celestial-Order-V2.5/
    parameters:
      density: 0.64
      weight: 0.64
  - model: Sorihon/CYDR-24B
    parameters:
      density: 0.32
      weight: 0.32
dtype: bfloat16