Modelpublic

LeroyDyer/SpydazWebAI_MiniAI_248m

sourceHugging Faceupdated 2y agoView on Hugging Face

1likes13downloads

Model Card

merge

Finally Joined the mini AI Group!

Merge Details

Merge Method

This model was merged using the TIES merge method using Locutusque/TinyMistral-248M-v2 as a base.

Models Merged

The following models were included in the merge:

—Felladrin/TinyMistral-248M-Chat-v2

Configuration

The following YAML configuration was used to produce this model:

yaml


base_model: Locutusque/TinyMistral-248M-v2
dtype: float16
merge_method: ties
parameters:
  int8_mask: 1.0
  normalize: 1.0
slices:
- sources:
  - layer_range: [0, 12]
    model: Felladrin/TinyMistral-248M-Chat-v2
    parameters:
      density: [1.0, 0.7, 0.1]
      weight: 1.0
  - layer_range: [0, 12]
    model: Locutusque/TinyMistral-248M-v2
    parameters:
      density: 0.5
      weight: [0.0, 0.3, 0.7, 1.0]