Modelpublic
CloudGoat/Qwen3.5-0.8B-JP-RoMM-Merged

sourceHugging Faceupdated 25d agoView on Hugging Face
0likes306downloads
Model Card
Qwen3.5-0.8B-JP-RoMM

This is a merge of pre-trained language models created using mergekit.
Merge Details

Merge Method

This model was merged using the SLERP merge method.
Models Merged

The following models were included in the merge:
Configuration

The following YAML configuration was used to produce this model:
yaml
merge_method: slerp
base_model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
dtype: bfloat16
parameters:
  t: 0.5
slices:
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 0
    - 1
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 0
    - 1
  merge_method: slerp
  parameters:
    t: 0.4996
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 1
    - 2
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 1
    - 2
  merge_method: slerp
  parameters:
    t: 0.4914
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 2
    - 3
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 2
    - 3
  merge_method: slerp
  parameters:
    t: 0.4913
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 3
    - 4
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 3
    - 4
  merge_method: slerp
  parameters:
    t: 0.5732
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 4
    - 5
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 4
    - 5
  merge_method: slerp
  parameters:
    t: 0.4932
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 5
    - 6
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 5
    - 6
  merge_method: slerp
  parameters:
    t: 0.4914
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 6
    - 7
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 6
    - 7
  merge_method: slerp
  parameters:
    t: 0.4793
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 7
    - 8
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 7
    - 8
  merge_method: slerp
  parameters:
    t: 0.5584
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 8
    - 9
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 8
    - 9
  merge_method: slerp
  parameters:
    t: 0.4805
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 9
    - 10
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 9
    - 10
  merge_method: slerp
  parameters:
    t: 0.4813
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 10
    - 11
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 10
    - 11
  merge_method: slerp
  parameters:
    t: 0.4783
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 11
    - 12
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 11
    - 12
  merge_method: slerp
  parameters:
    t: 0.5526
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 12
    - 13
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 12
    - 13
  merge_method: slerp
  parameters:
    t: 0.4652
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 13
    - 14
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 13
    - 14
  merge_method: slerp
  parameters:
    t: 0.4577
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 14
    - 15
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 14
    - 15
  merge_method: slerp
  parameters:
    t: 0.4522
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 15
    - 16
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 15
    - 16
  merge_method: slerp
  parameters:
    t: 0.5276
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 16
    - 17
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 16
    - 17
  merge_method: slerp
  parameters:
    t: 0.449
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 17
    - 18
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 17
    - 18
  merge_method: slerp
  parameters:
    t: 0.4521
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 18
    - 19
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 18
    - 19
  merge_method: slerp
  parameters:
    t: 0.4462
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 19
    - 20
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 19
    - 20
  merge_method: slerp
  parameters:
    t: 0.5122
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 20
    - 21
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 20
    - 21
  merge_method: slerp
  parameters:
    t: 0.4345
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 21
    - 22
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 21
    - 22
  merge_method: slerp
  parameters:
    t: 0.4364
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 22
    - 23
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 22
    - 23
  merge_method: slerp
  parameters:
    t: 0.4355
- sources:
  - model: CloudGoat/Qwen3.5-0.8B-JP-Tuned-v1.1
    layer_range:
    - 23
    - 24
  - model: Holy-fox/Qwen3.5-0.8B-JP
    layer_range:
    - 23
    - 24
  merge_method: slerp
  parameters:
    t: 0.5133