Modelpublic

Novaciano/Sphynx-3.2-1B

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes14downloads

Model Card

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora as a base.

Models Merged

The following models were included in the merge:

—mishl/Regex-AI-Llama-3.2-1B
—kenken6696/Llama-3.2-1B_understood_unfamiliar_fix_middle
—nbagent/llama-3.2-1B-Instruct-sciworld-sft
—Nexus402/Nexus-Llama-3.2-1B

Configuration

The following YAML configuration was used to produce this model:

yaml

base_model: xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
merge_method: model_stock
dtype: bfloat16
parameters:
  t: [0, 0.5, 1, 0.5, 0]
models:

- model: mishl/Regex-AI-Llama-3.2-1B
- model: Nexus402/Nexus-Llama-3.2-1B
- model: nbagent/llama-3.2-1B-Instruct-sciworld-sft
- model: kenken6696/Llama-3.2-1B_understood_unfamiliar_fix_middle