NotHereNorThere/Coral-v1.5-0.6B

Coral-v1.5-0.6B by NotHereNorThere

A 0.6B parameter uncensored generalist with adaptive Chain-of-Thought reasoning, it decides on its own whether a question needs thinking or not. Built from a 5-donor TIES merge of Qwen3-0.6B finetunes, healed with a 1k row fine-tune pass.

Part of the Coral-v1.5 model family, which adds to the original CoralLM series (Llama 3.2 1B based). Coral-v1.5 moves to Qwen3 architecture for native <think> support and significantly improved base capability.

What makes it interesting

• —Adaptive CoT at 0.6B — the model routes dynamically: simple questions get instant answers, complex reasoning tasks trigger <think> blocks. This accidently emerged from the fine-tune data mix rather than being explicitly trained.
• —Uncensored — refusal behavior has been removed via two abliterated donors. It just answers things.
• —Correct arithmetic — passes basic math with clean step-by-step working.

Merge Recipe

Method: TIES Base: Qwen/Qwen3-0.6B Tool: mergekit

base_model: Qwen/Qwen3-0.6B
merge_method: ties
dtype: bfloat16
parameters:
  normalize: true
  int8_mask: true

Fine-tune

Post-merge heal pass to fix coherence, identity, counting, and context retention. Also reinforces when to use CoT vs when to answer directly.

• —500 rows — OpenHermes 2.5 (simple QA + instruction following)
• —500 rows — OpenThoughts (reasoning with CoT)
• —Method: QLoRA + Flash Attention 2
• —Total: 1,000 rows, randomly sampled and shuffled

The 50/50 split between non-CoT and CoT data is seemingly what produced the adaptive routing behavior.

Evaluation

Tested post-heal on the following:

Quant Guide