Modelpublic

bunnycore/Qwen3-4B-Dot-Goat

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

6likes8downloads

Model Card

Qwen3-4B-Dot-Goat

Qwen3-4B-Dot-Goat is a 4-billion-parameter language model derived from the Qwen3 series. It merges capabilities from a diverse set of specialized models—reasoning prowess from Polars, uncensored depth from Amoral Qwen, personalized behavior via Persona LoRA, and tool-calling agility of Jan-Nano—into a single lightweight model.

Intended Use

—Chatbots, multi-turn dialogue systems
—Instruction following, code generation, logical reasoning
—Summarization, translation, creative writing
—Agentic workflows with external tool integration

Qwen3-4B-Dot-Goat is a merge of the following models using mergekit:

🧩 Configuration

yaml

models:
  - model: bunnycore/Qwen3-4B-dot-exp
    parameters:
      density: 0.5
      weight: 0.5
  - model: fakezeta/amoral-Qwen3-4B+bunnycore/Qwen-3-4B-Persona-lora_model
    parameters:
      density: 0.4
      weight: 0.4

merge_method: ties
base_model: mlabonne/Qwen3-4B-abliterated+bunnycore/Qwen-3-4B-Persona-lora_model
parameters:
  normalize: false
  int8_mask: true
dtype: float16