CoolFace
Modelpublic

Crownelius/Crow-4B-Opus-4.6-Distill-Heretic_Qwen3.5

sourceHugging Faceupdated 7mo agoView on Hugging Face
58likes2.3kdownloads
Model Card

<img src="https://huggingface.co/crownelius/Crow-9B-Opus-4.6-Distill-Heretic_Qwen3.5/resolve/main/banner.png" width="350"/>

๐Ÿชถ CROW-4B

Flagship Intelligence. Featherweight Footprint. Meticulously distilled from Claude Opus 4.6 into a highly efficient Qwen 3.5 architecture.

`Architecture:` Qwen 3.5 | `Parameters:` 4 Billion | `Teacher Model:` Claude Opus 4.6 | `Type:` Distilled LLM


๐ŸŒŸ Model Highlights

  • โ€”Distilled Excellence: Captures the deep reasoning, nuanced formatting, and instruction-following capabilities of Claude Opus 4.6.
  • โ€”Ultra Compact: At just 4B parameters, Crow-4B runs on virtually any consumer GPU or CPU โ€” including laptops and edge devices โ€” without sacrificing contextual depth.
  • โ€”Qwen 3.5 Backbone: Inherits robust multilingual support, a massive context window, and structural stability.
  • โ€”Broadest Training Mix: Trained on 15 datasets spanning reasoning, creative writing, agentic coding, security research, and roleplay โ€” over 25,000 carefully curated examples.

---Generating this model was expensive. You can support this one and future models by tipping. https://ko-fi.com/abcuo

Available Model Files:

  • โ€”Crow-4B-Opus-4.6-Distill-Heretic_Qwen3.5.BF16.gguf
  • โ€”Crow-4B-Opus-4.6-Distill-Heretic_Qwen3.5.Q8_0.gguf
  • โ€”Crow-4B-Opus-4.6-Distill-Heretic_Qwen3.5.Q5_K_M.gguf
  • โ€”Crow-4B-Opus-4.6-Distill-Heretic_Qwen3.5.Q4_K_M.gguf

Training Details

Base Modeltvall43/Qwen3.5-4B-heretic
Training FrameworkUnsloth + TRL SFTTrainer
LoRA Rankr=32, ฮฑ=32
Learning Rate2e-4 (cosine schedule)
Epochs1
Max Sequence Length2048 (model max)
HardwareNVIDIA A100 40GB

Available Model files:

Datasets (15 total, ~25,500 examples)

#DatasetCategory
1crownelius/Opus4.6-No-Reasoning-260xReasoning
2crownelius/Opus-4.6-Reasoning-2100x-formattedReasoning
3crownelius/Creative_Writing_Multiturn_EnhancedCreative Writing
4peteromallet/dataclaw-peteromalletAgentic
5TeichAI/Pony-Alpha-15kCreative / Roleplay
6crownelius/Pony-Alpha-3000x-formattedCreative / Roleplay
7HuggingFaceH4/llava-instruct-mix-vsftInstruction Following
8reedmayhew/LittleMonsterUncensored
9tandevllc/hacking-tricksSecurity Research
10m-a-p/Code-FeedbackCoding
11WithinUsAI/Python_GOD_Coder_50kCoding
12peteromallet/my-personal-codex-dataAgentic / Coding
13misterkerns/my-personal-claude-code-dataAgentic / Coding
14Roman1111111/gemini-3-pro-10000x-hard-high-reasoningReasoning
15reedmayhew/gemini-3.1-pro-2048-reasoning-1100xCoding + Reasoning

This was trained 2x faster with Unsloth

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>