RichWoollcott/DCL-Qwen3-4B-Instruct-2507-LoRA

DCL-Qwen3-4B-Instruct-2507 — LoRA adapter (~132 MB)

The LoRA adapter (r=16, α=32, attention+MLP targets) behind DCL-Qwen3-4B-Instruct-2507, a fine-tune of Qwen/Qwen3-4B-Instruct-2507 that authors and repairs DCL (Russell East's Declarative Capability Language). See the main model card for the evaluation table, the required serving prompt, and limitations.

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch

m = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B-Instruct-2507",
                                         dtype=torch.bfloat16, device_map="auto")
m = PeftModel.from_pretrained(m, "RichWoollcott/DCL-Qwen3-4B-Instruct-2507-LoRA")
tok = AutoTokenizer.from_pretrained("Qwen/Qwen3-4B-Instruct-2507")

Note: the adapter was trained against the 4-bit quantised base (QLoRA); applied to the full-precision base as above, behaviour matches the released merged model to within quantisation noise — the frozen-exam receipts were graded on the merged Q4KM build.

Trained on a private corpus of 507 compiler-verified, fully synthetic rows with Unsloth + TRL (PEFT 0.19.1) — kept private to protect the integrity of the frozen evaluation exam. Apache-2.0; base LICENSE retained.