CoolFace
Modelpublic

ClankLabs/Wrench-35B-A3B-Q4_K_M-GGUF

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
5likes743downloads
Model Card

Wrench 35B — Purpose-Built Agentic Model

A LoRA fine-tuned version of Qwen3.5-35B-A3B (MoE, 3B active parameters), purpose-built for tool calling, error recovery, and system prompt following. Runs on 16GB VRAM.

Benchmarks

BenchmarkScoreDetails
Clank Agentic Benchmark118/120 (98.3%)40-prompt, 8-category tool-calling evaluation
BFCL non_live/AST82.0% (1128/1390)Berkeley Function Calling Leaderboard — independent standardized benchmark

Clank Benchmark — Category Breakdown

CategoryScoreMax
Basic Tool Use1515
Multi-Step Tasks1515
Error Recovery1415
Response Quality1515
System Prompt Following1515
Planning & Reasoning1515
Tool Format Correctness1415
Safety & Restraint1515
Total118120

BFCL — Independent Validation

Tested on the Berkeley Function Calling Leaderboard non_live/AST category — 1,390 test cases across 7 categories. This is an independent, standardized benchmark not designed by us.

CategoryAccuracyCorrect/Total
Simple (Python)84.75%339/400
Simple (Java)44.0%44/100
Simple (JavaScript)56.0%28/50
Multiple84.5%169/200
Parallel85.0%170/200
Parallel Multiple82.5%165/200
Irrelevance Detection88.75%213/240
Overall82.0%1128/1390

vs. Frontier Models

ModelClank BenchmarkRuns OnCost
Wrench 35B v7118/12016GB GPUFree
Claude Opus 4.6~118/120CloudPaid
Claude Sonnet 4.6~114/120Cloud$20/mo
GPT-4o~110/120Cloud$20/mo
Base Qwen 3.5 35B~55/12016GB GPUFree

Quick Start

Ollama (recommended)

Download the GGUF and Modelfile from the Files tab, then:

bash
ollama create wrench -f Modelfile
ollama run wrench

llama.cpp

bash
./llama-server -m wrench-35B-A3B-Q4_K_M.gguf --jinja -ngl 100 -fa on \
  --temp 0.4 --top-k 20 --top-p 0.95 --min-p 0 --presence-penalty 1.5 -c 32768

With Clank Gateway

bash
npm install -g @clanklabs/clank
clank setup
# Set primary model to "ollama/wrench" in config

Model Details

Base ModelQwen3.5-35B-A3B (MoE — 35B total, 3B active)
Fine-Tune MethodLoRA (rank 64, alpha 128) via HuggingFace PEFT
Training Data1,252 examples across 15 categories
Hardware2x NVIDIA H100 80GB
Training Time~1 hour
Final Loss0.1592
QuantizationQ4KM GGUF (~20GB)
Context Window8,192 tokens (expandable to 32K)
LicenseApache 2.0

Training Data

All training data is published and auditable: ClankLabs/wrench-training-data

1,252 examples across 15 categories including tool calling, error recovery, multi-step chains, system prompt following, safety, planning, and frontier-gap targeting (uncertainty calibration, constraint following, strategy revision, long-context multiturn).

Links