CoolFace
Modelpublic

shuhulx/Qwopus3.5-4B-Coder-Fable5-v1-GGUF

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
8likes986downloads
Model Card

<div align="center">

๐Ÿ’ป Qwopus3.5-4B-Coder-Fable5-v1 GGUF

GGUF builds for llama.cpp, LM Studio, and local inference

<p><b>Fable-5 traces</b> ยท <b>agentic coding</b> ยท <b>tool use</b> ยท <b>debugging</b></p>

</div>


Overview

Qwopus3.5-4B-Coder-Fable5-v1 is a Fable-5 trace continuation of `Jackrong/Qwopus3.5-4B-Coder`.

The base model, Qwopus3.5-4B-Coder, is a compact Qwen3.5-based coding model trained for reasoning, tool use, function calling, coding workflows, and agent-style behavior.

This release continues that model on `Glint-Research/Fable-5-traces`, a dataset of Claude Fable 5 local coding-agent traces. The dataset is heavily oriented around tool-use trajectories, repository work, local command context, code editing, debugging loops, and <think>-style reasoning completions.

The result is a small local coding-agent model intended for:

AreaDescription
Tool-use workflowsBash, Read, Write, Edit, repo inspection, and action traces.
DebuggingFailing tests, stack traces, root-cause analysis, and patch planning.
Trace-style reasoningLong-form planning and <think> style reasoning traces.
Local agentsHermes-style, Claude-Code-style, OpenCode-style, and LM Studio workflows.

Files

Typical GGUF files:

  • โ€”Qwopus3.5-4B-Coder-Fable5-v1-Q4_K_M.gguf
  • โ€”Qwopus3.5-4B-Coder-Fable5-v1-Q5_K_M.gguf
  • โ€”Qwopus3.5-4B-Coder-Fable5-v1-mmproj-BF16.gguf

Which file should I use?

FileUse case
Q4_K_MBest default. Small, fast, good quality.
Q5_K_MBetter quality while still compact.
Q8_0Higher quality, larger memory use, if included.
mmproj-BF16Multimodal projector for compatible runtimes.

llama.cpp

bash
llama-cli \
  -m Qwopus3.5-4B-Coder-Fable5-v1-Q5_K_M.gguf \
  -p "Write a Bash/Read/Edit style plan for debugging a failing Python repo." \
  -n 768 \
  --temp 0.7 \
  --top-p 0.95

llama.cpp Server

bash
llama-server \
  -m Qwopus3.5-4B-Coder-Fable5-v1-Q5_K_M.gguf \
  --host 0.0.0.0 \
  --port 8080 \
  --ctx-size 8192

Then call it with an OpenAI-compatible client:

bash
curl -X POST "http://localhost:8080/v1/chat/completions" \
  -H "Content-Type: application/json" \
  --data '{
    "model": "Qwopus3.5-4B-Coder-Fable5-v1-Q5_K_M.gguf",
    "messages": [
      {"role": "user", "content": "Write a tool-use plan for debugging a Python repo."}
    ],
    "temperature": 0.7,
    "top_p": 0.95
  }'

About the Fable-5 Traces

`Glint-Research/Fable-5-traces` contains Claude Fable 5 coding traces.

The dataset includes fields such as:

text
uid
source_file
session
model
context
cot
output_type
output
completion
origin

The examples are not simple chat pairs. They are multi-step agent trajectories with local development context, reasoning traces, and tool-use outputs.

Common patterns in the dataset include:

  • โ€”user coding requests
  • โ€”local-command caveats
  • โ€”repository inspection
  • โ€”Bash command usage
  • โ€”file reads
  • โ€”file writes
  • โ€”edits
  • โ€”debugging passes
  • โ€”playtesting / validation loops
  • โ€”<think>...</think> reasoning traces
  • โ€”tool-use completions

A large portion of the dataset is tool_use style data, which makes it especially relevant for local coding agents and developer automation.

Capabilities

Agentic coding

Designed for coding-agent loops where the model must inspect a repo, plan work, call tools, edit files, and validate changes.

Tool-use style outputs

Works well with prompts that expose structured tools such as:

text
Bash
Read
Write
Edit
Search
Grep

Debugging and repair

Useful for:

  • โ€”finding likely failing files
  • โ€”explaining stack traces
  • โ€”planning test commands
  • โ€”proposing minimal patches
  • โ€”iterating after errors

Local-first deployment

The release includes Transformers, GGUF, MLX, and MLX 4-bit formats so it can run in Python, llama.cpp, LM Studio, and Apple Silicon workflows.

Available Releases

ReleaseRepoBest for
Transformers / Safetensors`shuhulx/Qwopus3.5-4B-Coder-Fable5-v1`Python, Transformers, custom inference.
GGUF`shuhulx/Qwopus3.5-4B-Coder-Fable5-v1-GGUF`llama.cpp, LM Studio, local CPU/GPU inference.
MLX`shuhulx/Qwopus3.5-4B-Coder-Fable5-v1-MLX`Apple Silicon full MLX inference.
MLX 4-bit`shuhulx/Qwopus3.5-4B-Coder-Fable5-v1-MLX-4bit`Apple Silicon low-memory inference.

Credits

Built on: