Modelpublic

FoxlightAI/qwen3-5-9b-mtp

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

0likes

Model Card

FoxlightAI/qwen3-5-9b-mtp

This repository contains an MTP speculative-decoding sidecar derived from `Qwen/Qwen3.5-9B`. It is not a standalone model — it provides the multi-token-prediction heads used by Skulk to speculatively decode for the target model `Qwen/Qwen3.5-9B`. The heads ship at full precision (bf16, unquantized) — they are the speculative drafter, where precision drives draft acceptance — so there is one sidecar per base model and it serves every quantization of the target.

Provenance

Field	Value
Artifact type	mtp-sidecar
Source model	`Qwen/Qwen3.5-9B`
Source revision	`c202236235762e1c871ad0ccb60c8ee5ba337b9a`
Target model	`Qwen/Qwen3.5-9B`
Extracted with	skulk-weights-publisher `0.1.0`
Generated	2026-06-04T16:28:47Z

Usage

Skulk loads this sidecar (mtp.safetensors) alongside the target model to enable MTP speculative decoding. It is referenced from the Skulk Weights Publisher catalog and fetched automatically by the Skulk shard downloader; it is not intended to be loaded standalone.

License

This artifact is derived from `Qwen/Qwen3.5-9B` and is published under that model's original license (apache-2.0), preserved unchanged. Refer to the source model's card for the full terms.