Modelpublic

SLBM/affine-k100-king-head

sourceHugging Faceapache-2.0updated 28d agoView on Hugging Face

0likes316downloads

Model Card

affine-k100-king-head

Private eval candidate. Not submitted to SN120.

Recipe: hv4 attention + hv4 routers + 100% sitting-king expert FFNs + sitting-king embed_tokens / lm_head / final RMSNorm.

Parents:

—controllers: angryaffine/Affine-5dhnrnxlw4-hv4 @ 9116967529160659279f25bda30e8cfde26439cf
—experts + vocab head: tojointhecommunity/affine-5efg6cm3yl-king @ 7c1c94cd0572475d4b3e3fde5258b0e79563d54f

Download:

bash

huggingface-cli download SLBM/affine-k100-king-head --local-dir /workspace/models/soups/hv4_graft_king_experts_kinghead