Modelpublic

higokri/RestoreKV-Qwen3-8B_plus

sourceHugging Facecc-by-nc-4.0updated 2mo agoView on Hugging Face

0likes320downloads

Model Card

RestoreKV-Qwen3-8B_plus

PEFT LoRA adapter + restore-token embeddings for RestoreKV (paper), a budget-matched, single-pass plug-in that recovers full-cache behavior under aggressive KV cache eviction on top of KVzip.

—Base model: Qwen/Qwen3-8B — base scorer: KVzip+
—adapter_model.safetensors: rank-8 LoRA (α=16) on q/k/v/o/gate/up/down proj
—restore_embeddings.safetensors: 8 learned restore-token embeddings

Load via the RestoreKVPress in NVIDIA/kvpress.

License

CC BY-NC 4.0 (distilled with LongAlpaca-derived data; research / non-commercial).