Modelpublic

gghfez/72B-Qwen2.5-Kunou-v1-control-vectors

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

1likes251downloads

Model Card

gghfez/72B-Qwen2.5-Kunou-v1-control-vectors

Creative Writing control-vectors for Sao10K/72B-Qwen2.5-Kunou-v1

Usage example

llama.cpp

llama-server --model  72B-Qwen2.5-Kunou-v1-Q4_K.gguf [other CLI arguments] \
    --control-vector  72B-Qwen2.5-Kunou-v1-character_focus__debias.gguf \
    --control-vector  72B-Qwen2.5-Kunou-v1-character_focus__dialogue.gguf \
    --control-vector  <other vectors>

Trained on 1xH100NVL using jukofyork's control-vectors

Based off Version v3.0 of creative-writing-control-vectors-v3.0.

See here for more info about control-vectors creative-writing-control-vectors-v3.0