Modelpublic

KevHamm07/qwen2.5-coder-7b-hermes-reviewer-gguf-v0-4

sourceHugging Faceupdated 4mo agoView on Hugging Face

0likes16downloads

Model Card

qwen2.5-coder-7b-hermes-reviewer-gguf-v0-4

GGUF conversion of KevHamm07/qwen2.5-coder-7b-hermes-reviewer-lora-v0-4, a LoRA adapter merged into Qwen/Qwen2.5-Coder-7B-Instruct.

Files

—qwen2.5-coder-7b-hermes-reviewer-lora-v0-4-q5_k_m.gguf — Q5KM — 5.07 GiB

Ollama

bash

hf download KevHamm07/qwen2.5-coder-7b-hermes-reviewer-gguf-v0-4 qwen2.5-coder-7b-hermes-reviewer-lora-v0-4-q4_k_m.gguf --local-dir ./model-gguf
cat > ./model-gguf/Modelfile <<'EOF'
FROM ./qwen2.5-coder-7b-hermes-reviewer-lora-v0-4-q4_k_m.gguf
PARAMETER temperature 0.2
PARAMETER num_ctx 4096
PARAMETER stop <|im_end|>
EOF
ollama create my-model:latest -f ./model-gguf/Modelfile
ollama run my-model:latest