ozashu/mistral-3b-sft-prompt-hack-gguf
034
mistral-3b-sft-prompt-hack-gguf
GGUF exports of the merged model.
Files:
model-f16.ggufmodel-Q4_K_M.gguf
Run with llama.cpp
llama-cli -m model-Q4_K_M.gguf -p "こんにちは" -n 128GGUF exports of the merged model.
Files:
model-f16.ggufmodel-Q4_K_M.ggufllama-cli -m model-Q4_K_M.gguf -p "こんにちは" -n 128