nethawk2025/fortunetelling-docker

1---2tags:3- gguf4- llama.cpp5- unsloth6 7---8 9# fortunetelling-docker - GGUF10 11This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth).12 13**Example usage**:14- For text only LLMs:    **llama-cli** **--hf** repo_id/model_name **-p** "why is the sky blue?"15- For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf16 17## Available Model files:18- `deepseek-r1-distill-llama-8b.Q4_K_M.gguf`19 20## Note21The model's BOS token behavior was adjusted for GGUF compatibility.22