CoolFace
Modelpublic

Novaciano/Toxic.NPC-1B-GGUF

sourceHugging Facegemmaupdated 7mo agoView on Hugging Face
0likes33downloads
Model Card

Toxic.NPC-1B

Model creator: Novaciano<br/> Original model: Novaciano/Toxic.NPC-1B<br/> GGUF quantization: provided by Novaciano using llama.cpp<br/>

Special thanks

๐Ÿ™ Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

bash
ollama run "hf.co/Novaciano/Toxic.NPC-1B-GGUF:Q4_K_M"

Use with LM Studio

bash
lms load "Novaciano/Toxic.NPC-1B-GGUF"

Use with llama.cpp CLI

bash
llama-cli --hf "Novaciano/Toxic.NPC-1B-GGUF:Q4_K_M" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

bash
llama-server --hf "Novaciano/Toxic.NPC-1B-GGUF:Q4_K_M" -c 4096