Modelpublic

QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

4likes1.3kdownloads

Model Card

base_model:

—PowerInfer/SmallThinker-3B-Preview tags:
—abliterated
—uncensored

![QuantFactory Banner](https://hf.co/QuantFactory)

QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF

This is quantized version of huihui-ai/SmallThinker-3B-Preview-abliterated created using llama.cpp

Original Model Card

huihui-ai/SmallThinker-3B-Preview-abliterated

This is an uncensored version of PowerInfer/SmallThinker-3B-Preview created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Use with ollama

You can use huihui_ai/smallthinker-abliterated directly

ollama run huihui_ai/smallthinker-abliterated