CoolFace
Modelpublic

QuantFactory/Llama-3.2-3B-Instruct-abliterated-GGUF

sourceHugging Facellama3.2updated 2y agoView on Hugging Face
26likes8.8kdownloads
Model Card

libraryname: transformers license: llama3.2 basemodel: meta-llama/Llama-3.2-3B-Instruct tags:

  • —abliterated
  • —uncensored

![QuantFactory Banner](https://hf.co/QuantFactory)

QuantFactory/Llama-3.2-3B-Instruct-abliterated-GGUF

This is quantized version of huihui-ai/Llama-3.2-3B-Instruct-abliterated created using llama.cpp

Original Model Card

🦙 Llama-3.2-3B-Instruct-abliterated

This is an uncensored version of Llama 3.2 3B Instruct created with abliteration (see this article to know more about it).

Special thanks to @FailSpy for the original code and technique. Please follow him if you're interested in abliterated models.

Evaluations

The following data has been re-evaluated and calculated as the average for each test.

BenchmarkLlama-3.2-3B-InstructLlama-3.2-3B-Instruct-abliterated
IF_Eval76.5576.76
MMLU Pro27.8828.00
TruthfulQA50.5550.73
BBH41.8141.86
GPQA28.3928.41

The script used for evaluation can be found inside this repository under /eval.sh, or click here