usermma/Holo-3.1-4B-abliterated-rdo
13
Holo-3.1-4B-OBLITERATED
This model was abliterated using the `rdo` method via OBLITERATUS.
How to Use
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("Holo-3.1-4B-OBLITERATED")
tokenizer = AutoTokenizer.from_pretrained("Holo-3.1-4B-OBLITERATED")
prompt = "Hello, how are you?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))About OBLITERATUS
OBLITERATUS is an open-source tool for removing refusal behavior from language models via activation engineering (abliteration). Learn more at github.com/elder-plinius/OBLITERATUS.
