Datasetpublic

Arkhiveus/unaligner1K_DPO

DPO only version of unaligner1K A consolidated and cleaned dataset created from toxic-dpo-v0.2, orthogonal-activation-steering-TOXIC, ToxicQAFinal. The datasets were sorted using Llama-Guard-2 and then randomly sampled. New rejections were generated by Llama-3-8B-Instruct, while new chosen answers for OAS-Toxic and ToxicQA were generated with Nous-Hermes-2-Yi-34B. No of rows from each dataset: OAS-Toxic : 311 ToxicDPO : 478 ToxicQA : 211 Harm occurrence: S1 : 62, S10 : 20, S11 :… See the full description on the dataset page: https://huggingface.co/datasets/Arkhiveus/unaligner1K_DPO.

sourceHugging Facemitupdated 2y agoView on Hugging Face

1likes11downloads

settings

This repository belongs to Arkhiveus on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameunaligner1K_DPO

visibilitypublic

licencemit

gatedno

ownerArkhiveus

Account settings