CoolFace
Datasetpublic

jmajkutewicz/PKU-SafeRLHF-binarized

Dataset Summary This is a binarized version of the PKU-SafeRLHF dataset. It was converted to a format suitable for DPO alignment training by selecting responses with lower severity as preferred responses. Please see the original PKU-SafeRLHF dataset for full dataset details: https://huggingface.co/datasets/PKU-Alignment/PKU-SafeRLHF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes42downloads
discussions and pull requests

Conversations for this repository live on Hugging Face.

CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.

Open discussions on Hugging Face
jmajkutewicz/PKU-SafeRLHF-binarized · CoolFace