CoolFace
Datasetpublic

sdananya/eigenbench-oct-dpo-vs-introspection

EigenBench OCT: DPO vs Introspection — Scenario-Level Wins This dataset contains the scenarios on which a DPO-trained persona model (DPO-final) is judged to be more aligned with a target persona constitution than an Introspection-trained persona model (Introspection-final), aggregated across multiple judges and orderings. The ten persona constitutions are taken from the OCT (Open Constitution Taxonomy) set shipped with EigenBench (data/constitutions/oct_*.json): goodness, humor… See the full description on the dataset page: https://huggingface.co/datasets/sdananya/eigenbench-oct-dpo-vs-introspection.

sourceHugging Facemitupdated 5mo agoView on Hugging Face
0likes8downloads
discussions and pull requests

Conversations for this repository live on Hugging Face.

CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.

Open discussions on Hugging Face
sdananya/eigenbench-oct-dpo-vs-introspection · CoolFace