iknow-lab/JudgeBias-DPO-RefFree-LOSO-iupac
JudgeBias-DPO-RefFree-LOSO-iupac A Leave-One-Swap-Type-Out (LOSO) variant of JudgeBias-DPO-RefFree for evaluating out-of-distribution generalization of DPO-trained LLM judges. Held-out Swap Type Field Value Swap type IUPAC Axis τ⁺ (representational) Removed dataset llm_to_iupac_100pct Description compound-to-IUPAC name conversion All DPO pairs derived from llm_to_iupac_100pct have been removed from both training and validation splits. The… See the full description on the dataset page: https://huggingface.co/datasets/iknow-lab/JudgeBias-DPO-RefFree-LOSO-iupac.
Add Qwen3-8B judge inference predictions (DPO-LOSO + base) on validation
Initial upload: LOSO-iupac DPO dataset (llm_to_iupac_100pct held out)
initial commit
