violetxi/harvey-closed-book-qwen35-9b-notes-conditioned-30m-kl-0p05
harvey-closed-book-qwen35-9b-notes-conditioned-30m-kl-0p05 Completed closed-book C&H knowledge evaluation of violetxi/qwen35-9b-harvey-v4-notes-conditioned-30m-kl-0p05, revision 1bced92ee267198876b452d59e13cf17c41d5df9, job 122412. All 7,933 probes completed without API errors. Each probe category is a separate split in this single repo. Split Probes Accuracy forward_qa 2,515 16.90% mc_logprob 1,780 50.45% negative_abstain 1,799 41.30% reversed_qa 1,839 7.94%… See the full description on the dataset page: https://huggingface.co/datasets/violetxi/harvey-closed-book-qwen35-9b-notes-conditioned-30m-kl-0p05.
0379
Publish complete closed-book evaluation with four probe-category splits
initial commit
