CoolFace
Datasetpublic

violetxi/harvey-closed-book-qwen35-9b-notes-conditioned-30m-kl-0p05

harvey-closed-book-qwen35-9b-notes-conditioned-30m-kl-0p05 Completed closed-book C&H knowledge evaluation of violetxi/qwen35-9b-harvey-v4-notes-conditioned-30m-kl-0p05, revision 1bced92ee267198876b452d59e13cf17c41d5df9, job 122412. All 7,933 probes completed without API errors. Each probe category is a separate split in this single repo. Split Probes Accuracy forward_qa 2,515 16.90% mc_logprob 1,780 50.45% negative_abstain 1,799 41.30% reversed_qa 1,839 7.94%… See the full description on the dataset page: https://huggingface.co/datasets/violetxi/harvey-closed-book-qwen35-9b-notes-conditioned-30m-kl-0p05.

sourceHugging Faceupdated 5d agoView on Hugging Face
0likes379downloads
2 commits on main
21f48d15d ago

Publish complete closed-book evaluation with four probe-category splits

violetxi
45a52ec5d ago

initial commit

violetxi