frederickwang99/SoAyBench

SoAyBench by WangYC We've based SoAyBench creation on AMiner. To really understand how well LLMs can use SoAPI, we need to make AMiner's basic SoAPIs available for LLMs to use. We also need a test set made up of academic (question, solution, answer) triplets for checking how they're doing. The tricky part is, academic data keeps changing fast – stuff like info on scholars and their publications. So, keeping a test set with fixed answers is tough. To tackle this, what we've… See the full description on the dataset page: https://huggingface.co/datasets/frederickwang99/SoAyBench.