datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
research-ideation-arena-dataset
Research Ideation
This repository contains the public data payload for the Research Ideation benchmark, presented in the paper Ideation Arena: Evaluating LLM Generated Research Ideas with Battle-style Human Expert Assessment. The code is available at https://github.com/foss12138/Research-Ideation-Arena.
Files
final_ideation_results_with_response.json
Final pairwise ideation evaluation records with released responses.
queries.json
Query definitions used by the… See the full description on the dataset page: https://huggingface.co/datasets/yolo1213811/research-ideation-arena-dataset.research-ideation-arena-si-rm
Research Ideation Arena — Scientific Ideation RM Splits
Derived from Research Ideation Arena, revision f5704385bd66781d504e44810a9a8b56c1623b7a.
Original authors: Zhiyu Chen et al. See the paper and official code.
Splits and evaluation caveat
Train: 3,047 preference pairs. Test: 500 fixed preference pairs.
All remaining pairs from the 3,547-pair filtered pool are assigned to training.
Exact sample/pair overlap is zero, but 607 training rows share a connected… See the full description on the dataset page: https://huggingface.co/datasets/tintin1027/research-ideation-arena-si-rm.