Samsoup/CreativeEval
CreativeEval Paper-grouped multidimensional research-ideation evaluation data from CreativeEval. Contents The release contains 1,026 complete paper rows. Each row contains a human-written research-paper introduction, the raw reviewer score arrays for provenance, and four mean prediction targets: contribution_mean, soundness_mean, presentation_mean, and overall_score_mean. All four targets are derived from the human reviewer scores released with the paper. The raw… See the full description on the dataset page: https://huggingface.co/datasets/Samsoup/CreativeEval.
CreativeEval
Paper-grouped multidimensional research-ideation evaluation data from CreativeEval.
Contents
The release contains 1,026 complete paper rows. Each row contains a human-written research-paper introduction, the raw reviewer score arrays for provenance, and four mean prediction targets: contribution_mean, soundness_mean, presentation_mean, and overall_score_mean.
All four targets are derived from the human reviewer scores released with the paper. The raw reviewer arrays are retained for auditability and should not be provided as predictor inputs.
Split organization
Each seed has paper-grouped train, validation, and test splits. One paper introduction remains in exactly one split. There is no OOD split because CreativeEval does not define a clean unseen venue or paper collection.
The paper-group counts are 718 train, 103 validation, and 205 test papers for every seed.
Provenance
Paper: https://aclanthology.org/2026.eacl-long.297/ Original code and data: https://github.com/lichun-19/creative_eval
Rebuild with:
python data/creativeeval_quality/build_huggingface_dataset.py \
--source-file /path/to/research_ideation.json