aplesner-eth/FLIP-Challenge

FLIP Reasoning Challenge Dataset This repository contains the FLIP dataset, a benchmark for evaluating AI reasoning capabilities based on human verification tasks from the Idena blockchain. The dataset focuses on testing sequential reasoning, visual storytelling, and common sense understanding in multimodal AI systems. Paper: https://arxiv.org/abs/2504.12256. Dataset Description FLIP challenges present users with two orderings (stacks) of 4 images, requiring them… See the full description on the dataset page: https://huggingface.co/datasets/aplesner-eth/FLIP-Challenge.