cerc-aai/CHIRP
CHIRP Benchmark: An Open-Ended Free form Multimodal Benchmark CHIRP is a new multimodal evaluation benchmark with 104 open ended questions. Free form questions consists of questions where the model has to generate a response that is more open-ended, creative and does not have a "correct" answer. We include 8 distinct categories of questions. Each category requires understanding the image, and presents the opportunity for analysis and a thorough response. The categories are:… See the full description on the dataset page: https://huggingface.co/datasets/cerc-aai/CHIRP.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face