Datasetpublic

pranitchawla/crisismmd-mteb

CrisisMMD for MTEB This repository contains two image+text classification configurations derived from the official QCRI/CrisisMMD release at revision 10a5626ba112ab9c50369c473a2062bcf205d708. informative: useful vs. not useful for humanitarian response. humanitarian: five humanitarian information categories. For informative and humanitarian, only rows in the authors' official text_img_agreed_lab splits are retained. Their independently annotated image and tweet labels are… See the full description on the dataset page: https://huggingface.co/datasets/pranitchawla/crisismmd-mteb.

sourceHugging Facecc-by-nc-sa-4.0updated 24d agoView on Hugging Face

0likes123downloads

Dataset Card

CrisisMMD for MTEB

This repository contains two image+text classification configurations derived from the official `QCRI/CrisisMMD` release at revision 10a5626ba112ab9c50369c473a2062bcf205d708.

—informative: useful vs. not useful for humanitarian response.
—humanitarian: five humanitarian information categories.

For informative and humanitarian, only rows in the authors' official text_img_agreed_lab splits are retained. Their independently annotated image and tweet labels are therefore identical, source split membership is preserved, and dev is renamed to validation.

The builder verifies that image and tweet IDs do not cross splits and fully decodes every included image.

The original dataset paper reports generally strong inter-annotator agreement across its annotation tasks. The two agreed-label configurations add a separate, stricter requirement: the independently assigned image and text targets must also match.

License FYI

The official QCRI Hugging Face release declares CC BY-NC-SA 4.0. The legacy CrisisNLP download page also links separate research-data terms.

Built from the pinned official QCRI source snapshot and agreed-label archive (SHA-256 32f2203bbf0545057be2c6d5c95636cfb5032aef58d0f57e04c5dfac246843ff).