datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
flickr_1k_test_image_text_retrieval
Flickr30k (1K test set)
Original paper: From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions
Homepage: https://shannon.cs.illinois.edu/DenotationGraph/
1K test set split from: http://cs.stanford.edu/people/karpathy/deepimagesent/caption_datasets.zip
Bibtex:
@article{young2014image,
title={From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions}… See the full description on the dataset page: https://huggingface.co/datasets/nlphuji/flickr_1k_test_image_text_retrieval.flickr1k-sd-attn
Flickr1k VQA Dataset with Per-Word Attention Maps
This dataset is a 1K subset of the Flickr30k VQA dataset, including per-word attention maps extracted with Stable Diffusion v1.4.
📂 Structure
image: Main image associated with the question, stored in the images/ subfolder.
question: VQA question derived from Flickr30k captions.
answers: Ground-truth answers.
attention_images: A dictionary of per-word saliency images stored in the attention_images/ subfolder.
All images… See the full description on the dataset page: https://huggingface.co/datasets/lxasqjc/flickr1k-sd-attn.