datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
fixtures-cocococonot
🥥 CoCoNot: Contextually, Comply Not! Dataset Card
Dataset Details
Dataset Description
Chat-based language models are designed to be helpful, yet they should not comply with every user request.
While most existing work primarily focuses on refusal of "unsafe" queries, we posit that the scope of noncompliance should be broadened. We introduce a comprehensive taxonomy of contextual noncompliance describing when and how models should not comply with user… See the full description on the dataset page: https://huggingface.co/datasets/allenai/coconot.coco-karpathy
Dataset Card for "yerevann/coco-karpathy"
The Karpathy split of COCO for image captioning.
COCO-Caption
Large-scale Multi-modality Models Evaluation Suite
Accelerating the development of large-scale multi-modality models (LMMs) with lmms-eval
🏠 Homepage | 📚 Documentation | 🤗 Huggingface Datasets
This Dataset
This is a formatted version of COCO-Caption-2014-version. It is used in our lmms-eval pipeline to allow for one-click evaluations of large multi-modality models.
@misc{lin2015microsoft,
title={Microsoft COCO: Common Objects in Context}… See the full description on the dataset page: https://huggingface.co/datasets/lmms-lab-encoder/COCO-Caption.coco_captions
Dataset Card for "coco_captions"
More Information needed
COCO-Caption2017
Large-scale Multi-modality Models Evaluation Suite
Accelerating the development of large-scale multi-modality models (LMMs) with lmms-eval
🏠 Homepage | 📚 Documentation | 🤗 Huggingface Datasets
This Dataset
This is a formatted version of COCO-Caption-2017-version. It is used in our lmms-eval pipeline to allow for one-click evaluations of large multi-modality models.
@misc{lin2015microsoft,
title={Microsoft COCO: Common Objects in Context}… See the full description on the dataset page: https://huggingface.co/datasets/lmms-lab-encoder/COCO-Caption2017.laion-coco-nllb
LAION COCO translated into 200 languages
This dataset contains the samples of the LAION-COCO dataset translated to 200 languages using
the largest NLLB-200 model (3.3B parameters).
Fields description
id - unique ID of the image.
url - original URL of the image from the LAION-COCO dataset.
eng_caption - original English caption from the LAION-COCO dataset.
captions - a list of captions translated to the languages from the Flores 200 dataset. Every item in the list is a… See the full description on the dataset page: https://huggingface.co/datasets/visheratin/laion-coco-nllb.MS-COCOcoco-30-val-2014
Dataset Card for "coco-30-val-2014"
This is 30k randomly sampled image-captioned pairs from the COCO 2014 val split. This is useful for image generation benchmarks (FID, CLIPScore, etc.).
Refer to the gist to know how the dataset was created: https://gist.github.com/sayakpaul/0c4435a1df6eb6193f824f9198cabaa5.
coco2017
coco2017
Image-text pairs from MS COCO2017.
Data origin
Data originates from cocodataset.org
While coco-karpathy uses a dense format (with several sentences and sendids per row), coco-karpathy-long uses a long format with one sentence (aka caption) and sendid per row. coco-karpathy-long uses the first five sentences and therefore is five times as long as coco-karpathy.
phiyodr/coco2017: One row corresponds one image with several sentences.
phiyodr/coco2017-long: One row… See the full description on the dataset page: https://huggingface.co/datasets/phiyodr/coco2017.cc12m-wds-coco-recaptioned
CC12M WebDataset with COCO-style Recaptions
A large-scale image-text dataset containing 3 million images from Conceptual Captions 12M (CC12M) with COCO-style factual descriptions generated using NVIDIA Nemotron Nano 12B v2 VL.
Dataset Overview
Base Dataset: pixparse/cc12m-wds - Conceptual Captions 12M (CC12M)
Images: 3,000,000+ high-quality internet images
Recaption Model: NVIDIA Nemotron Nano 12B v2 VL
Recaption Style: COCO-style factual descriptions (20 words average)… See the full description on the dataset page: https://huggingface.co/datasets/undefined443/cc12m-wds-coco-recaptioned.CocoChorales-E
Viewer note: default uses viewer_preview/ for responsive audio playback.
Full training/evaluation files remain available in the original folder structure.
CocoChorales-E
CocoChorales-E subset used by the LadderSym training pipeline.
Paired Inputs for Error Detection
The model takes paired inputs:
mistake: performance audio/MIDI containing musical errors
score: paired reference score audio/MIDI (target/correct context)
Error supervision is provided with labels:… See the full description on the dataset page: https://huggingface.co/datasets/ben2002chou/CocoChorales-E.Captioned_COCOStuffcoco2017This dataset contains all COCO 2017 images and annotations split in training (118287 images) and validation (5000 images).AA_preference_cocourCOCO_2014COCO_captions_train
Dataset Card for "COCO_captions_train"
More Information needed
coco_val2014_blip2_processed
Dataset Card for "coco_val2014_blip2_processed"
More Information needed
coco-narratives
COCO Narratives
Original Source | Google Localized Narrative
📌 Introduction
This dataset collects the images and annotations from the original MS COCO 2017 and the annotations from the project localized-narratives
🙏 Acknowledgement
All credits to the original COCO project and the localized-narratives teams.
📜 Cite
Please consider to cite the following related papers:
@article{DBLP:journals/corr/LinMBHPRDZ14,
author = {Tsung{-}Yi Lin and… See the full description on the dataset page: https://huggingface.co/datasets/Fhrozen/coco-narratives.cocoterosCOCOTEROS Dataset V1.1
Dataset Summary: The COCOTEROS dataset is designed for constrained text generation tasks with the added feature of providing contextual information to assist models in generating text. The dataset is structured to allow models to generate coherent phrases based on a set of keywords and a linguistic context which serves as the co-text of the keywords provided. This makes COCOTEROS suitable for tasks where the generated text needs to be related both to a set of specific… See the full description on the dataset page: https://huggingface.co/datasets/gplsi/cocoteros.COCO_captions_validation
Dataset Card for "COCO_captions_validation"
More Information needed
coco-2014-instance
Dataset Card for "coco-2014-instance"
More Information needed
VG150-coco-format
VG150 — Visual Genome 150 (COCO format)
This dataset is the standard VG150 split of
Visual Genome
(Krishna et al., 2017), the most widely used benchmark for Scene Graph Generation,
reformatted in standard COCO-JSON format. VG150 contains the top 150 object categories
and 50 relations from the original Visual Genome dataset, selected by frequency in the
Scene Graph Generation by Iterative Message Passing paper.
This version in COCO format was produced as part of the… See the full description on the dataset page: https://huggingface.co/datasets/maelic/VG150-coco-format.COCO-Wholebody-annotatedCOCO-2017
MS COCO 2017
The complete COCO 2017 release — all four image splits and every annotation family — in Parquet.
from datasets import load_dataset
# annotations only (~6 MB) -- no image bytes
ann = load_dataset("srishti-kaushik/COCO-2017", "instances_val2017", split="train")
# images
img = load_dataset("srishti-kaushik/COCO-2017", "images_val2017", split="train")
img[0]["image"] # PIL.Image
# stream, instead of downloading 19 GB
train =… See the full description on the dataset page: https://huggingface.co/datasets/srishti-kaushik/COCO-2017.llama4-maverick-coco-captionscoco-paligemmaCoCount-train-2coco-2017-instance
Dataset Card for "coco-2017-instance"
More Information needed
coco2017_caption_normal