datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
blip3-kale
🥬 BLIP3-KALE:Knowledge Augmented Large-scale Dense Captions
BLIP3-KALE is an open-source dataset of 218 million image-text pairs, featuring knowledge-augmented dense captions combining web-scale knowledge with detailed image descriptions.
Paper: [To be added]
Uses
BLIP3-KALE is designed to facilitate research in multimodal pretraining. The dataset can be used for training large multimodal models that require factually grounded, dense image captions. It has already been an… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/blip3-kale.BLIP3o-Pretrain-Long-Caption
BLIP3o Pretrain Long-Caption Dataset
This collection contains 27 million images, each paired with a long (~120 token) caption generated by Qwen/Qwen2.5-VL-7B-Instruct.
Download
from huggingface_hub import snapshot_download
snapshot_download(
repo_id="BLIP3o/BLIP3o-Pretrain-Long-Caption",
repo_type="dataset"
)
Load Dataset without Extracting
You don’t need to unpack the .tar archives, use WebDataset support in 🤗datasets instead:
from datasets import… See the full description on the dataset page: https://huggingface.co/datasets/BLIP3o/BLIP3o-Pretrain-Long-Caption.pokemon-blip-captions
Notice of DMCA Takedown Action
We have received a DMCA takedown notice from The Pokémon Company International, Inc.
In response to this action, we have taken down the dataset.
We appreciate your understanding.
BLIP3o-Pretrain-Short-Caption
BLIP3o Pretrain Short-Caption Dataset
This collection contains 5 million images, each paired with a short (~20 token) caption generated by Qwen/Qwen2.5-VL-7B-Instruct.
Download
from huggingface_hub import snapshot_download
snapshot_download(
repo_id="BLIP3o/BLIP3o-Pretrain-Short-Caption",
repo_type="dataset"
)
Load Dataset without Extracting
You don’t need to unpack the .tar archives, use WebDataset support in 🤗datasets instead:
from datasets import… See the full description on the dataset page: https://huggingface.co/datasets/BLIP3o/BLIP3o-Pretrain-Short-Caption.prof_images_blip__22h-vintedois-diffusion-v0-1
Dataset Card for "prof_images_blip__22h-vintedois-diffusion-v0-1"
More Information needed
prof_images_blip__stabilityai-stable-diffusion-2
Dataset Card for "prof_images_blip__stabilityai-stable-diffusion-2"
More Information needed
prof_images_blip__SG161222-Realistic_Vision_V1.4
Dataset Card for "prof_images_blip__SG161222-Realistic_Vision_V1.4"
More Information needed
BLIP3o-Pretrain-JourneyDB
BLIP3o Pretrain JourneyDB Dataset
This collection contains 4 million JourneyDB images.
Download
from huggingface_hub import snapshot_download
snapshot_download(
repo_id="BLIP3o/BLIP3o-Pretrain-JourneyDB",
repo_type="dataset"
)
Load Dataset without Extracting
You don’t need to unpack the .tar archives, use WebDataset support in 🤗datasets instead:
from datasets import load_dataset
import glob
data_files = glob.glob("/your/data/path/*.tar")… See the full description on the dataset page: https://huggingface.co/datasets/BLIP3o/BLIP3o-Pretrain-JourneyDB.blip3-ocr-200m
BLIP3-OCR-200M Dataset
Overview
The BLIP3-OCR-200M dataset is designed to address the limitations of current Vision-Language Models (VLMs) in processing and interpreting text-rich images, such as documents and charts. Traditional image-text datasets often struggle to capture nuanced textual information, which is crucial for tasks requiring complex text comprehension and reasoning.
Key Features
OCR Integration: The dataset incorporates Optical Character… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/blip3-ocr-200m.BLIP3o-NEXT-EDIT-ENSEMBLE-DATASETSBLIP3o-60knaruto-blip-captions
Dataset Card for Naruto BLIP captions
Dataset used to train TBD.
The original images were obtained from narutopedia.com and captioned with the pre-trained BLIP model.
For each row the dataset contains image and text keys. image is a varying size PIL jpeg, and text is the accompanying text caption. Only a train split is provided.
Example stable diffusion outputs
"Bill Gates with a hoodie", "John Oliver with Naruto style", "Hello Kitty with Naruto style", "Lebron… See the full description on the dataset page: https://huggingface.co/datasets/lambda/naruto-blip-captions.prof_images_blip__andite-anything-v4.0
Dataset Card for "prof_images_blip__andite-anything-v4.0"
More Information needed
blip3o-256BLIP3o-60kThis is BLIP3o-60k Text-to-Image instruction tuning dataset distilled from GPT-4o, including the following categories:
JourneyDB
Human (including MSCOCO with human caption, human gestures, occupations)
Dalle3
Geneval (no overlap with test set)
Common objects
Simple text
Here we provide the code guidance to download tar file:
from huggingface_hub import snapshot_download
snapshot_download(repo_id='BLIP3o/BLIP3o-60k', repo_type=‘dataset’)
And you can use huggingface datasets to read the tar… See the full description on the dataset page: https://huggingface.co/datasets/BLIP3o/BLIP3o-60k.hagrid250k-blip2
Dataset Card for "hagrid250k-blip2"
More Information needed
blip3o-60kprof_images_blip__andite-pastel-mix
Dataset Card for "prof_images_blip__andite-pastel-mix"
More Information needed
coco_val2014_blip2_processed
Dataset Card for "coco_val2014_blip2_processed"
More Information needed
prof_images_blip__CompVis-stable-diffusion-v1-4
Dataset Card for "prof_images_blip__CompVis-stable-diffusion-v1-4"
More Information needed
pokemon-blip-captions
Dataset Card for Pokémon BLIP captions
Dataset used to train Pokémon text to image model
BLIP generated captions for Pokémon images from Few Shot Pokémon dataset introduced by Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis (FastGAN). Original images were obtained from FastGAN-pytorch and captioned with the pre-trained BLIP model.
For each row the dataset contains image and text keys. image is a varying size PIL jpeg, and text is the… See the full description on the dataset page: https://huggingface.co/datasets/reach-vb/pokemon-blip-captions.BLIP3o-JourneyDBblip3-grounding-50m
BLIP3-GROUNDING-50M Dataset
Overview
The BLIP3-GROUNDING-50M dataset is designed to enhance the ability of Vision-Language Models (VLMs) to ground semantic concepts in visual features, which is crucial for tasks like object detection, semantic segmentation, and understanding referring expressions (e.g., "the object to the left of the dog"). Traditional datasets often lack the necessary granularity for such tasks, making it challenging for models to accurately localize and… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/blip3-grounding-50m.blip_50k_train
Dataset Card for "blip_50k_train"
More Information needed
prof_images_blip__SD_v1.4_random_seeds
Dataset Card for "prof_images_blip__SD_v1.4_random_seeds"
More Information needed
pokemon-blip-captions-en-zh
Dataset Card for Pokémon BLIP captions with English and Chinese.
Dataset used to train Pokémon text to image model, add a Chinese Column of Pokémon BLIP captions
BLIP generated captions for Pokémon images from Few Shot Pokémon dataset introduced by Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis (FastGAN). Original images were obtained from FastGAN-pytorch and captioned with the pre-trained BLIP model.
For each row the dataset contains image… See the full description on the dataset page: https://huggingface.co/datasets/svjack/pokemon-blip-captions-en-zh.kream-product-blip-captions
KREAM Product Blip Captions Dataset Information
KREAM Product Blip Captions Dataset is a dataset card for finetuning a text-to-image generative model collected from KREAM, one of the best online-resell market in Korea.
This dataset consists of 'image' and 'text' key pairs.
The format of 'text' is 'category (e.g. outer), product original name (e.g. The North Face 1996 Eco Nuptse Jacket Black), blip captions (e.g. a photography of the north face black down jacket)'.
You can easily… See the full description on the dataset page: https://huggingface.co/datasets/hahminlew/kream-product-blip-captions.prof_images_blip__wavymulder-Analog-Diffusion
Dataset Card for "prof_images_blip__wavymulder-Analog-Diffusion"
More Information needed
prof_images_blip__dalle-2
Dataset Card for "prof_images_blip__dalle-2"
More Information needed
DataComp_large_pool_BLIP2_captions
Dataset Card for DataComp_large_pool_BLIP2_captions
Dataset Summary
Supported Tasks and Leaderboards
We have used this dataset for pre-training CLIP models and found that it rivals or outperforms models trained on raw web captions on average across the 38 evaluation tasks proposed by DataComp.
Refer to the DataComp leaderboard (https://www.datacomp.ai/leaderboard.html) for the top baselines uncovered in our work.
Languages
Primarily English.… See the full description on the dataset page: https://huggingface.co/datasets/thaottn/DataComp_large_pool_BLIP2_captions.