datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
danbooru2024-webp-4Mpixel
🎨 Danbooru2024 Webp 4MPixel Dataset
📊 Dataset Overview
The Danbooru2024-Webp dataset is a comprehensive collection focused on animation and illustration artwork, derived from the official Danbooru platform. It contains approximately 8.05 million high-quality, user-annotated images with corresponding tags and textual descriptions.
This dataset is 4MP-focused webp resized-dataset of Danbooru2024.
✨ Features
📋 Metadata Support
Includes a Parquet… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/danbooru2024-webp-4Mpixel.danbooru2025-metadata
🎨 Danbooru 2025 Metadata
Latest Post ID: 9,158,800
(as of Apr 16, 2025)
📁 About the DatasetThis dataset provides structured metadata for user-submitted images on Danbooru, a large-scale imageboard focused on anime-style artwork.
Scraping began on January 2, 2025, and the data are stored in Parquet format for efficient programmatic access.Compared to earlier versions, this snapshot includes:
More consistent tag history tracking
Better coverage of older or previously… See the full description on the dataset page: https://huggingface.co/datasets/trojblue/danbooru2025-metadata.chexpert
CheXpert
CheXpert is a large dataset of chest X-rays and competition for automated chest x-ray interpretation, which features uncertainty labels and radiologist-labeled reference standard evaluation sets.
https://stanfordmlgroup.github.io/competitions/chexpert/
Warning on AP/PA label
I could not find in the paper a mapping from the 0/1 label to AP/PA, so I assumed 0=AP and 1=PA. Looking at a few images this seems to be correct, but I'm not a radiologist.… See the full description on the dataset page: https://huggingface.co/datasets/danjacobellis/chexpert.Danbooru-2024-Filtered-1Mdanbooru2024-latents-sdxl-1ktar
Danbooru 2024 SDXL VAE latents in 1k tar
Dedicated dataset to align deepghs/danbooru2024-webp-4Mpixel. "4MP-Focus" for average raw image resolution.
Latents are ARB with maximum size of 1024x1024 as the recommended setting in kohyas. Major reason is to make sure I can finetune with RTX 3090. VRAM usage will raise drastically after 1024.
Generated from prepare_buckets_latents_v2.py, modified from prepare_buckets_latents.py.
Used for kohya-ss/sd-scripts. In theory it may replace… See the full description on the dataset page: https://huggingface.co/datasets/6DammK9/danbooru2024-latents-sdxl-1ktar.damaged-media
Dataset Card for "ARTeFACT"
ARTeFACT: Benchmarking Segmentation Models on Diverse Analogue Media Damage
Here we provide example code for downloading the data, loading it as a PyTorch dataset, splitting by material and/or content, and visualising examples.
Housekeeping
!pip install datasets
!pip install -qqqU wandb transformers pytorch-lightning==1.9.2 albumentations torchmetrics torchinfo
!pip install -qqq requests gradio
import os
from glob import glob
import cv2… See the full description on the dataset page: https://huggingface.co/datasets/danielaivanova/damaged-media.DANI
DANI: Discrepancy Assessing for Natural and AI Images
Paper: D-Judge: How Far Are We? Evaluating the Discrepancies Between AI-synthesized Images and Natural Images through Multimodal Guidance
Code: https://github.com/RenyangLiu/DJudge
A Large-Scale Dataset for Visual Research on AI-Synthesized and Natural Images
Overview
DANI (Discrepancy Assessing for Natural and AI Images) is a large-scale, multimodal dataset for benchmarking and broad visual research on both… See the full description on the dataset page: https://huggingface.co/datasets/Renyang/DANI.danbooru2023-webp-4Mpixel
Danbooru 2023 webp: A space-efficient version of Danbooru 2023
This dataset is a resized/re-encoded version of danbooru2023.
Which removed the non-image/truncated files and resize all of them into smaller size.
This dataset already be updated to latest_id = 7,832,883.
Thx to DeepGHS!
Notice: content of updates folder and deepghs/danbooru_newest-webp-4Mpixel have been merged to 2000~2999.tar, You can ignore all the content in updates folder safely!
Details
This… See the full description on the dataset page: https://huggingface.co/datasets/KBlueLeaf/danbooru2023-webp-4Mpixel.danbooru-tags-20260518Danbooru Dataset collected with my script.
Collected post ids: 1 ~ 11403815
Usage:
from datasets import load_dataset
dataset = load_dataset("u-haru/danbooru-tags-20260518", split="train")
VinDR-CXR-VQA
VinDr-CXR-VQA Dataset
Dataset Description
VinDr-CXR-VQA is a large-scale chest X-ray Visual Question Answering (VQA) dataset designed for explainable medical AI with spatial grounding capabilities. The dataset combines natural language question-answer pairs with bounding box annotations and clinical reasoning explanations.
Key Features
🏥 4,394 chest X-ray images from VinDr-CXR
💬 17,597 question-answer pairs across 6 question types
📍 Spatial… See the full description on the dataset page: https://huggingface.co/datasets/Dangindev/VinDR-CXR-VQA.danyig-pedri-binary-script-classifier
Danyig vs Pedri Binary Script Classification Dataset
Stage-2 binary classifier for distinguishing Danyig (5 subscripts: DraDring, DraRing, Drathung, Gongshabma, Tsegdrig) from Pedri (2 subscripts: Peri, Petsuk). Real-only, all images human-reviewed.
Images per class
Class
train
val
test
All
Danyig
480
60
60
600
Pedri
480
60
60
600
Total
960
120
120
1,200
Splits
Manuscript-stratified split — each manuscript work appears in exactly… See the full description on the dataset page: https://huggingface.co/datasets/BDRC/danyig-pedri-binary-script-classifier.danbooru2023-metadata-database
Metadata Database for Danbooru2023
Danbooru 2023 datasets: https://huggingface.co/datasets/nyanko7/danbooru2023
The latest entry of this database is id 7,866,491. Which is newer than nyanko7's dataset.
This dataset contains a sqlite db file which have all the tags and posts metadata in it.
The Peewee ORM config file is provided too, plz check it for more information. (Especially on how I link posts and tags together)
The original data is from the official dump of the posts info.… See the full description on the dataset page: https://huggingface.co/datasets/KBlueLeaf/danbooru2023-metadata-database.imagenet_288_dcae_fp8
ImageNet-1k in 5GB
The full ImageNet-1k compressed to less than 5 GB
Compression procedure:
Resize shorter edge to 288 and crop longer edge to a multiple of 32
Analysis transform: DC-AE f32 c32
Quantization: 8 bit float (e4m3)
Entropy coding: TIFF (CMYK) with deflate
Example dataloader for training
import torch
import datasets
from types import SimpleNamespace
from diffusers import AutoencoderDC
from torchvision.transforms.v2 import ToPILImage, PILToTensor… See the full description on the dataset page: https://huggingface.co/datasets/danjacobellis/imagenet_288_dcae_fp8.CaptchaOCR-500K
CaptchaOCR-500K
Dataset Summary
CaptchaOCR-500K is a large-scale CAPTCHA recognition dataset containing 500,000 CAPTCHA images with corresponding text labels.
The dataset is designed for training and evaluating Optical Character Recognition (OCR), CAPTCHA solving systems, image-to-text models, and computer vision models focused on text recognition.
Tasks
Optical Character Recognition (OCR)
CAPTCHA Recognition
Image-to-Text
Computer Vision
Text… See the full description on the dataset page: https://huggingface.co/datasets/dan6864/CaptchaOCR-500K.social-media-robustness-sdxl-instantid
Social Media Robustness Benchmark: SDXL+InstantID Synthetic Face Detection
Version: v1.0.0 · License: CC BY-NC 4.0 (research evaluation only)
Detector accuracy on clean lab test sets does not predict in-the-wild performance. Social
platforms re-encode every uploaded image: platform-specific JPEG, resize, chroma subsampling,
metadata stripped. This benchmark lets detector authors and procurers measure robustness under
documented, paired, demographically-balanced conditions… See the full description on the dataset page: https://huggingface.co/datasets/danb21/social-media-robustness-sdxl-instantid.robot-vision-sample-dataset2
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-dataset-v2
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-sample-dataset-vv
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-dataset-vc
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
danbooru-convnext-embeddings2
Dataset Card for Danbooru ConvNeXt Embeddings 2
Danbooru ConvNeXt 向量数据集 2
Dataset Details / 数据集详情
Dataset Description / 数据集描述
English:
This dataset contains approximately 5,312,000 image embeddings (vectors). It was generated by extracting features from the massive Danbooru anime image dataset using the convnext_large.dinov3_lvd1689m computer vision model. These embeddings represent the visual features of the images in a high-dimensional space… See the full description on the dataset page: https://huggingface.co/datasets/telecomadm1145/danbooru-convnext-embeddings2.robot-vision-sample-dataset12
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-sample-dataset-v3
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot_vision_sample_dataset_a12
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-sample-dataset20
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-model-vs
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot_vision_dataset_vh
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-dataset-vk
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-dataset-vl
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-sample-dataset
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
robot-vision-dataset-vj
Robot Vision Sample Dataset
This dataset is created for experimental robotics vision and perception training purposes.
