datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
danbooru
Danbooru 2024 Dataset
Danbooru 2024 数据集
A collection of images from Danbooru website, organized and packaged by ID sequence. This dataset is for research and learning purposes only.
本数据集收集了来自 Danbooru 网站的图像,按 ID 顺序组织打包。该数据集仅用于研究和学习目的。
Dataset Description
数据集描述
This dataset contains image resources from Danbooru website, updated to ID 8380648 (Update time: 2024-11-03).
本数据集包含来自 Danbooru 网站的图像资源,更新至 ID 8380648(更新时间:2024-11-03)。
Data… See the full description on the dataset page: https://huggingface.co/datasets/picollect/danbooru.danbooru2024-webp-4Mpixel
🎨 Danbooru2024 Webp 4MPixel Dataset
📊 Dataset Overview
The Danbooru2024-Webp dataset is a comprehensive collection focused on animation and illustration artwork, derived from the official Danbooru platform. It contains approximately 8.05 million high-quality, user-annotated images with corresponding tags and textual descriptions.
This dataset is 4MP-focused webp resized-dataset of Danbooru2024.
✨ Features
📋 Metadata Support
Includes a Parquet… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/danbooru2024-webp-4Mpixel.danbooru2023-webp-4Mpixel-224The data set is just resized to 224*224
https://huggingface.co/datasets/KBlueLeaf/danbooru2023-webp-4Mpixel
Pseudo code for processing
def resize_image(file_path):
with Image.open(file_path) as img:
resized_img = img.resize((224, 224))
resized_img.save(file_path)
dan-webp-newpure-danbooru
pure-danbooru Dataset
WarriorMama777/pure-danbooru
概要
このデータセットはDanbooruをメインに700万枚のイラストで構成された大規模な画像データセットです。
特徴は以下の通りです。
Danbooruのタグを純粋に維持した未検閲のトレーニング用データセット。Danbooruのユーザーたちが地道に長年作業してきたタグ付けの作業がピュアに維持されています。
丁寧な前処理、およびトレーニング用にデータを整形済み。sd-scriptsのFinetuningに準拠した形でトレーニング用Jsonが提供されており、箱から出してすぐに使えます。
データセットの詳細
画像は主にDanbooruのイラストレーションで構成されています(Danbooruの一部のタグは隠されており有料会員しか閲覧できないので、その部分をGelbooru等から補填しています)。
画像の収集… See the full description on the dataset page: https://huggingface.co/datasets/WarriorMama777/pure-danbooru.danbooru2024-latents-sdxl-1ktar
Danbooru 2024 SDXL VAE latents in 1k tar
Dedicated dataset to align deepghs/danbooru2024-webp-4Mpixel. "4MP-Focus" for average raw image resolution.
Latents are ARB with maximum size of 1024x1024 as the recommended setting in kohyas. Major reason is to make sure I can finetune with RTX 3090. VRAM usage will raise drastically after 1024.
Generated from prepare_buckets_latents_v2.py, modified from prepare_buckets_latents.py.
Used for kohya-ss/sd-scripts. In theory it may replace… See the full description on the dataset page: https://huggingface.co/datasets/6DammK9/danbooru2024-latents-sdxl-1ktar.RWF-2000Para crear un archivo README adecuado para un dataset en Hugging Face, es importante proporcionar información clara y detallada sobre el contenido del dataset, su uso y cualquier información adicional relevante. Aquí tienes un ejemplo de un README para el dataset Real World Fight (RWF) 2000:
Real World Fight (RWF) 2000
Descripción
Real World Fight (RWF) 2000 es un conjunto de datos de video diseñado para el reconocimiento de peleas en videos del mundo real. Este… See the full description on the dataset page: https://huggingface.co/datasets/DanJoshua/RWF-2000.danbooru2023-webp-4Mpixel
Danbooru 2023 webp: A space-efficient version of Danbooru 2023
This dataset is a resized/re-encoded version of danbooru2023.
Which removed the non-image/truncated files and resize all of them into smaller size.
This dataset already be updated to latest_id = 7,832,883.
Thx to DeepGHS!
Notice: content of updates folder and deepghs/danbooru_newest-webp-4Mpixel have been merged to 2000~2999.tar, You can ignore all the content in updates folder safely!
Details
This… See the full description on the dataset page: https://huggingface.co/datasets/KBlueLeaf/danbooru2023-webp-4Mpixel.dan-new-webp-trainDanbooru-images-latents-0319danbooru-convnext-embeddings3danbooru_variantMACE-Dance
🎵 MACE-Dance Dataset
MACE-Dance is a large-scale dataset for music-driven dance video generation, released with our SIGGRAPH 2026 paper:
MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generation
It is designed to support research on generating dance videos that are both:
🕺 kinematically plausible
🎨 visually coherent
🎼 well aligned with music
✨ Overview
The dataset contains approximately:
70K dance video clips
5–10 seconds per… See the full description on the dataset page: https://huggingface.co/datasets/GD-ML/MACE-Dance.JFK-AssassinationRecords-OCR-2025
Ask your favourite LLM who killed JFK
Parsing the JFK Assassination Records Release 2025 with OCR to extract text files that can be used for Retrieval Augmented Generation (RAG) in LLMs.
Download text_output.tar.gz (49 MB) from this dataset repository which are the text files extracts via OCR from the JFK pdf files.
Then download for example https://www.nomic.ai/gpt4all and use LocalDocs to import text_output into some high dimensional space and then chat with your favourite LLM… See the full description on the dataset page: https://huggingface.co/datasets/dangermouse77/JFK-AssassinationRecords-OCR-2025.danbooru2DA-Next-5MWikiArt-81K-BLIP_2-768x768
WikiArt Resized Dataset
Description
This dataset contains 81,444 artistic images from WikiArt, organized into different artistic genres. The images have been resized to a uniform resolution of 768x768 pixels using LANCZOS resampling and padded to maintain aspect ratio, ensuring consistency for machine learning tasks and computational art analysis. The base for the dataset was Dant33/WikiArt-81K-BLIP_2-captions.
Enhancements
1. Image Resizing… See the full description on the dataset page: https://huggingface.co/datasets/Dant33/WikiArt-81K-BLIP_2-768x768.animetimm-Danbooru-VLMDanbooru2024-Webp-4MPixel-NL
📊 Dataset Overview
The Danbooru2024-Webp-4MPixel-NL dataset is an extension of the deepghs/danbooru2024-webp-4Mpixel collection, specifically curated to provide natural language descriptions for approximately 7.8 million high-quality images sourced from the official Danbooru platform. Each image is paired with a detailed textual description generated using the fancyfeast/llama-joycaption-alpha-two-hf-llava model. The dataset features a filtering rule ensuring only images with an… See the full description on the dataset page: https://huggingface.co/datasets/chinoll/Danbooru2024-Webp-4MPixel-NL.Wikiart_with_StableDiffusion
Artistic Images Transformed by Stable Diffusion XL Refiner 1.0
Overview
This dataset contains 81,444 AI-generated images derived from famous paintings across 27 artistic genres. The transformation process involved resizing the original images to 768px, generating detailed descriptions using BLIP2, and creating customized prompts with LLaMA 3 8B. These prompts were then used with Stable Diffusion XL Refiner 1.0 to generate modified versions of the original artworks.
The… See the full description on the dataset page: https://huggingface.co/datasets/Dant33/Wikiart_with_StableDiffusion.VTokenizer_BenchRWF100cot-migration
Model Card for Model ID
Model Details
Model Description
Developed by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Model type: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Finetuned from model [optional]: [More Information Needed]
Model Sources [optional]
Repository: [More Information Needed]
Paper… See the full description on the dataset page: https://huggingface.co/datasets/Danqi7/cot-migration.WikiArt-81K-BLIP_2-1024x1024
WikiArt Resized Dataset
Description
This dataset contains 81,444 artistic images from WikiArt, organized into different artistic genres. The images have been resized to a uniform resolution of 1024x1024 pixels using LANCZOS resampling, ensuring consistency for machine learning tasks and computational art analysis. The base for the dataset was Dant33/WikiArt-81K-BLIP_2-captions
Enhancements
1. Image Resizing
All images have been resized to… See the full description on the dataset page: https://huggingface.co/datasets/Dant33/WikiArt-81K-BLIP_2-1024x1024.danbooru_1024WikiArt-81K-BLIP_2-captions
WikiArt Enhanced Dataset
Description
This dataset contains 81,444 artistic images from WikiArt, organized into different artistic genres. It has undergone several improvements and corrections to optimize its use in machine learning tasks and computational art analysis. Credits to the original author of daset go to: WikiArt
Enhancements
1. Encoding Issues Correction
Fixed encoding issues in filenames and artist information.
All filenames were renamed… See the full description on the dataset page: https://huggingface.co/datasets/Dant33/WikiArt-81K-BLIP_2-captions.cvat-pipeline-5-cloud_segmentation_4f3b74fcICASSP2024-Acoustic_Scattering_AI-Noninvasive_Object_Classificationsdanbooru-convnext-embeddings2
Dataset Card for Danbooru ConvNeXt Embeddings 2
Danbooru ConvNeXt 向量数据集 2
Dataset Details / 数据集详情
Dataset Description / 数据集描述
English:
This dataset contains approximately 5,312,000 image embeddings (vectors). It was generated by extracting features from the massive Danbooru anime image dataset using the convnext_large.dinov3_lvd1689m computer vision model. These embeddings represent the visual features of the images in a high-dimensional space… See the full description on the dataset page: https://huggingface.co/datasets/telecomadm1145/danbooru-convnext-embeddings2.danbooru_curated-jxl_lossless_4mpCurated and deduped version of Danbooru.Scraped the images directly from Danbooru.Curated 10M images down to 5.85M images based on personal preferences.Deduped within itself and against anime-pictures_curated-jxl_lossless_4mp, pixiv_curated-jxl_lossless_4mp and vncg_curated-jxl.Losslessly encoded into JPEG XL.Dataset size is 6.1 TiB / 6.7 TB.
Max image size for non JPG images is 2048x2048.JPG images gets resized down to 2048x2048 if they end up being more than 10MB after lossless JPG to JPEG… See the full description on the dataset page: https://huggingface.co/datasets/Disty0/danbooru_curated-jxl_lossless_4mp.
