Disty0/danbooru_curated-jxl_lossless_4mp

Curated and deduped version of Danbooru.Scraped the images directly from Danbooru.Curated 10M images down to 5.85M images based on personal preferences.Deduped within itself and against anime-pictures_curated-jxl_lossless_4mp, pixiv_curated-jxl_lossless_4mp and vncg_curated-jxl.Losslessly encoded into JPEG XL.Dataset size is 6.1 TiB / 6.7 TB. Max image size for non JPG images is 2048x2048.JPG images gets resized down to 2048x2048 if they end up being more than 10MB after lossless JPG to JPEG… See the full description on the dataset page: https://huggingface.co/datasets/Disty0/danbooru_curated-jxl_lossless_4mp.