datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
webvid-10Mfood-dataset
Food Dataset
An image classification dataset of food photos organized into 201 categories (folders), with 35,046 images total (~924 MB).
Each top-level folder is a category (e.g. adana kebab, sushi, waffles, tiramisu, ...) containing JPEG images of that food/dish. This follows the standard Hugging Face imagefolder layout, so it loads directly with:
from datasets import load_dataset
ds = load_dataset("webbrain-one/food-dataset")
Structure
<category… See the full description on the dataset page: https://huggingface.co/datasets/webbrain-one/food-dataset.danbooru2024-webp-4Mpixel
🎨 Danbooru2024 Webp 4MPixel Dataset
📊 Dataset Overview
The Danbooru2024-Webp dataset is a comprehensive collection focused on animation and illustration artwork, derived from the official Danbooru platform. It contains approximately 8.05 million high-quality, user-annotated images with corresponding tags and textual descriptions.
This dataset is 4MP-focused webp resized-dataset of Danbooru2024.
✨ Features
📋 Metadata Support
Includes a Parquet… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/danbooru2024-webp-4Mpixel.imagenet-w21-webp-wds
Dataset Summary
This is a copy of the full Winter21 release of ImageNet in webdataset tar format with WEBP encoded images. This release consists of 19167 classes, 2674 fewer classes than the original 21841 class Fall11 release of the full ImageNet.
The classes were removed due to these concerns: https://www.image-net.org/update-sep-17-2019.php
This is the same contents as https://huggingface.co/datasets/timm/imagenet-w21-wds but encoded in webp at ~56% of the size, shard count… See the full description on the dataset page: https://huggingface.co/datasets/timm/imagenet-w21-webp-wds.showui-web-processed
ShowUI-Web Processed
Flattened, normalized, and scenario-split version of showlab/ShowUI-web.
Each row is a single (instruction, UI element) pair with normalized bounding-box coordinates.
Schema
Column
Type
Description
sample_id
string
Unique row identifier ({row}_{element})
screenshot_id
string
Groups elements from the same screenshot
image_relpath
string
Relative path to the screenshot image
scenario
string
Website/domain inferred from the image path… See the full description on the dataset page: https://huggingface.co/datasets/e1879/showui-web-processed.webpii
WebPII Dataset
Split
Samples
Train
40,384
Test
4,481
Total
44,865
For more information, see webpii.github.io
danbooru2023-webp-4Mpixel
Danbooru 2023 webp: A space-efficient version of Danbooru 2023
This dataset is a resized/re-encoded version of danbooru2023.
Which removed the non-image/truncated files and resize all of them into smaller size.
This dataset already be updated to latest_id = 7,832,883.
Thx to DeepGHS!
Notice: content of updates folder and deepghs/danbooru_newest-webp-4Mpixel have been merged to 2000~2999.tar, You can ignore all the content in updates folder safely!
Details
This… See the full description on the dataset page: https://huggingface.co/datasets/KBlueLeaf/danbooru2023-webp-4Mpixel.Web_UI
Web UI Dataset
This dataset contains web pages, their screenshots across different devices, and images extracted from the web pages. Scrolling videos are stored separately in the 'video' folder. It is intended for use in machine learning tasks related to web design, computer vision, and data analysis.
Dataset Summary
Total web pages: 34
Total images: 492
Total screenshots: 102
Total videos: 34
Contents
For each web page, the dataset includes:
URL of the web… See the full description on the dataset page: https://huggingface.co/datasets/GoofyGoof/Web_UI.audioform_dataset
AAA UUUUUUUU UUUUUUUUDDDDDDDDDDDDD IIIIIIIIII OOOOOOOOO FFFFFFFFFFFFFFFFFFFFFF OOOOOOOOO RRRRRRRRRRRRRRRRR MMMMMMMM MMMMMMMM
A:::A U::::::U U::::::UD::::::::::::DDD I::::::::I OO:::::::::OO F::::::::::::::::::::F OO:::::::::OO R::::::::::::::::R M:::::::M M:::::::M
A:::::A U::::::U U::::::UD:::::::::::::::DD I::::::::I OO:::::::::::::OO… See the full description on the dataset page: https://huggingface.co/datasets/webxos/audioform_dataset.sankaku-webp-4Mpixel
Sankaku 4M Re-encoded Dataset
This is the re-encoded dataset of deepghs/sankaku_full. And all the resized images are maintained here.
There are 16492859 images in total. The maximum ID of these images is 36864051. Last updated at 2025-01-02 12:41:55 JST.
How to Painlessly Use This
Use cheesechaser to quickly get images from this repository.
Before using this code, you have to grant the access from this gated repository. And then set your personal HuggingFace token into… See the full description on the dataset page: https://huggingface.co/datasets/deepghs/sankaku-webp-4Mpixel.mnist-webdataset-png
MNIST WebDataset PNG
The MNIST dataset with samples stored as PNG images and compiled into the WebDataset format.
DALI/JAX Example
The following code shows how this dataset can be loaded into JAX arrays by DALI.
from nvidia.dali import pipeline_def
import nvidia.dali.fn as fn
import nvidia.dali.types as types
from nvidia.dali.plugin.jax import DALIGenericIterator
from nvidia.dali.plugin.base_iterator import LastBatchPolicy
def get_data_iterator(batch_size, dataset_path):… See the full description on the dataset page: https://huggingface.co/datasets/hayden-donnelly/mnist-webdataset-png.