datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
imagenet-1k
Dataset Card for ImageNet
Dataset Summary
ILSVRC 2012, commonly known as 'ImageNet' is an image dataset organized according to the WordNet hierarchy. Each meaningful concept in WordNet, possibly described by multiple words or word phrases, is called a "synonym set" or "synset". There are more than 100,000 synsets in WordNet, majority of them are nouns (80,000+). ImageNet aims to provide on average 1000 images to illustrate each synset. Images of each concept are… See the full description on the dataset page: https://huggingface.co/datasets/ILSVRC/imagenet-1k.imagenet1k-256-wds-latentsThe imagenet1k dataset in the webdataset format
Each image was resized so that the max side resolution is 256, making sure to preserve aspect ratio.
Each image was encoded to latents using the sixteen channel https://huggingface.co/ostris/vae-kl-f8-d16
No cropping was used to encode to latents!
The resulting dataset has images in their original aspect ratio, but much smaller, and encodeded with a vae.
tiny-imagenet
Dataset Card for tiny-imagenet
Dataset Summary
Tiny ImageNet contains 100000 images of 200 classes (500 for each class) downsized to 64×64 colored images. Each class has 500 training images, 50 validation images, and 50 test images.
Languages
The class labels in the dataset are in English.
Dataset Structure
Data Instances
{
'image': <PIL.JpegImagePlugin.JpegImageFile image mode=RGB size=64x64 at 0x1A800E8E190,
'label': 15
}… See the full description on the dataset page: https://huggingface.co/datasets/zh-plus/tiny-imagenet.wds_imagenet_sketchimagenetimagenet1k-256-wdsThis is imagenet1k in webdataset format. Images are stored as jpg files. Every image has been resized to a maximum side length of 256. That means that if an image in the original dataset was 1000 by 500, the new size will be 256 by 128. Images with a maximum side length of under 256 were not resized.
The total size of all dataset files is 57.8 GB, there are 1,281,167 rows in the training split and 50,000 rows in the validation split.
imagenet_1k_resized_256
Dataset Card for "imagenet_1k_resized_256"
Dataset summary
The same ImageNet dataset but all the smaller side resized to 256.
A lot of pretraining workflows contain resizing images to 256 and random cropping to 224x224, this is why 256 is chosen.
The resized dataset can also be downloaded much faster and consume less space than the original one.
See here for detailed readme.
Dataset Structure
Below is the example of one row of data. Note that the labels in… See the full description on the dataset page: https://huggingface.co/datasets/evanarlian/imagenet_1k_resized_256.imagenet-sketch-dataImageNetV2imagenet-r
ImageNet-R
This repo is made to facilitate the evaluation of various pretraining models. It's constructed from the source file provided by official implementation.
Usage
from datasets import load_dataset
dataset = load_dataset('axiong/imagenet-r')
Dataset Summary
ImageNet-R(endition) contains art, cartoons, deviantart, graffiti, embroidery, graphics, origami, paintings, patterns, plastic objects, plush objects, sculptures, sketches, tattoos, toys, and video… See the full description on the dataset page: https://huggingface.co/datasets/axiong/imagenet-r.imagenet_sketchImageNet-Sketch data set consists of 50000 images, 50 images for each of the 1000 ImageNet classes.
We construct the data set with Google Image queries "sketch of __", where __ is the standard class name.
We only search within the "black and white" color scheme. We initially query 100 images for every class,
and then manually clean the pulled images by deleting the irrelevant images and images that are for similar
but different classes. For some classes, there are less than 50 images after manually cleaning, and then we
augment the data set by flipping and rotating the images.Imagenet-1k-SD-1.4wds_imagenet-rImagenet21KNOTE: I have recaptioned all images here
This dataset is the entire 21K ImageNet dataset with about 13 million examples and about 19 thousand classes as strings
(for some reason it only had ~19K classes instead of 21K).
The images are in PNG format. They can be decoded like in the following example
import io
from PIL import Image
Image.open(io.BytesIO(row["image"]))
where row["image"] are the raw image bytes.
ImageNet1K-valmapping:
n01440764 tench, Tinca tinca
n01443537 goldfish, Carassius auratus
n01484850 great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias
n01491361 tiger shark, Galeocerdo cuvieri
n01494475 hammerhead, hammerhead shark
n01496331 electric ray, crampfish, numbfish, torpedo
n01498041 stingray
n01514668 cock
n01514859 hen
n01518878 ostrich, Struthio camelus
n01530575 brambling, Fringilla montifringilla
n01531178 goldfinch, Carduelis carduelis
n01532829 house finch… See the full description on the dataset page: https://huggingface.co/datasets/mrm8488/ImageNet1K-val.wds_imagenet-aimagenet-1k-256x256
Repack Information
This repository contains a complete repack of ILSVRC/imagenet-1k in Parquet format with the following data transformations:
Images were center-cropped to square to the minimum height/width dimension.
Images were then rescaled to 256x256 using Lanczos resampling.
Dataset Card for ImageNet
Dataset Summary
ILSVRC 2012, commonly known as 'ImageNet' is an image dataset organized according to the WordNet hierarchy. Each meaningful concept in… See the full description on the dataset page: https://huggingface.co/datasets/benjamin-paine/imagenet-1k-256x256.imagenet-100
Dataset Card for ImageNet-100
ImageNet-100 is a subset of the original ImageNet-1k dataset containing 100 randomly selected classes. In addition, the images have been resized to 160 pixels on the shorter side.
Homepage: https://github.com/HobbitLong/CMC
Paper: https://arxiv.org/abs/1906.05849
Dataset Structure
Data Instances
An example looks like below:
{
'image': <PIL.PngImagePlugin.PngImageFile image mode=RGB size=160x213>,
'label': 0
}… See the full description on the dataset page: https://huggingface.co/datasets/clane9/imagenet-100.mini-imagenet
Dataset Description
A mini version of ImageNet-1k with 100 of 1000 classes present.
Unlike some 'mini' variants this one includes the original images at their original sizes. Many such subsets downsample to 84x84 or other smaller resolutions.
Data Splits
Train
50000 samples from ImageNet-1k train split
Validation
10000 samples from ImageNet-1k train split
Test
5000 samples from ImageNet-1k validation split (all 50 samples per class)… See the full description on the dataset page: https://huggingface.co/datasets/timm/mini-imagenet.wds_imagenetv2CC12M_and_Imagenet21K_RecapI removed all low quality data and uploaded it here
This dataset is the entire 21K ImageNet dataset with about 13 million examples and about 19 thousand classes as strings
(for some reason it only had ~19K classes instead of 21K) as well as the entire CC12M dataset, recaptioned.
If you just want the recaptioned Imagenet dataset, I have that here
I obtained the CC12M form others. CC12M is a dataset with 12 million images created in 2021. Unfortunately the downloader provided by Google has many… See the full description on the dataset page: https://huggingface.co/datasets/gmongaras/CC12M_and_Imagenet21K_Recap.imagenet_hard_review_data_r2ImageNet2012_conditionimagenet-22k-wds
Dataset Summary
This is a copy of the full ImageNet dataset consisting of all of the original 21841 clases. It also contains labels in a separate field for the '12k' subset described at at (https://github.com/rwightman/imagenet-12k, https://huggingface.co/datasets/timm/imagenet-12k-wds)
This dataset is from the original fall11 ImageNet release which has been replaced by the winter21 release which removes close to 3000 synsets containing people, a number of these are of an offensive… See the full description on the dataset page: https://huggingface.co/datasets/timm/imagenet-22k-wds.wds_imagenetcimagenet-1k-wds
Dataset Summary
ILSVRC 2012, commonly known as 'ImageNet' is an image dataset organized according to the WordNet hierarchy. Each meaningful concept in WordNet, possibly described by multiple words or word phrases, is called a "synonym set" or "synset". There are more than 100,000 synsets in WordNet, majority of them are nouns (80,000+). ImageNet aims to provide on average 1000 images to illustrate each synset. Images of each concept are quality-controlled and human-annotated.
💡… See the full description on the dataset page: https://huggingface.co/datasets/timm/imagenet-1k-wds.imagenet-1k
Repack Information
This repository contains a complete repack of ILSVRC/imagenet-1k in Parquet format, with no arbitrary code execution. Images were not resampled.
Dataset Card for ImageNet
Dataset Summary
ILSVRC 2012, commonly known as 'ImageNet' is an image dataset organized according to the WordNet hierarchy. Each meaningful concept in WordNet, possibly described by multiple words or word phrases, is called a "synonym set" or "synset". There are more than… See the full description on the dataset page: https://huggingface.co/datasets/benjamin-paine/imagenet-1k.ImageNet1K-trainmapping:
n01440764 tench, Tinca tinca
n01443537 goldfish, Carassius auratus
n01484850 great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias
n01491361 tiger shark, Galeocerdo cuvieri
n01494475 hammerhead, hammerhead shark
n01496331 electric ray, crampfish, numbfish, torpedo
n01498041 stingray
n01514668 cock
n01514859 hen
n01518878 ostrich, Struthio camelus
n01530575 brambling, Fringilla montifringilla
n01531178 goldfinch, Carduelis carduelis
n01532829 house finch… See the full description on the dataset page: https://huggingface.co/datasets/mrm8488/ImageNet1K-train.imagenet-aThe ImageNet-A dataset contains 7,500 natural adversarial examples.
Source: https://github.com/hendrycks/natural-adv-examples.Also see the ImageNet-C and ImageNet-P datasets at https://github.com/hendrycks/robustness
@article{hendrycks2019nae, title={Natural Adversarial Examples}, author={Dan Hendrycks and Kevin Zhao and Steven Basart and Jacob Steinhardt and Dawn Song}, journal={arXiv preprint arXiv:1907.07174}, year={2019}}
There are 200 classes we consider. The WordNet ID and a… See the full description on the dataset page: https://huggingface.co/datasets/barkermrl/imagenet-a.wds_imagenet1k