Datasetpublic

gaunernst/glint360k-wds-gz

Glint360K This dataset is introduced in the Partial FC paper https://arxiv.org/abs/2010.05222. There are 17,091,657 images and 360,232 ids. All images are aligned based on facial landmarks predicted by RetinaFace and resized to 112x112. This was downloaded from https://github.com/deepinsight/insightface/tree/master/recognition/_datasets_. The original dataset format is MXNet RecordIO. It was converted to WebDataset in this copy here. There are 1,385 shards in total.… See the full description on the dataset page: https://huggingface.co/datasets/gaunernst/glint360k-wds-gz.

sourceHugging Faceupdated 2y agoView on Hugging Face

5likes5.6kdownloads

Dataset Card

Glint360K

This dataset is introduced in the Partial FC paper https://arxiv.org/abs/2010.05222.

There are 17,091,657 images and 360,232 ids. All images are aligned based on facial landmarks predicted by RetinaFace and resized to 112x112.

This was downloaded from https://github.com/deepinsight/insightface/tree/master/recognition/_datasets_. The original dataset format is MXNet RecordIO. It was converted to WebDataset in this copy here. There are 1,385 shards in total.

Usage

python

import webdataset as wds

url = "https://huggingface.co/datasets/gaunernst/glint360k-wds-gz/resolve/main/glint360k-{0000..1384}.tar.gz"
ds = wds.WebDataset(url).decode("pil").to_tuple("jpg", "cls")

img, label = next(iter(ds))