Birchlabs/wds-dataset-viewer-test
Read from the webdataset (after saving it somewhere on your disk) like this: from webdataset import WebDataset from typing import TypedDict, Iterable from PIL import Image from PIL.PngImagePlugin import PngImageFile from io import BytesIO from os import makedirs Example = TypedDict('Example', { '__key__': str, '__url__': str, 'img.png': bytes, }) dataset = WebDataset('./wds-dataset-viewer-test/{00000..00001}.tar') out_root = 'out' makedirs(out_root, exist_ok=True) it:… See the full description on the dataset page: https://huggingface.co/datasets/Birchlabs/wds-dataset-viewer-test.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face