datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Kuro-Siwo-Webdataset
Kuro Siwo webdatasets
Paper | GitHub |
Dataset Details
Dataset Description
Kuro Siwo is a global multi-temporal SAR dataset for rapid flood mapping. It contains 43 flood events in 6 continents and 3 climate zones, over the period 2015-2022. The annotations have been produced through meticulous photointerpretation by a team of experts, at 10m spatial resolution. For each flood event, we provide one Sentinel-1 post-flood and two Sentinel-1 pre-flood… See the full description on the dataset page: https://huggingface.co/datasets/orion-ai-lab/Kuro-Siwo-Webdataset.geobenchv1-webdataset
GeoBench V1 - pickle-free sharded edition
This is a data-only metadata conversion of the six classification datasets in isaaccorley/geobenchv1-webdataset, pinned at revision cb847e5ff87a2c8f00064d631ed7b6a39a084c68. The original benchmark is GEO-Bench.
The image arrays, sample IDs, labels, shard boundaries, and train/validation/test partitions are unchanged. Sample metadata is stored as JSON instead of pickle. No pickle deserialization is needed to read this edition.… See the full description on the dataset page: https://huggingface.co/datasets/calebrob6/geobenchv1-webdataset.mnist-webdataset-png
MNIST WebDataset PNG
The MNIST dataset with samples stored as PNG images and compiled into the WebDataset format.
DALI/JAX Example
The following code shows how this dataset can be loaded into JAX arrays by DALI.
from nvidia.dali import pipeline_def
import nvidia.dali.fn as fn
import nvidia.dali.types as types
from nvidia.dali.plugin.jax import DALIGenericIterator
from nvidia.dali.plugin.base_iterator import LastBatchPolicy
def get_data_iterator(batch_size, dataset_path):… See the full description on the dataset page: https://huggingface.co/datasets/hayden-donnelly/mnist-webdataset-png.