datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
tokenizers-benchzangei_tokenizer_1M_imgs
zangei_tokenizer_1M_imgs
Packed image dataset for Zangei tokenizer training. Each record has a stable core_id
that can be used to join this image dataset with DINOv3 feature shards and future
text/metadata datasets.
Views
original_webp: original image dimensions, encoded as WebP.
center_sq_256_webp: center-square crop, resized to 256x256, encoded as WebP.
resized_256_webp: direct resize to 256x256 without cropping, encoded as WebP.
Shard target: about 10GB per shard… See the full description on the dataset page: https://huggingface.co/datasets/kingsidharth/zangei_tokenizer_1M_imgs.tokenizer-bench-resultssphere_tokenizer_results_NSD