datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
movies_CLIP_ViT-L14
🎬 Movie Frame & Caption Dataset
📖 Introduction
This dataset was created from multiple movies across 10 genres, with approximately 3 movies per genre.From each movie, frames were extracted periodically, and AI-generated captions (BLIP) were assigned to each frame.A total of 93,813 frames were extracted.
This dataset can be used for tasks such as:
Video understanding
Multimodal learning (image + text)
Image captioning
Vision-language retrieval
📂 Data… See the full description on the dataset page: https://huggingface.co/datasets/thaotien/movies_CLIP_ViT-L14.Arabic_3M_5M_ViT-B-16-plus-240
Loading the training split as follows:
from datasets import load_dataset
ds_train = load_dataset("Arabic-Clip/Arabic_3M_5M_ViT-B-16-plus-240", split="train")
ds_train
# Dataset({
# features: ['index', 'url', 'en_caption', 'embeddings_en', 'caption_ar'],
# num_rows: 200000
# })
Loading the validation split as follows:
from datasets import load_dataset
ds_validation = load_dataset("Arabic-Clip/Arabic_3M_5M_ViT-B-16-plus-240", split="validation")… See the full description on the dataset page: https://huggingface.co/datasets/Arabic-Clip/Arabic_3M_5M_ViT-B-16-plus-240.Arabic_dataset_13M_translated_cleaned_v2_jsonl_format_ViT-B-16-SigLIP-512_validationArabic_3M_5M_ViT-B-16-SigLIP-512
Loading the training split as follows:
from datasets import load_dataset
ds_train = load_dataset("Arabic-Clip/Arabic_3M_5M_ViT-B-16-SigLIP-512", split="train")
ds_train
# Dataset({
# features: ['index', 'url', 'en_caption', 'embeddings_en', 'caption_ar'],
# num_rows: 2000000
# })
Loading the validation split as follows:
from datasets import load_dataset
ds_validation = load_dataset("Arabic-Clip/Arabic_3M_5M_ViT-B-16-SigLIP-512", split="validation")… See the full description on the dataset page: https://huggingface.co/datasets/Arabic-Clip/Arabic_3M_5M_ViT-B-16-SigLIP-512.Arabic_dataset_1M_translated_jsonl_format_ViT-B-16-plus-240This translation done using https://huggingface.co/Helsinki-NLP/opus-mt-en-ar
Arabic_dataset_13M_translated_cleaned_v2_jsonl_format_ViT-B-16-plus-240This dataset repo contains the dataset (CC3M+CC12M+SBU) translated using opus-mt-en-ar and cleaned. Its size about 13M
Arabic_dataset_13M_translated_cleaned_v2_jsonl_format_ViT-B-16-plus-240-fulldata-v2DatasetDict({
train: Dataset({
features: ['index', 'embeddings', 'en_caption', 'ar_caption', 'nr_words', 'url'],
num_rows: 12166802
})
})
McAuleyLabsAmazonReviewImageEmbeddings_ViTarabic_dataset_translated_v2_ViT-B-16-SigLIP-512