datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
LLaVA-OneVision-Data-ru
LLaVA-OneVision-Data-ru
Translated lmms-lab/LLaVA-OneVision-Data dataset into Russian language using Google translate.
Almost all datasets have been translated, except for the following:
["tallyqa(cauldron,llava_format)", "clevr(cauldron,llava_format)", "VisualWebInstruct(filtered)", "figureqa(cauldron,llava_format)", "magpie_pro(l3_80b_mt)", "magpie_pro(qwen2_72b_st)", "rendered_text(cauldron)", "ureader_ie"]
Usage
import datasets
data =… See the full description on the dataset page: https://huggingface.co/datasets/d0rj/LLaVA-OneVision-Data-ru.LLAVA-LibMoE
Download Instructions
This repository provides the full LLAVA-LibMoE dataset, including LLaVA-665K and OneVision-1M2 image sources, organized into the following required directory tree:
libmoe/
└── data/
├── image_onevision/
├── coco/
│ └── train2017/
├── gqa/
│ └── images/
├── ocr_vqa/
│ └── images/
├── textvqa/
│ └── train_images/
└── vg/
├── VG_100K/
└──… See the full description on the dataset page: https://huggingface.co/datasets/DavidNguyen/LLAVA-LibMoE.llava-en-zh-300kThis dataset is composed by
150k examples of English Visual Instruction Data from LLaVA.
150k examples of English Visual Instruction Data from openbmb.
You can use it in LLaMA Factory by specifying --dataset llava_150k_en,llava_150k_zh.
LLaVAR
LLaVAR Data: Enhanced Visual Instruction Data with Text-Rich Images
More info at LLaVAR project page, Github repo, and paper.
Training Data
Based on the LAION dataset, we collect 422K pretraining data based on OCR results. For finetuning data, we collect 16K high-quality instruction-following data by interacting with langauge-only GPT-4. Note that we also release a larger and more diverse finetuning dataset below (20K), which contains the 16K we used for the paper. The… See the full description on the dataset page: https://huggingface.co/datasets/SALT-NLP/LLaVAR.LLaVA-OneVision-Mid-Data
Dataset Card for LLaVA-OneVision
Due to unknow reasons, we are unable to process dataset with large amount into required HF format. So we directly upload the json files and image folders (compressed into tar.gz files).
You can use the following link to directly download and decompress them.
https://huggingface.co/datasets/lmms-lab/LLaVA-OneVision-Mid-Data/tree/main/evol_instruct
We provide the whole details of LLaVA-OneVision Dataset. In this dataset, we include the data splits… See the full description on the dataset page: https://huggingface.co/datasets/lmms-lab/LLaVA-OneVision-Mid-Data.LLaVA-CoT-Instruct-58KThis dataset is borrowed from LLaVA-CoT-o1-Instruct
llava-en-zh-300kThis dataset is composed by
150k examples of English Visual Instruction Data from LLaVA.
150k examples of English Visual Instruction Data from openbmb.
You can use it in LLaMA Factory by specifying --dataset llava_150k_en,llava_150k_zh.
multimodel_llava_med_zh_instruct_60kBorrowed from https://huggingface.co/datasets/BUAADreamer/llava-med-zh-instruct-60k
Fix the <image> placeholder issue, which will cause error during training:
raise ValueError(f"The number of images does not match the number of {IMAGE_PLACEHOLDER} tokens.")
LLaVA-VSD-120K
LLaVA-VSD-120K
120K Visual Spatial Description dataset for instruction-tuning Large Language-and-Vision Assistant.
Dataset Details
Visual Spatial Description (VSD) aims to generate texts that describe the spatial relationships between objects within images.
Traditional visual spatial relationship classification (VSRC) methods typically output the spatial relationship between two objects in an image,
often neglecting world knowledge and lacking general language… See the full description on the dataset page: https://huggingface.co/datasets/swordli/LLaVA-VSD-120K.LLaVA-Instruct-21K-COCO-SubSet
subset from https://huggingface.co/datasets/liuhaotian/LLaVA-Instruct-150K
train: 21000
val seen: 3000
val unseen: 2100
test: 6000
LLaVA-Pretrain-AR
AR LLaVA Pretraining Dataset
Original LLaVA Pretraining Datasettranslated to Arabic.