seed-ai
Datasets
All datasets matching “seed-ai”SEED-Bench
SEED-Bench Card
Benchmark details
Benchmark type:
SEED-Bench is a large-scale benchmark to evaluate Multimodal Large Language Models (MLLMs).
It consists of 19K multiple choice questions with accurate human annotations, which
covers 12 evaluation dimensions including the comprehension of both the image and video modality.
Benchmark date:
SEED-Bench was collected in July 2023.
Paper or resources for more information:
https://github.com/AILab-CVC/SEED-Bench
License:… See the full description on the dataset page: https://huggingface.co/datasets/AILab-CVC/SEED-Bench.SEED-Data-Edit-Part2-3
SEED-Data-Edit
SEED-Data-Edit is a hybrid dataset for instruction-guided image editing with a total of 3.7 image editing pairs, which comprises three distinct types of data:
Part-1: Large-scale high-quality editing data produced by automated pipelines (3.5M editing pairs).
Part-2: Real-world scenario data collected from the internet (52K editing pairs).
Part-3: High-precision multi-turn editing data annotated by humans (95K editing pairs, 21K multi-turn rounds with a maximum of 5… See the full description on the dataset page: https://huggingface.co/datasets/AILab-CVC/SEED-Data-Edit-Part2-3.SEED-Data-Edit-Part1-Openimages
SEED-Data-Edit
SEED-Data-Edit is a hybrid dataset for instruction-guided image editing with a total of 3.7 image editing pairs, which comprises three distinct types of data:
Part-1: Large-scale high-quality editing data produced by automated pipelines (3.5M editing pairs).
Part-2: Real-world scenario data collected from the internet (52K editing pairs).
Part-3: High-precision multi-turn editing data annotated by humans (95K editing pairs, 21K multi-turn rounds with a maximum of 5… See the full description on the dataset page: https://huggingface.co/datasets/AILab-CVC/SEED-Data-Edit-Part1-Openimages.SEED-Data-Edit-Part1-Unsplash
SEED-Data-Edit
SEED-Data-Edit is a hybrid dataset for instruction-guided image editing with a total of 3.7 image editing pairs, which comprises three distinct types of data:
Part-1: Large-scale high-quality editing data produced by automated pipelines (3.5M editing pairs).
Part-2: Real-world scenario data collected from the internet (52K editing pairs).
Part-3: High-precision multi-turn editing data annotated by humans (95K editing pairs, 21K multi-turn rounds with a maximum of 5… See the full description on the dataset page: https://huggingface.co/datasets/AILab-CVC/SEED-Data-Edit-Part1-Unsplash.SEED-Bench-H
SEED-Bench-H Card
Benchmark details
Benchmark type:
SEED-Bench-H is a large-scale benchmark to evaluate Multimodal Large Language Models (MLLMs).
It consists of 28K multiple-choice questions with precise human annotations, spanning 34 dimensions, including the evaluation of both text and
image generation.
Benchmark date:
SEED-Bench-H was collected in April 2024.
Paper or resources for more information:
https://github.com/AILab-CVC/SEED-Bench
License:… See the full description on the dataset page: https://huggingface.co/datasets/AILab-CVC/SEED-Bench-H.SEED-Bench-2
SEED-Bench Card
Benchmark details
Benchmark type:
SEED-Bench-2 is a comprehensive large-scale benchmark for evaluating Multimodal Large Language Models (MLLMs), featuring 24K multiple-choice questions with precise human annotations.
It spans 27 evaluation dimensions, assessing both text and image generation.
Benchmark date:
SEED-Bench was collected in November 2023.
Paper or resources for more information:
https://github.com/AILab-CVC/SEED-Bench
License:… See the full description on the dataset page: https://huggingface.co/datasets/AILab-CVC/SEED-Bench-2.