oceanbench
OceanBenchmark
OceanBenchmark
1. Dataset Description
OceanBenchmark is a benchmark dataset designed to evaluate the comprehensive capabilities of marine-focused large models. It encompasses a diverse range of tasks, spanning from unimodal marine science knowledge question answering to complex multimodal visual question answering.
2. Sub-datasets
Subset Directory
Task Type
Sample Size
Description
Example
VQA
816
Combined multimodal examples with Sonar… See the full description on the dataset page: https://huggingface.co/datasets/zjunlp/OceanBenchmark.hclimrep-ocean-oceanbench
HCLIMREP Ocean — OceanBench challenger forecasts
OceanBench challenger submissions produced with the
WeatherGenerator machine-learning Earth
system model, together with the executed evaluation notebooks that turn each forecast
store into an OceanBench report.
Each subdirectory is one evaluated model. Scores are tied to a specific OceanBench
version and are not comparable across versions.
Model
OceanBench
Store
Report
ft0818
0.4.0
ft0818/wg_ft0818_B1.zarr… See the full description on the dataset page: https://huggingface.co/datasets/kacpnowak/hclimrep-ocean-oceanbench.OceanBenchmark
OceanBenchmark
1. Dataset Description
OceanBenchmark is a benchmark dataset designed to evaluate the comprehensive capabilities of marine-focused large models. It encompasses a diverse range of tasks, spanning from unimodal marine science knowledge question answering to complex multimodal visual question answering.
2. Sub-datasets
Subset Directory
Task Type
Sample Size
Description
Example
VQA
816
Combined multimodal examples with Sonar… See the full description on the dataset page: https://huggingface.co/datasets/cola60/OceanBenchmark.OceanBenchWe release OceanBench, which is part of the dataset for evaluating OceanGPT.
🛠️ How to use OceanGPT
We provide the example and you can modify the input according to your needs.
from datasets import load_dataset
dataset = load_dataset("zjunlp/OceanBench")
🚩Citation
Please cite the following paper if you use OceanBench in your work.
@article{bi2023oceangpt,
title={OceanGPT: A Large Language Model for Ocean Science Tasks},
author={Bi, Zhen and Zhang, Ningyu and Xue… See the full description on the dataset page: https://huggingface.co/datasets/zjunlp/OceanBench.