datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Chat2Workflow-Evaluation
Chat2Workflow
Chat2Workflow is a benchmark designed for evaluating the ability of Large Language Models (LLMs) to generate executable visual workflows from natural language instructions.
Paper: Chat2Workflow: A Benchmark for Generating Executable Visual Workflows with Natural Language
Repository: zjunlp/Chat2Workflow
Overview
Executable visual workflows are widely used in industrial deployments for their reliability and controllability. Chat2Workflow addresses the… See the full description on the dataset page: https://huggingface.co/datasets/zjunlp/Chat2Workflow-Evaluation.japanese-humor-evaluation-v2
Japanese Multimodal Humor Evaluation Dataset (v2)
画像/テキストのお題に対する面白い回答のデータセット。bokete(画像→テキスト)とkeitai(テキスト→テキスト)を統合。
使い方
from datasets import load_dataset
dataset = load_dataset("iammytoo/japanese-humor-evaluation-v2")
データ構造
odai_type: 'image' or 'text'
image: 画像お題(textタイプではNone)
odai: テキストお題(imageタイプではNone)
response: 回答テキスト
score: 0-4の正規化スコア
ソース
YANS-official/ogiri-bokete
YANS-official/ogiri-keitai
