datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
vsr_zeroshot
VSR: Visual Spatial Reasoning
This is the zero-shot set of VSR: Visual Spatial Reasoning (TACL 2023) [paper].
Usage
from datasets import load_dataset
data_files = {"train": "train.jsonl", "dev": "dev.jsonl", "test": "test.jsonl"}
dataset = load_dataset("cambridgeltl/vsr_zeroshot", data_files=data_files)
Note that the image files still need to be downloaded separately. See data/ for details.
Go to our github repo for more introductions.
Citation
If you find… See the full description on the dataset page: https://huggingface.co/datasets/cambridgeltl/vsr_zeroshot.PlantCAD2_zero_shot_tasks
🌱 PlantCAD2 Zero-Shot Tasks
Zero-shot evaluation tasks for plant genomics using PlantCAD2.This dataset contains tasks designed to evaluate model performance without task-specific training.
📂 Available Tasks
🔬 Cross-species Evolutionary Conservation
Task Name
Description
Samples
Metric
conservation_within_andropogoneae
Predict conserved vs non-conserved sites using alignments within 35 Andropogoneae genomes
19,030 vs 19,030
AUROC… See the full description on the dataset page: https://huggingface.co/datasets/plantcad/PlantCAD2_zero_shot_tasks.PlantCAD2_zero_shot_tasks
🌱 PlantCAD2 Zero-Shot Tasks
Zero-shot evaluation tasks for plant genomics using PlantCAD2.This dataset contains tasks designed to evaluate model performance without task-specific training.
📂 Available Tasks
🔬 Cross-species Evolutionary Conservation
Task Name
Description
Samples
Metric
conservation_within_andropogoneae
Predict conserved vs non-conserved sites using alignments within 35 Andropogoneae genomes
19,030 vs 19,030
AUROC… See the full description on the dataset page: https://huggingface.co/datasets/Yangximiao/PlantCAD2_zero_shot_tasks.synthetic_zeroshot_mixtral_v0.1ProteinGYM-DMS-zeroshotsf_fold
SF Fold
Real-world data for general robotics.
🤖 What is SF Fold?
This dataset contains real-world residential t-shirt folding demonstrations, collected by trained data collectors using hand-held grippers in diverse home environments.
📖 Table of Contents
Features
Terminology
Specifications
Dataset Composition
Environment Composition
Garment Composition
Trajectory Specifications
Hardware Specifications
Physical… See the full description on the dataset page: https://huggingface.co/datasets/zeroshotdata/sf_fold.so100_test3This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100_bimanual",
"total_episodes": 6,
"total_frames": 9213,
"total_tasks": 1,
"total_videos": 12,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:6"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ZeroShotLaz/so100_test3.so100_bimanualThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100_bimanual",
"total_episodes": 5,
"total_frames": 4025,
"total_tasks": 1,
"total_videos": 5,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ZeroShotLaz/so100_bimanual.zero_shotso100_bimanual_coffee2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100_bimanual",
"total_episodes": 6,
"total_frames": 15411,
"total_tasks": 1,
"total_videos": 6,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:6"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ZeroShotLaz/so100_bimanual_coffee2.rollout-pi05-zeroshot-stack-two-blocks-2026-02-19This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "franka",
"total_episodes": 5,
"total_frames": 2505,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 15,
"splits": {
"train": "0:5"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ankile/rollout-pi05-zeroshot-stack-two-blocks-2026-02-19.so100_bimanual_coffeeThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100_bimanual",
"total_episodes": 4,
"total_frames": 8908,
"total_tasks": 1,
"total_videos": 4,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:4"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ZeroShotLaz/so100_bimanual_coffee.eval_pi0-zeroshot-1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 1,
"total_frames": 1462,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/asdl-unist/eval_pi0-zeroshot-1.eval_pi0-zeroshot-2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 1,
"total_frames": 1433,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/asdl-unist/eval_pi0-zeroshot-2.so100_testThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 1,
"total_frames": 63,
"total_tasks":1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ZeroShotLaz/so100_test.so100_test1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 1,
"total_frames": 899,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ZeroShotLaz/so100_test1.zero-shot-classification-checkpoint-downloadsso100_test2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100",
"total_episodes": 1,
"total_frames": 730,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ZeroShotLaz/so100_test2.rollout-pi05-zeroshot-pick-cube-2026-02-19This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "franka",
"total_episodes": 17,
"total_frames": 5079,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 15,
"splits": {
"train": "0:17"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ankile/rollout-pi05-zeroshot-pick-cube-2026-02-19.rollout-pi05-zeroshot-insert-marker-2026-02-19This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "franka",
"total_episodes": 6,
"total_frames": 1806,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 15,
"splits": {
"train": "0:6"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ankile/rollout-pi05-zeroshot-insert-marker-2026-02-19.eval_pi0-zeroshot-0This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 1,
"total_frames": 1461,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/asdl-unist/eval_pi0-zeroshot-0.eval_openarm_pi05_folding_final_zeroshot_v5This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "bi_openarm_follower",
"total_episodes": 0,
"total_frames": 0,
"total_tasks": 0,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/wsqSB/eval_openarm_pi05_folding_final_zeroshot_v5.tracka_qwen_zeroshot_angerzero-shot-image-classification-checkpoint-downloadszeroshot-sft-4.0.0transformers_zero_shot_llama70b_llama8b_resultsResults for 0-shot prompting on transformers code using queries provided by HuggingFace team.
Description
The RAG responses are generated using the dataset: https://huggingface.co/datasets/Nutanix/transformers_processed_data_llama70b. Llama-3-128k-70b-Instruct-awq was used for feature extraction of transformers code(v4.42.3) to create the dataset, and Llama-3-8b-Instruct was used for generation of both RAG and Raw outputs.
Data Fields
id - The id for the… See the full description on the dataset page: https://huggingface.co/datasets/Nutanix/transformers_zero_shot_llama70b_llama8b_results.zeroshot-dpo-1.1.0ecva_zeroshot_thinking
Qwen/Qwen3-VL-2B-Thinking · happy8825/valid_ecva_clean results
Model: Qwen/Qwen3-VL-2B-Thinking
Dataset: happy8825/valid_ecva_clean
Generated: 2025-12-16 01:28:46Z
Metrics
Metric
Value
Total samples
924
With GT
0
Parsed answers
0
Top-1 accuracy
0
Recall@5
0
MRR
0
The uploaded JSON contains full per-sample predictions produced via t3_infer_with_vllm.bash.
EVQA/ECVA Metrics
Metric
Value
EVQA total
924
EVQA with GT… See the full description on the dataset page: https://huggingface.co/datasets/happy8825/ecva_zeroshot_thinking.zeroshot-validation-3.2.0zeroshot-sft-3.4.0
