Datasetpublic

thomas-yanxin/cosmos-reason1-benchmark-mirror

Cosmos-Reason1 Benchmark Mirror Prepared local mirror for the Cosmos benchmark following the EmbodiedArena layout. Source input: /home/yons/cosmos-20260413T110714Z-3-001.zip Contents: <subtask>/<subtask>_benchmark_qa_pairs.json annotation files <subtask>/clips/*.mp4 benchmark videos benchmark.jsonl combined single-file export for local em-eval runs meta.json validation summary Subtask summary: bridgev2: 100 rows, 100 unique videos, 0 duplicated video references robovqa: 110… See the full description on the dataset page: https://huggingface.co/datasets/thomas-yanxin/cosmos-reason1-benchmark-mirror.

sourceHugging Faceupdated 6mo agoView on Hugging Face

0likes135downloads

Dataset Card

Cosmos-Reason1 Benchmark Mirror

Prepared local mirror for the Cosmos benchmark following the EmbodiedArena layout.

Source input: /home/yons/cosmos-20260413T110714Z-3-001.zip

Contents:

—<subtask>/<subtask>_benchmark_qa_pairs.json annotation files
—<subtask>/clips/*.mp4 benchmark videos
—benchmark.jsonl combined single-file export for local em-eval runs
—meta.json validation summary

Subtask summary:

—bridgev2: 100 rows, 100 unique videos, 0 duplicated video references
—robovqa: 110 rows, 101 unique videos, 9 duplicated video references
—agibot: 100 rows, 100 unique videos, 0 duplicated video references
—holoassist: 100 rows, 100 unique videos, 0 duplicated video references
—robofail: 100 rows, 100 unique videos, 0 duplicated video references

Total rows: 510 Total unique videos: 501

Local em-eval usage:

json

{
  "task_configs": {
    "cosmos": {
      "data_path": "/path/to/benchmark.jsonl",
      "video_root": "/path/to/mirror/root"
    }
  }
}