Datasetpublic

happy8825/ecva_instruct_ver2

/hub_data4/seohyun/saves/ecva_instruct/full/sft/checkpoint-175 · happy8825/valid_ecva_clean results Model: /hub_data4/seohyun/saves/ecva_instruct/full/sft/checkpoint-175 Dataset: happy8825/valid_ecva_clean Generated: 2025-12-18 10:50:16Z Metrics Metric Value Total samples 924 With GT 0 Parsed answers 0 Top-1 accuracy 0 Recall@5 0 MRR 0 The uploaded JSON contains full per-sample predictions produced via t3_infer_with_vllm.bash.… See the full description on the dataset page: https://huggingface.co/datasets/happy8825/ecva_instruct_ver2.

sourceHugging Faceupdated 9mo agoView on Hugging Face

0likes11downloads

Dataset Card

/hubdata4/seohyun/saves/ecvainstruct/full/sft/checkpoint-175 · happy8825/validecvaclean results

—Model: /hub_data4/seohyun/saves/ecva_instruct/full/sft/checkpoint-175
—Dataset: happy8825/valid_ecva_clean
—Generated: 2025-12-18 10:50:16Z

Metrics

Metric	Value
Total samples	924
With GT	0
Parsed answers	0
Top-1 accuracy	0
Recall@5	0
MRR	0

The uploaded JSON contains full per-sample predictions produced via t3_infer_with_vllm.bash.

EVQA/ECVA Metrics

Metric	Value
EVQA total	924
EVQA with GT label	924
EVQA accuracy	0.569264

Run Summary

Saved 924 results to /home/seohyun/vid_understanding/video_retrieval/video_retrieval/output_ecva_instruct/ecva_instruct_ver2.json
Metrics: {
  "total": 924,
  "with_gt": 0,
  "with_parsed_answer": 0,
  "top1_acc": 0.0,
  "recall_at_5": 0.0,
  "mrr": 0.0,
  "num_shards": 1,
  "shard_index": 0,
  "evqa_total": 924,
  "evqa_with_gt_label": 924,
  "evqa_acc": 0.5692640692640693
}
Pushed ecva_instruct_ver2.jsonl and README to https://huggingface.co/datasets/happy8825/ecva_instruct_ver2