Datasetpublic

happy8825/experiment_bitsandbytes

/hub_data4/seohyun/saves/ecva_instruct_1223/full/sft/checkpoint-350 · happy8825/valid_ecva_clean results Model: /hub_data4/seohyun/saves/ecva_instruct_1223/full/sft/checkpoint-350 Dataset: happy8825/valid_ecva_clean Generated: 2026-01-08 11:28:44Z Metrics Metric Value Total samples 924 With GT 0 Parsed answers 0 Top-1 accuracy 0 Recall@5 0 MRR 0 The uploaded JSON contains full per-sample predictions produced via t3_infer_with_vllm.bash.… See the full description on the dataset page: https://huggingface.co/datasets/happy8825/experiment_bitsandbytes.

sourceHugging Faceupdated 9mo agoView on Hugging Face

0likes6downloads

Dataset Card

/hubdata4/seohyun/saves/ecvainstruct1223/full/sft/checkpoint-350 · happy8825/validecva_clean results

—Model: /hub_data4/seohyun/saves/ecva_instruct_1223/full/sft/checkpoint-350
—Dataset: happy8825/valid_ecva_clean
—Generated: 2026-01-08 11:28:44Z

Metrics

Metric	Value
Total samples	924
With GT	0
Parsed answers	0
Top-1 accuracy	0
Recall@5	0
MRR	0

The uploaded JSON contains full per-sample predictions produced via t3_infer_with_vllm.bash.

EVQA/ECVA Metrics

Metric	Value
EVQA total	924
EVQA with GT label	924
EVQA accuracy	0.731602

Run Summary

Saved 924 results to /home/seohyun/vid_understanding/video_retrieval/video_retrieval/output_ecva/experiment_bitsandbytes.json
Metrics: {
  "total": 924,
  "with_gt": 0,
  "with_parsed_answer": 0,
  "top1_acc": 0.0,
  "recall_at_5": 0.0,
  "mrr": 0.0,
  "num_shards": 1,
  "shard_index": 0,
  "evqa_total": 924,
  "evqa_with_gt_label": 924,
  "evqa_acc": 0.7316017316017316
}
Pushed experiment_bitsandbytes.jsonl and README to https://huggingface.co/datasets/happy8825/experiment_bitsandbytes