Datasetpublic

happy8825/fp8_quantized

/hub_data4/seohyun/saves/ecva_instruct_1223/full/sft/checkpoint-350-fp8 · happy8825/valid_ecva_clean results Model: /hub_data4/seohyun/saves/ecva_instruct_1223/full/sft/checkpoint-350-fp8 Dataset: happy8825/valid_ecva_clean Generated: 2025-12-24 05:49:28Z Metrics Metric Value Total samples 924 With GT 0 Parsed answers 0 Top-1 accuracy 0 Recall@5 0 MRR 0 The uploaded JSON contains full per-sample predictions produced via… See the full description on the dataset page: https://huggingface.co/datasets/happy8825/fp8_quantized.

sourceHugging Faceupdated 9mo agoView on Hugging Face

0likes6downloads

Dataset Card

/hubdata4/seohyun/saves/ecvainstruct1223/full/sft/checkpoint-350-fp8 · happy8825/validecva_clean results

—Model: /hub_data4/seohyun/saves/ecva_instruct_1223/full/sft/checkpoint-350-fp8
—Dataset: happy8825/valid_ecva_clean
—Generated: 2025-12-24 05:49:28Z

Metrics

Metric	Value
Total samples	924
With GT	0
Parsed answers	0
Top-1 accuracy	0
Recall@5	0
MRR	0

The uploaded JSON contains full per-sample predictions produced via t3_infer_with_vllm.bash.

EVQA/ECVA Metrics

Metric	Value
EVQA total	924
EVQA with GT label	924
EVQA accuracy	0.751082

Run Summary

Saved 924 results to /home/seohyun/vid_understanding/video_retrieval/video_retrieval/output_ecva/fp8_quantized.json
Metrics: {
  "total": 924,
  "with_gt": 0,
  "with_parsed_answer": 0,
  "top1_acc": 0.0,
  "recall_at_5": 0.0,
  "mrr": 0.0,
  "num_shards": 1,
  "shard_index": 0,
  "evqa_total": 924,
  "evqa_with_gt_label": 924,
  "evqa_acc": 0.7510822510822511
}
Pushed fp8_quantized.jsonl and README to https://huggingface.co/datasets/happy8825/fp8_quantized