CoolFace
Datasetpublic

videoSALMONN2/video-SALMONN_2_testset

video-SALMONN 2 Benchmark Generate the caption corresponding to the video and the audio with video_salmonn2_test.json Organize your results in the format like the following example: [ { "id": ["0.mp4"], "pred": "Generated Caption" } ] Replace res_file in eval.py with your result file. Run python3 eval.py

sourceHugging Faceupdated 1y agoView on Hugging Face
3likes552downloads
Dataset Card

video-SALMONN 2 Benchmark

  • Generate the caption corresponding to the video and the audio with video_salmonn2_test.json
  • Organize your results in the format like the following example:
json
[
    {
        "id": ["0.mp4"], 
        "pred": "Generated Caption"
    }
]
  • Replace res_file in eval.py with your result file.
  • Run python3 eval.py