CoolFace
Datasetpublic

AgPerry/Video-R1-soft-filter-v2

Video-R1-soft-filter-v2 147,850 samples from Video-R1-260k filtered using the complete Kelsey soft filter. Filter Logic Remove a sample only if 2+ models can answer it text-only under circular evaluation. Model Method MCQ Coverage Non-MCQ GPT-5-mini Single-pass text-only 263K (full) ✅ Qwen2.5-VL-7B 4-perm circular eval 149,586 MCQ pass@10 Gemini 3.1 Pro 3-perm circular eval 149,583 MCQ direct eval (111K) Comparison Version… See the full description on the dataset page: https://huggingface.co/datasets/AgPerry/Video-R1-soft-filter-v2.

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
0likes20downloads
Dataset Card

Video-R1-soft-filter-v2

147,850 samples from Video-R1-260k filtered using the complete Kelsey soft filter.

Filter Logic

Remove a sample only if 2+ models can answer it text-only under circular evaluation.

ModelMethodMCQ CoverageNon-MCQ
GPT-5-miniSingle-pass text-only263K (full)✅
Qwen2.5-VL-7B4-perm circular eval149,586 MCQpass@10
Gemini 3.1 Pro3-perm circular eval149,583 MCQdirect eval (111K)

Comparison

VersionQwenGeminiKept
soft-filter (v1)2-permPro 3-perm160,837
soft-filter-v24-permPro 3-perm147,850

Combination Breakdown

GPTQwenGeminiCountAction
NNN96,551kept
NYN33,330kept
NNY9,500kept
YNN8,469kept
YYY56,840removed
NYY42,329removed
YYN13,070removed
YNY2,982removed

Stats

  • —Total: 147,850 (56.2% of 260k)
  • —Video: computed from source data
  • —Source: Video-R1-260k (263,071 samples)