datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MMMU_with_difficulty_level
MMMU with difficulty level tags
This dataset extends the 🤗 MMMU val benchmark by introducing two additional tags: passrate_for_qwen2.5_vl_7b and difficulty_level_for_qwen2.5_vl_7b. Further details are available in our paper The Synergy Dilemma of Long-CoT SFT and RL: Investigating Post-Training Techniques for Reasoning VLMs.
🚀 Data Usage
from datasets import load_dataset
dataset = load_dataset("JierunChen/MMMU_with_difficulty_level")
print(dataset)
📑… See the full description on the dataset page: https://huggingface.co/datasets/JierunChen/MMMU_with_difficulty_level.MathVision_with_difficulty_level
MathVision with difficulty level tags
This dataset extends the 🤗 MathVision benchmark by introducing two additional tags: passrate_for_qwen2.5_vl_7b and difficulty_level_for_qwen2.5_vl_7b. Further details are available in our paper The Synergy Dilemma of Long-CoT SFT and RL: Investigating Post-Training Techniques for Reasoning VLMs.
🚀 Data Usage
from datasets import load_dataset
dataset = load_dataset("JierunChen/MathVision_with_difficulty_level")
print(dataset)… See the full description on the dataset page: https://huggingface.co/datasets/JierunChen/MathVision_with_difficulty_level.MathVista_with_difficulty_level
MathVista with difficulty level tags
This dataset extends the 🤗 MathVista testmini benchmark by introducing two additional tags: passrate_for_qwen2.5_vl_7b and difficulty_level_for_qwen2.5_vl_7b. Further details are available in our paper The Synergy Dilemma of Long-CoT SFT and RL: Investigating Post-Training Techniques for Reasoning VLMs.
🚀 Data Usage
from datasets import load_dataset
dataset = load_dataset("JierunChen/MathVista_with_difficulty_level")… See the full description on the dataset page: https://huggingface.co/datasets/JierunChen/MathVista_with_difficulty_level.MathVerse_with_difficulty_level
MathVerse with difficulty level tags
This dataset extends the 🤗 MathVerse testmini benchmark by introducing two additional tags: passrate_for_qwen2.5_vl_7b and difficulty_level_for_qwen2.5_vl_7b. Further details are available in our paper The Synergy Dilemma of Long-CoT SFT and RL: Investigating Post-Training Techniques for Reasoning VLMs.
🚀 Data Usage
from datasets import load_dataset
dataset = load_dataset("JierunChen/MathVerse_with_difficulty_level")… See the full description on the dataset page: https://huggingface.co/datasets/JierunChen/MathVerse_with_difficulty_level.MMStar_with_difficulty_level
MMStar with difficulty level tags
This dataset extends the 🤗 MMStar benchmark by introducing two additional tags: passrate_for_qwen2.5_vl_7b and difficulty_level_for_qwen2.5_vl_7b. Further details are available in our paper The Synergy Dilemma of Long-CoT SFT and RL: Investigating Post-Training Techniques for Reasoning VLMs.
🚀 Data Usage
from datasets import load_dataset
dataset = load_dataset("JierunChen/MMStar_with_difficulty_level")
print(dataset)… See the full description on the dataset page: https://huggingface.co/datasets/JierunChen/MMStar_with_difficulty_level.