Datasetpublic

Mohamed-Abbas/cleaned-plotqa-v2-difficulty

Cleaned-PlotQA v2 with difficulty tiers (vectorized + calibrated) This repository augments jrc/cleaned-plotqa-v2 by adding a single column difficulty_tier ∈ {easy, medium, hard} computed with a vectorized, batch‑scored rule set and cutoffs calibrated on a 1,000‑example sample to avoid tier collapse. Tier counts easy: 77403 medium: 78521 hard: 43369 total labeled: 199293 Notes Only one new column is added; original fields remain unchanged. The… See the full description on the dataset page: https://huggingface.co/datasets/Mohamed-Abbas/cleaned-plotqa-v2-difficulty.

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes64downloads

Dataset Card

dataset_name: cleaned-plotqa-v2-difficulty tags:

—plotqa
—visual-question-answering
—curriculum-learning
—difficulty-estimation
—rule-based ---

Cleaned-PlotQA v2 with difficulty tiers (vectorized + calibrated)

This repository augments jrc/cleaned-plotqa-v2 by adding a single column difficulty_tier ∈ {easy, medium, hard} computed with a vectorized, batch‑scored rule set and cutoffs calibrated on a 1,000‑example sample to avoid tier collapse.

Tier counts

—easy: 77403
—medium: 78521
—hard: 43369
—total labeled: 199293

Notes

—Only one new column is added; original fields remain unchanged.
—The scoring runs batched (8192) with multiprocessing (num_proc=4) for speed; adjust to fit memory/CPU limits.