datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
DeepScaleR_Difficulty
Difficulty Estimation on DeepScaleR
We annotate the entire DeepScaleR dataset with a difficulty score based on the performance of the Qwen 2.5-MATH-7B model. This provides an adaptive signal for curriculum construction and model evaluation.
DeepScaleR is a curated dataset of 40,000 reasoning-intensive problems used to train and evaluate reinforcement learning-based methods for large language models.
Difficulty Scoring Method
Difficulty scores are estimated using the… See the full description on the dataset page: https://huggingface.co/datasets/lime-nlp/DeepScaleR_Difficulty.GSM8K_Difficulty
Difficulty Estimation on DeepScaleR
We annotate the entire GSM8K dataset with a difficulty score based on the performance of the Qwen 2.5-MATH-7B model. This provides an adaptive signal for curriculum construction and model evaluation.
GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of question answering on basic mathematical problems that require multi-step reasoning.… See the full description on the dataset page: https://huggingface.co/datasets/lime-nlp/GSM8K_Difficulty.human_anatomy_qa_with_difficulty
Truth, Trust, and Trouble (TTT) – Medical Anatomy QA Benchmark
This repository hosts the dataset introduced in the EMNLP Industry Track 2025 paper “Truth, Trust, and Trouble: Medical AI on the Edge.”
The dataset contains 1,077 high-quality, clinically validated True/False anatomy questions, designed to evaluate medical LLMs along three critical axes:
Honesty (factual alignment)
Helpfulness (semantic relevance & completeness)
Harmlessness (safety under clinical constraints)
This… See the full description on the dataset page: https://huggingface.co/datasets/ekplatebiryani/human_anatomy_qa_with_difficulty.MATH_Difficulty
Difficulty Estimation on MATH
We annotate the entire MATH dataset with a difficulty score based on the performance of the Qwen 2.5-MATH-7B model. This provides an adaptive signal for curriculum construction and model evaluation.
The Mathematics Aptitude Test of Heuristics (MATH) dataset consists of problems from mathematics competitions, including the AMC 10, AMC 12, AIME, and more. Each problem in MATH has a full step-by-step solution, which can be used to teach models to generate… See the full description on the dataset page: https://huggingface.co/datasets/lime-nlp/MATH_Difficulty.orz_math_difficulty
Difficulty Estimation on Open Reasoner Zero
We annotate the entire Open Reasoner Zero dataset with a difficulty score based on the performance of the Qwen 2.5-MATH-7B model. This provides an adaptive signal for curriculum construction.
Open Reasoner Zero is a curated a dataset of 57,000 reasoning-intensive problems used to train and evaluate reinforcement learning-based methods for large language models.
Difficulty Scoring Method
Difficulty scores are estimated using… See the full description on the dataset page: https://huggingface.co/datasets/lime-nlp/orz_math_difficulty.difficulty_and_receptive_field_advectionFinished run of te difficulty_and_receptive_field_advection_1d.ipynb example.
japanese-character-difficulty
Japanese Character Difficulty Dataset
A comprehensive dataset of 3,003 Japanese kanji characters with their educational difficulty grades, sourced from official Japanese educational standards and kanjiapi.dev.
Dataset Overview
Total Characters: 3,003 kanji
Source: Japanese Ministry of Education (MEXT) Joyo Kanji list + kanjiapi.dev
Coverage: Elementary grades 1-6, plus secondary education and advanced characters
Format: Character-grade pairs for easy lookup and analysis… See the full description on the dataset page: https://huggingface.co/datasets/ronantakizawa/japanese-character-difficulty.test-4k-difficultymaze_20x20_very_far_ood_path_difficultymaze_20x20_far_ood_path_difficultycombined_mmlu_llama8b_oracle_difficultycombined_gpqa_llama8b_oracle_difficultymaze_10x10_ood_difficultymaze_30x30_near_ood_difficultycombined_mmlu_llama70b_oracle_difficultycombined_math500_llama8b_oracle_difficultycombined_gpqa_llama70b_oracle_difficultymaze_20x20_near_ood_path_difficultymaze_20x20_ood_difficultycombined_math500_llama70b_oracle_difficulty