CoolFace
Datasetpublic

akh-mysterio/nemotron-math-v2-hard-tool

Nemotron-Math-v2 Hard Tool-Use Subset Filtered from nvidia/Nemotron-Math-v2 — only the hardest problems with tool-use trajectories. Filters applied Source: only high reasoning effort splits changed_answer_to_majority == False metadata.reason_high_with_tool.accuracy <= 0.375 (model gets <= 3/8 correct) tools field non-empty (Python TIR tool definition present) messages contain actual tool_calls (model used the tool) expected_answer is non-null Splits… See the full description on the dataset page: https://huggingface.co/datasets/akh-mysterio/nemotron-math-v2-hard-tool.

sourceHugging Facecc-by-4.0updated 6mo agoView on Hugging Face
0likes10downloads
Dataset Card

Nemotron-Math-v2 Hard Tool-Use Subset

Filtered from nvidia/Nemotron-Math-v2 — only the hardest problems with tool-use trajectories.

Filters applied

  1. 1.Source: only high reasoning effort splits
  2. 2.changed_answer_to_majority == False
  3. 3.metadata.reason_high_with_tool.accuracy <= 0.375 (model gets <= 3/8 correct)
  4. 4.tools field non-empty (Python TIR tool definition present)
  5. 5.messages contain actual tool_calls (model used the tool)
  6. 6.expected_answer is non-null

Splits (by pass rate)

SplitAccuracyRowsUnique Problems
0_80/8 (total failure)88
1_81/8 (near-failure)1,2051,195
2_82/8 (very hard)1,164652
3_83/8 (hard)2,206875
Total4,5832,724

Zero cross-split duplicate problems.