laion/nemotron-terminal-software_engineering

nemotron-terminal-software_engineering

Per-source partition of nvidia/Nemotron-Terminal-Corpus, filtered to source == "software_engineering". The difficulty column preserves the original easy / medium / mixed split (na for the dataset_adapters/* files, which did not carry a difficulty label).

Partitioning scheme:

• —adapters_{code,math,swe} — rows from dataset_adapters/{code,math,swe}.parquet
• —{skill} (e.g. debugging, security, …) — rows from synthetic_tasks/skill_based/{easy,medium,mixed}/{skill}/data_filtered.parquet

Columns

Same as the source dataset (conversations, agent, model, model_provider, date, task, episode, run_id, trial_name, enable_thinking) plus:

• —source — the partition key ("software_engineering" throughout this repo)
• —difficulty — easy / medium / mixed / na
• —original_source — only present in adapters_code; preserves the original source column value (OpenCodeReasoning or synthetic) from the upstream file.

Citation

@misc{pi2026dataengineeringscalingllm,
      title={On Data Engineering for Scaling LLM Terminal Capabilities},
      author={Renjie Pi and Grace Lam and Mohammad Shoeybi and Pooya Jannaty and Bryan Catanzaro and Wei Ping},
      year={2026},
      eprint={2602.21193},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2602.21193},
}

Original dataset license: CC-BY-4.0.