CoolFace
Datasetpublic

Prasham1710/ci-triage-scenarios

CI-Triage Scenarios A corpus of CI-failure scenarios for the CI-Triage-Env OpenEnv RL environment. Generated from public OSS CI logs (anonymized) and open-license datasets (DeFlaker, iDFlakies, FlakeFlagger, LogHub). Splits Split Count Notes train 419 Unambiguous families only val 89 Unambiguous families only held_out 241 Includes ALL ambiguous instances (calibration probe) Schema Each row contains: scenario_id (string): unique… See the full description on the dataset page: https://huggingface.co/datasets/Prasham1710/ci-triage-scenarios.

sourceHugging Facecc-by-4.0updated 5mo agoView on Hugging Face
0likes25downloads
Dataset Card

CI-Triage Scenarios

A corpus of CI-failure scenarios for the CI-Triage-Env OpenEnv RL environment. Generated from public OSS CI logs (anonymized) and open-license datasets (DeFlaker, iDFlakies, FlakeFlagger, LogHub).

Splits

SplitCountNotes
train419Unambiguous families only
val89Unambiguous families only
held_out241Includes ALL ambiguous instances (calibration probe)

Schema

Each row contains:

  • —scenario_id (string): unique identifier (<family>-s<seed>-<hash>)
  • —family (string): one of real_bug, race_flake, timing_flake, infra_network, infra_resource, dependency_drift, ambiguous
  • —scenario_json (string): full Scenario JSON, validates against ci_triage_env.schemas.scenario.Scenario
  • —difficulty (string): easy / medium / hard

Failure Families

FamilyDescription
real_bugA genuine code defect introduced by a recent commit
race_flakeNon-deterministic failure from a data race / goroutine conflict
timing_flakeIntermittent timeout under CI scheduler load
infra_networkDNS / TLS / connectivity failure on the CI node
infra_resourceOOM-kill, disk full, or file-descriptor exhaustion
dependency_driftBreaking change from a dependency version bump
ambiguousMultiple plausible causes — correct response is low confidence

License

CC-BY-4.0. Generated from public OSS CI logs (anonymized) and open-license datasets (DeFlaker, iDFlakies, FlakeFlagger, LogHub).

Citation

If you use this corpus, please cite the originating datasets and the Meta PyTorch OpenEnv hackathon submission (CI-Triage-Env).