om192006/github-issue-triage

1spec_version: 12name: github_issue_triage3type: space4runtime: fastapi5app: server.app:app6port: 80007tags:8  - openenv9  - real-world10  - triage11  - github12  - nlp13description: >14  GitHub Issue Triage — an RL environment where an AI agent reads real GitHub15  issues and makes structured decisions: assigning labels, routing to the right16  engineering team, scoring priority, and suggesting a concrete fix action.17  Designed for training and evaluating LLM-based triage agents.18 19tasks:20  - id: easy21    description: >22      Read a GitHub issue and assign the correct label.23      Valid labels: bug | feature | docs | question.24      Grader: 1.0 for correct label, 0.0 for wrong.25    difficulty: easy26    max_steps: 127    reward_threshold: 1.028 29  - id: medium30    description: >31      Read a GitHub issue and assign the correct label AND team.32      Valid teams: frontend | backend | ml | devops | docs.33      Grader: label (0.5) + team (0.5).34    difficulty: medium35    max_steps: 136    reward_threshold: 0.537 38  - id: hard39    description: >40      Read a GitHub issue and assign label, team, priority, AND a suggested fix action.41      Priority options: critical | high | medium | low.42      Grader: label (0.30) + team (0.30) + priority (0.20) + fix suggestion quality (0.20).43    difficulty: hard44    max_steps: 145    reward_threshold: 0.546 47observation_space:48  type: structured49  fields:50    issue_id: string51    issue_title: string52    issue_body: string53    repo_name: string54    author: string55    existing_comments: list[string]56    task_id: string57    task_description: string58    last_reward: float59    feedback: string60    step_number: integer61 62action_space:63  type: structured64  fields:65    label: "string — one of: bug | feature | docs | question"66    team: "string | null — one of: frontend | backend | ml | devops | docs"67    priority: "string | null — one of: critical | high | medium | low"68    suggested_action: "string | null — brief concrete fix recommendation"69    reasoning: "string | null — justification for the triage decision"