CoolFace
Apppublic

vedkdev/FlakyTestSleuthOpenEnvRL

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes
openenv.yaml38 linesDownload Raw Back to root
1spec_version: 12name: flaky_sleuth3type: space4runtime: fastapi5app: server.app:app6port: 80007 8version: 0.1.09description: >10  An RL environment where an LLM agent investigates flaky tests in Python repositories.11  The agent uses tool-like actions to read files, search code, and run tests, then submits12  a terminal verdict for classification, root-cause detection, or fix proposal.13 14action_type: FlakySleuthAction15observation_type: FlakySleuthObservation16reward_range: (0.001, 0.999)17episode_max_steps: 2018baseline_script: inference.py19 20tasks:21  - id: task1_classify22    name: Flaky vs Stable Classification23    difficulty: easy24    description: Classify the target test as flaky or stable.25  - id: task2_root_cause26    name: Root Cause Category Identification27    difficulty: medium28    description: Predict flaky-test root-cause category (OD, NOD, TD, TZD, NIO, ID, etc.).29  - id: task3_fix_proposal30    name: Fix Proposal31    difficulty: hard32    description: Propose a concrete fix as unified diff for a known flaky test.33 34infra:35  vcpu: 236  memory_gb: 837  max_inference_minutes: 2038