anon-ops/ops-lite

1---2license: apache-2.03pretty_name: "ops-lite: Curated RCA Evaluation Set for Microservice Systems"4size_categories:5  - n<1K6task_categories:7  - graph-ml8  - tabular-classification9  - other10task_ids:11  - multi-class-classification12language:13  - en14tags:15  - root-cause-analysis16  - rca17  - microservices18  - observability19  - aiops20  - chaos-engineering21  - causal-graph22  - benchmark23annotations_creators:24  - machine-generated25language_creators:26  - machine-generated27source_datasets:28  - original29configs:30  - config_name: default31    data_files:32      - split: test33        path: "manifest.jsonl"34---35 36# ops-lite37 38A curated 500-case root-cause-analysis (RCA) evaluation set for39microservice systems, with manifest-driven causal-graph ground truth.40 41Each case bundles:42 43- a chaos-injection ground truth (`injection.json`)44- a causal service graph derived from the injection's fault contract45  (`causal_graph.json`)46- the runtime environment snapshot (`env.json`, `result.json`,47  `label.txt`)48- 12 parquet metric tables per case, split into the abnormal window49  (during fault) and the normal window (baseline)50 51The corpus spans three open-source microservice testbeds:52 53| system | n | description |54|---|---:|---|55| `ts` (Train-Ticket)        | 320 | Java/Spring Cloud microservice system, 44 application services |56| `hs` (Hotel Reservation / DeathStarBench) | 142 | Go/gRPC microservice system, 9 application services |57| `otel-demo`                |  38 | OpenTelemetry Demo e-commerce app, 15 polyglot application services |58 59## Intended use60 61Benchmarking RCA algorithms on microservice fault propagation. Each case62provides the ground-truth root-cause service(s) and a manifest-derived63causal graph against which an algorithm's predicted ranking or path can64be scored.65 66## Pipeline67 681. **Generation** — chaos faults are injected and observed by AegisLab,69   an open-source RCA benchmarking platform. A detector confirms each70   case is observable end-to-end before it enters the candidate pool.712. **Annotation** — for every observable case, a manifest-driven causal72   graph reasoner (rcabench-platform v3 `internal/reasoning`)73   enumerates the fault propagation layer-by-layer from the registered74   fault manifest, producing the `causal_graph.json` ground truth.753. **Curation** — a 1464-case raw pool is reduced to 500 via a greedy76   selector with hard filters (cyclic graphs, lp ≤ 1, frontend-only77   injections) and soft caps on system / chaos-family / root-service.78 79This repo card summarizes the released artifact itself. The full80generation and selection pipeline will be documented in the associated81paper / artifact release.82 83## Data layout84 85```86ops-lite/87├── manifest.jsonl            # 500 lines, one JSON record per case88├── README.md89├── croissant.json            # core Croissant + RAI fields90└── cases/91    └── <case-name>/92        ├── injection.json93        ├── causal_graph.json94        ├── env.json95        ├── result.json96        ├── label.txt97        └── *.parquet         # abnormal_* + normal_*98```99 100`manifest.jsonl` schema:101 102```json103{104  "name": "ts0-ts-order-service-exception-l2bqm5",105  "system": "ts|hs|otel-demo",106  "longest_path": 7,107  "n_svc": 13,108  "n_edge": 21,109  "n_alarm_svc": 2,110  "root_services": ["ts-order-service"],111  "chaos_family": "JVM*|HTTP*|Network*|Pod*|*Stress|DNS|Time|hybrid_clean|hybrid_kill",112  "primary_kind": "<chaos_type or 'hybrid'>",113  "subtypes": ["..."],114  "hybrid": false,115  "has_kill_leg": false116}117```118 119## Composition120 121| metric | value |122|---|---:|123| total cases | 500 |124| mean `longest_path` | 3.18 |125| mean `n_edge` | 4.06 |126| mean `n_svc` | 3.97 |127| chaos families | 8 |128| systems | 3 |129 130## License131 132Apache-2.0. The underlying microservice testbeds (Train-Ticket,133Hotel Reservation / DeathStarBench, OpenTelemetry Demo) retain their own134upstream licenses.135 136## Citation137 138A formal citation will be added on publication.139