AriaAICompany/or-bench-problems
ORBench problems and recorded results 100 synthetic inventory, assignment, and scheduling instances for the ORBench demo. Organization dataset and collection are public. Live Gradio and the organization card are created by scripts/publish.py. Runnable Space source is stored in demo/. Collection: Aria AI — OR + LLM Evaluation. Generated data, seed 25. All identifiers are synthetic. Gold objectives come from OR-Tools CP-SAT on the same schema that ships in each row. LLM rows in… See the full description on the dataset page: https://huggingface.co/datasets/AriaAICompany/or-bench-problems.
ORBench problems and recorded results
100 synthetic inventory, assignment, and scheduling instances for the ORBench demo.
Organization dataset and collection are public. Live Gradio and the organization card are created by scripts/publish.py. Runnable Space source is stored in demo/. Collection: Aria AI — OR + LLM Evaluation.
Generated data, seed 25. All identifiers are synthetic. Gold objectives come from OR-Tools CP-SAT on the same schema that ships in each row. LLM rows in results.jsonl are explicitly not_evaluated.
Files
- data/problems.jsonl
- data/results.jsonl
- data/leaderboard.csv
- data/splits.json
- data/sample_preview.json
- data/protocol.md
- demo/ — runnable Gradio Space source
- showcase/ — organization static card
Splits
- development: 60 instances, templates
D-A/D-B/D-Cwith aSCHEMA_BEGINblock - test: 40 instances, templates
T-A/T-Bin prose - interactive: 20 ids listed in
splits.json
Development and test do not share (family, template_id) pairs. Near-duplicate prompt templates are therefore not reused across the split.
Metrics
Independent validators recompute inventory balance, pack multiples, budget, capacity, assignment uniqueness/eligibility/capacity, and schedule overlap/precedence/release. Optimality gap is reported only when gold status is optimal. An unevaluated method is never written as 0.
License
CC-BY-4.0. Keep the synthetic-data label.