CoolFace
Apppublic

Sinegas23/Metaxscaler

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes
App README

Cloud Infrastructure Cost Optimizer OpenEnv

An AI-powered environment for autonomous cloud cost management (FinOps). Agents learn to navigate complex cloud dashboards, identify idling resources, and execute optimization strategies while maintaining strict performance SLAs.

๐ŸŒŸ Motivation & Real-World Utility (30% Evaluation)

The Problem: Enterprises waste over $10 Billion annually on over-provisioned cloud infrastructure. Traditional "static" rules fail because they cannot balance the tradeoff between cost savings and performance reliability.

The Solution: This environment fills a critical gap in the OpenEnv ecosystem by providing a high-fidelity FinOps benchmark. Agents are trained not just to "cut costs," but to act as Sovereign Cloud Engineers who must weigh the financial impact against production stability.

  • โ€”Immediate Value: Evaluating how LLMs reason about resource utilization (CPU/Memory) vs. cost centers.
  • โ€”Novelty: Unlike simple chat or moderation tasks, this requires precise mathematical reasoning about capacity planning.

๐Ÿ› ๏ธ Action Space (Discrete Multi-Field)

FieldTypeDescription
resource_idstringThe target AWS/Azure/GCP resource ID
actionstringresize, stop, terminate, tag, snapshot, ignore
target_typestringTarget SKU (e.g., t3.micro)
new_tagsdictMetadata for cost center attribution
reasoningstringHuman-readable justification for the FinOps action

๐Ÿ‘๏ธ Observation Space (Structured JSON)

The agent monitors a dashboard of live Resources:

  • โ€”resource_id: The identifier.
  • โ€”cpu_utilization: 7-day average utilization %.
  • โ€”monthly_cost: Current USD run rate.
  • โ€”is_production: Flag for critical SLA resources.

๐ŸŽฏ Task Tiers & Difficulty

TaskDifficultyMulti-StepDescription
easyEasyNoGovernance: Fix missing 'CostCenter' tags to stop "Ghost Spend."
mediumMediumNoZombie Hunt: Shutdown staging resources with <1% utilization.
hardHardYesProduction Re-architecting: Optimize an entire web cluster (multiple resources) without breaching an 80% CPU peak SLA.

๐Ÿ’ฐ Reward Design (Partial Progress & Safety)

  • โ€”Cost Savings: +Reward for every USD saved monthly.
  • โ€”Partial Progress: Immediate positive signals for each resource optimized in a cluster.
  • โ€”Safety Penalty: -1.0 penalty for "Destructive Actions" like stopping a Production node unexpectedly.
  • โ€”Efficiency Bonus: Extra points for achieving the most optimized SKU recommended by the Oracle.

๐Ÿš€ Setup & Usage

Running Locally

  1. 1.pip install -r requirements.txt
  2. 2.python main.py
  3. 3.Verify via BASELINE_MODE=mock python inference.py

Docker Deployment

bash
docker build -t cloud-optimizer .
docker run -p 7860:7860 cloud-optimizer

๐Ÿ“Š Baseline Scores (Reproduce via mock mode)

TaskSuccess RateAvg Score
Easy100%1.00
Medium100%1.00
Hard100%0.97