CoolFace
Modelpublic

Ashith18/sentinel-disasternet-grpo

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face
0likes
Model Card

Uploaded model

🚨 SENTINEL: Teaching AI to Coordinate Earthquake Disaster Response with GRPO

πŸš€ GRPO training improved reward by +27% in 300 steps. The model discovered hospital protection (89% vs 31%) without being programmed.

🌍 The Problem

In the 2023 Turkey–Syria earthquake, over 50,000 people lost their lives.

Many deaths were preventable β€” not due to lack of resources, but due to poor coordination in the first 72 hours.


🧠 What is DisasterNET?

DisasterNET is a reinforcement learning environment simulating real-world disaster response.

  • β€”10 city zones (hospital, schools, residential areas)
  • β€”12 sequential decisions across 72 hours
  • β€”Cascade failure (hospital fails if not protected)
  • β€”Fog of war (only 40% data visible)
  • β€”Based on real earthquake data

βš™οΈ Training Setup

Model: Qwen2.5-0.5B-Instruct

  • β€”GRPO (Group Relative Policy Optimization)
  • β€”150 training episodes
  • β€”Multi-objective reward system

Efficiency:

  • β€”QLoRA 4-bit (Unsloth)
  • β€”Free T4 GPU
  • β€”Training time: 81 minutes

πŸ“Š Results

MetricBeforeAfter
Average Reward0.3730.474
Peak Rewardβ€”0.560
Human Expertβ€”0.710
Hospital Protection31%89%

πŸ‘‰ Improvement: +0.101 (+27%)


πŸ”₯ Key Discovery: Emergent Behavior

The model learned to protect the hospital:

  • β€”Before: 31%
  • β€”After: 89%
  • β€”Improvement: +58%

We NEVER programmed this rule.

The model learned it through environment feedback and consequences.


πŸ”— Try It

  • β€”πŸŒ Environment: https://huggingface.co/spaces/Ashith18/disasternet
  • β€”πŸ€– Model: https://huggingface.co/Ashith18/sentinel-disasternet-grpo
  • β€”πŸ’» GitHub: https://github.com/Ashith-13/disasternet.git

🏁 Final Takeaway

GRPO training improved performance by +27% in 300 steps.

The model independently discovered hospital protection β€” a critical real-world strategy β€” without explicit programming.


[image].png)