xXArjunXx/MetaHackathon
0
1---2title: Email Triage OpenEnv3emoji: ๐ง4colorFrom: blue5colorTo: indigo6sdk: docker7pinned: false8---9 10# Email Triage OpenEnv11 12A real-world environment for training and evaluating AI agents on email triage tasks. Implements the full OpenEnv specification for agent learning.13 14## Overview15 16This environment simulates the task of triaging and organizing emails into appropriate categories and actions. An AI agent must learn to:17- Classify emails by priority and type18- Identify spam and suspicious emails19- Execute appropriate actions (archive, delete, reply, forward)20- Handle complex, contextual decision-making21 22Perfect for training agents on realistic email management workflows.23 24## Environment Specification25 26### Tasks27 281. **Easy** - Basic Email Management29 - Sort 5 emails into appropriate categories30 - Actions: Read, Archive, Delete31 - Expected difficulty: Straightforward classification32 332. **Medium** - Smart Email Organization34 - Triage 8 emails with attachment handling35 - Actions: Read, Archive, Mark Important, Flag36 - Expected difficulty: Requires contextual understanding37 383. **Hard** - Expert Email Management39 - Manage 10 complex emails requiring nuanced decisions40 - Actions: All above + Reply, Forward, Report Spam41 - Expected difficulty: Requires deep contextual understanding42 43### Observation Space44 45```python46{47 "task": str,48 "step_count": int,49 "cumulative_reward": float,50 "normalized_score": float,51 "actions_taken": dict,52 "progress": str,53 "done": bool54}55```56 57### Action Space58 59Valid actions: read, archive, delete, flag, mark_spam, reply, forward60 61### Reward Function62 63- Correct action: +0.1 to +0.364- Incorrect action: -0.1 to -0.265- Episode bonus: +0.5 for 100% accuracy66 67## Setup & Usage68 69### Installation70 71```bash72pip install -r server/requirements.txt73pip install openenv-core74```75 76### Running Locally77 78```bash79cd server80python main.py81```82 83### Docker84 85```bash86docker build -t email-triage-openenv .87docker run -p 8000:8000 email-triage-openenv88```89 90## Baseline Performance91 92| Task | Accuracy | Score |93|--------|----------|-------|94| Easy | 100% | 0.95 |95| Medium | 87% | 0.78 |96| Hard | 72% | 0.65 |97 98## API Endpoints99 100- `POST /reset` - Start new episode101- `POST /step` - Execute action102- `GET /state` - Get current state103- `GET /grade` - Get scores104 105## OpenEnv Compliance106 107โ
Full OpenEnv spec108โ
Typed Pydantic models109โ
Deterministic graders110โ
Meaningful rewards111 112```bash113openenv validate114```115 116## License117 118MIT119 