CoolFace
Apppublic

xXArjunXx/MetaHackathon

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes
README.md119 linesDownload Raw Back to root
1---2title: Email Triage OpenEnv3emoji: ๐Ÿ“ง4colorFrom: blue5colorTo: indigo6sdk: docker7pinned: false8---9 10# Email Triage OpenEnv11 12A real-world environment for training and evaluating AI agents on email triage tasks. Implements the full OpenEnv specification for agent learning.13 14## Overview15 16This environment simulates the task of triaging and organizing emails into appropriate categories and actions. An AI agent must learn to:17- Classify emails by priority and type18- Identify spam and suspicious emails19- Execute appropriate actions (archive, delete, reply, forward)20- Handle complex, contextual decision-making21 22Perfect for training agents on realistic email management workflows.23 24## Environment Specification25 26### Tasks27 281. **Easy** - Basic Email Management29   - Sort 5 emails into appropriate categories30   - Actions: Read, Archive, Delete31   - Expected difficulty: Straightforward classification32 332. **Medium** - Smart Email Organization34   - Triage 8 emails with attachment handling35   - Actions: Read, Archive, Mark Important, Flag36   - Expected difficulty: Requires contextual understanding37 383. **Hard** - Expert Email Management39   - Manage 10 complex emails requiring nuanced decisions40   - Actions: All above + Reply, Forward, Report Spam41   - Expected difficulty: Requires deep contextual understanding42 43### Observation Space44 45```python46{47  "task": str,48  "step_count": int,49  "cumulative_reward": float,50  "normalized_score": float,51  "actions_taken": dict,52  "progress": str,53  "done": bool54}55```56 57### Action Space58 59Valid actions: read, archive, delete, flag, mark_spam, reply, forward60 61### Reward Function62 63- Correct action: +0.1 to +0.364- Incorrect action: -0.1 to -0.265- Episode bonus: +0.5 for 100% accuracy66 67## Setup & Usage68 69### Installation70 71```bash72pip install -r server/requirements.txt73pip install openenv-core74```75 76### Running Locally77 78```bash79cd server80python main.py81```82 83### Docker84 85```bash86docker build -t email-triage-openenv .87docker run -p 8000:8000 email-triage-openenv88```89 90## Baseline Performance91 92| Task   | Accuracy | Score |93|--------|----------|-------|94| Easy   | 100%     | 0.95  |95| Medium | 87%      | 0.78  |96| Hard   | 72%      | 0.65  |97 98## API Endpoints99 100- `POST /reset` - Start new episode101- `POST /step` - Execute action102- `GET /state` - Get current state103- `GET /grade` - Get scores104 105## OpenEnv Compliance106 107โœ… Full OpenEnv spec108โœ… Typed Pydantic models109โœ… Deterministic graders110โœ… Meaningful rewards111 112```bash113openenv validate114```115 116## License117 118MIT119