SHUBHAMOS/meta-pytorch-hackathon
0
1�
2 U��ipF � �6 � % S r SSKJr SSKrSSKJrJr SSKJrJrJ r J3r4J r SSK J
r
JrJrJrJrJrJrJrJrJr / SQr/ S Q/ S5Q/ S Q/ S QS
.rS\S' / SQ/ SQ/ SQ/ SQS
.rS\S' SSSSS
.rS\S' SSSS S
.r S \S ' S S S!.S"S#S$.S%.r S)S& jr " S' S(5 r g)*u 6SHUBHAMOS: AI Email Operations & Triage Environment7environment.py — EmailTriageEnv OpenEnv-compliant environment class8 9Implements:10 reset(task_config) → Observation11 step(action) → (Observation, float, bool, dict)12 state() → State13� )� annotationsN)�datetime�timezone)�Any�Dict�List�Optional�Tuple� )14�Action�15ActionType�Email�
EmailCategory� Observation�ObservationEmail�Priority� Sentiment�State�StepInfo)16zalice.johnson@acmecorp.comzbob.smith@enterprise.iozsupport@bigclient.netzbilling@financeops.comzceo@urgentco.orgzinfo@spamblaster.bizznoreply@marketing.cloudzjames.t@retailpartner.comzhelpdesk@internal.corpzcarol.w@medicalgroup.org)z You've won a $500 gift card!z URGENT: Claim your prize nowu Free iPhone — limited offeru# Make money from home — guaranteedz Your account has been selected!)z Question about your servicesz Request for product informationzPartnership inquiryz$Media inquiry regarding your companyzHow do I get started?z(Can you help me understand your pricing?)u% Invoice discrepancy — please reviewz Double charged on my accountz Refund request for order #44821u Payment failed — what do I do?z Billing error on last statementz I was overcharged this month)z,URGENT: Service outage affecting my businessu/ Complete system failure — need immediate helpz Critical bug causing data lossu- Unacceptable service — legal action pendingu& Production down — customers impacted��spam�general_inquiry�
billing_issue�urgent_complaintz Dict[EmailCategory, List[str]]�_SUBJECTS_BY_CATEGORY)z�Congratulations! You have been selected to receive a $500 gift card. Click here to claim your reward before it expires in 24 hours. No purchase necessary. Act now!z�We have a special offer just for you! Make $5000/week from the comfort of your home. No experience needed. Join thousands of successful members. Click to get started today!z�LIMITED TIME OFFER: You have been pre-approved for a FREE iPhone 15 Pro. Simply complete a short survey and the device will be shipped to your door. Claim now!z�Your email was randomly selected for our VIP program. As a VIP member you get access to exclusive deals, cash prizes, and luxury vacations. Join for free today!)a Hello, I came across your company online and I'm interested in learning more about your product offerings. Could you please send me a product catalog and pricing information? I'm particularly interested in your enterprise solutions. Thank you for your time.z�Hi there, I'm evaluating potential vendors for our upcoming project and your company came highly recommended. I'd love to schedule a 30-minute call to discuss how you might be able to help us. What's your availability this week?z�I'm a journalist writing an article about innovation in your industry. I would love to get a quote from your team about recent developments. Could you connect me with your PR contact? Deadline is Friday.z�We are a small business looking to expand our operations and are interested in your services. Before we proceed, I have a few questions about your support model and SLA commitments. Can someone from your sales team reach out?z�Hello, I recently attended your webinar on digital transformation and had a few follow-up questions. Could you share the recording and slide deck? Also, I'd love to speak with a product specialist about implementation timelines.)z�I received my invoice for last month and I believe there is an error. I was charged $1,200 but my contract clearly states the monthly fee is $950. Can you please review and send a corrected invoice as soon as possible? Invoice #INV-2024-0892.z�I was double charged on March 15th. My bank statement shows two transactions of $299 from your company. Please refund one of these charges immediately. I can provide bank statement screenshots if needed. This needs to be resolved urgently.z�I would like to request a refund for my recent purchase (Order #44821). I was charged for a premium plan but I never actually used the service. Per your refund policy, I should be eligible for a full refund within 30 days. Please process this ASAP.z�My credit card payment failed but I was still charged. I now see a pending charge of $450 on my card but I never received a confirmation. Can you check your system and either confirm the payment was received or release the hold?z�There is a discrepancy on my account statement. I was on the $99/month plan but was charged $149 this cycle. I did not authorize any plan upgrade. Please revert this change and refund the difference of $50.)us Our production environment has been down for the past 2 hours and your support team has been completely unresponsive. This is causing significant financial losses for our company — approximately $10,000 per hour. We have 500+ customers impacted and I need an immediate response. If this isn't resolved in the next hour we will be forced to seek an emergency injunction.aA I am writing to formally complain about the catastrophic failure of your service last night. Our entire database was corrupted due to what appears to be a bug in your latest update. We lost 3 days worth of data that cannot be recovered. Our legal team is reviewing our options. I expect a formal response within 24 hours.aM CRITICAL: Your system has been sending duplicate notifications to all our users for the last 4 hours. Our customers are furious and several have already cancelled their subscriptions. I have escalated this internally to our CEO. Your on-call team needs to fix this immediately. I am requesting a full incident report within 48 hours.a0 I have been waiting 3 weeks for my issue to be resolved and I am at the end of my patience. Every time I contact support I get a different answer. This is completely unacceptable for an enterprise customer paying $50,000/year. I am now involving our procurement department to review the contract renewal.�_BODIES_BY_CATEGORY�neutral�positive�negativez Dict[EmailCategory, Sentiment]�_SENTIMENT_BY_CATEGORY�low�medium�highz Dict[EmailCategory, Priority]�_PRIORITY_BY_CATEGORY�333333�?gffffff�?)r# r" 皙�����?g�������?)r! r" )r r c � � [ R " U5 n/ SQn/ SQn/ n[ SSSSSS[ R S9n[ U 5 GH3 nUR
X4SS 9S nUR [ U 5 n UR [ U 5 n17UR [ 5 n UR SS185 n UR UR U S - - UR U S - S - - S
9n
U[ ; aP [ U n[! UR# 5 5 n[! UR% 5 5 nUR
UUSS 9S nO [& U n[( U nUR+ [- SUS- S 3U U19U U
UUUS95 GM6 U$ )zGGenerate a deterministic list of realistic emails using the given seed.r )r& gffffff�?r% g333333�?i� � r � r )�tzinfo)�weights�ki` �< � )�minute�hour�email_�03d)�id�subject�body�sender� timestamp� gt_category� gt_priority� sentiment)�random�Randomr r �utc�range�choices�choicer r �_SENDERS�randint�replacer/ r0 �_PRIORITY_OVERRIDES�list�keys�valuesr$ r �appendr )�count�seed�rng�20categoriesr+ �emails�base_ts�i�categoryr4 r5 r6 �offset_minutes�ts�opts�priority_labels�priority_weightsr9 r: s �server/environment.py�_generate_emailsrW s� � �21�-�-��22 �C� 'g�J�$�G� �F��t�Q��1�a��8�<�<�@�G�
�5�\��"%�+�+�j�Q�+�"O�PQ�"R�� �*�*� 2�8� <�=���z�z�-�h�7�8�����H�%�� ���Q�23�3��
�_�_��>�>�N�R�$7�7�� � � �2�!5�� :�:� � 24�� �*� *�&�x�0�D� "�4�9�9�;� /�O� #�D�K�K�M� 2� �$'�K�K��IY�]^�K�$_�`a�$b�K�/��9�K� 5�h� ?� ��
�
�e���!��C�y�!����� �#� � 25� �5 �J �M� c �r � \ rS rSrSrSS jrSS jrSS jrSS jrSS jr SS jr26SS jr SS27 jr SS jr
S rg
)�EmailTriageEnv� a2 28SHUBHAMOS OpenEnv-compliant environment for email triage.29 30Usage:31 env = EmailTriageEnv()32 obs = env.reset(task_config)33 for _ in range(max_steps):34 action = agent.act(obs)35 obs, reward, done, info = env.step(action)36 if done:37 break38 final_state = env.state()39c � � / U l SU l SU l SU l SU l / U l SU l SU l SU l S U l g )Nr F� � )40�_emails� _step_count�41_max_steps�_done�
_total_reward�_action_history�_seed�_task_id� _initialized�_reward_engine��selfs rV �__init__�EmailTriageEnv.__init__� sO � �$&�� � !��� ��� ��42�$'���57�� ���43� ��
�"'��� #��rX c �� � [ UR SS5 5 U l [ UR SS5 5 n[ UR SS5 5 U l [ UR SS5 5 U l [ R " U R 5 [ X R 5 U l S U l44 S45U l S U l / U l
S U l U R 5 $ )
ad 46Reset the environment for a new episode.47 48Args:49 task_config: Dict with keys:50 - seed (int): random seed for reproducibility51 - email_count (int): number of emails to generate52 - max_steps (int): episode step limit53 - task_id (str, optional): "easy"/"medium"/"hard"54 55Returns:56 Observation: initial state visible to agent57rJ �* � email_countr. � max_steps�2 �task_id�easyr Fr] T)�int�getre ra �strrf r; rJ rW r_ r` rb rc rd rg �_build_observation)rj � task_configro s rV �reset�EmailTriageEnv.reset� s� � � �� � ���4�5��58��+�/�/�-��;�<� � �k�o�o�k�2� >�?����K�O�O�I�v� >�?��
� � � �D�J�J� � (� �Z�Z�@�� � �����59� ��� !�� � ����&�&�(�(rX c �F � U R ( d [ S5 eU R ( a [ S5 eU R U5 u p#SnU( aF U R U5 U R60 b& U R61 R
XR 5 nOSnU =R S-
sl U =R U-
sl U R R U R UR UR UUUS.5 [ S U R 5 5 nU R U R :� nU=( d UU l U R! 5 n[# UR UR UUUU R S9R% 5 nXtU R U4$ ) z�62Apply an action to the environment.63 64Args:65 action: Action object with action_type and email_id (+ optional payload)66 67Returns:68 (observation, reward, done, info)69zCall reset() before step()z5Episode is done. Call reset() to start a new episode.r] g{�G�z��r )�step� action_type�email_id�valid�error�rewardc 3 �@ # � U H oR 5 v � M g 7f)N)� is_processed��.0�es rV � <genexpr>�&EmailTriageEnv.step.<locals>.<genexpr> s � � �C�l��N�N� ,� ,�l�s � )r} r~ r r� � step_reward�done)rg � RuntimeErrorrb �_validate_action�_dispatch_actionrh � score_actionr_ r` rc rd rH r} r~ �allra rw r �70model_dump) rj �actionr � error_msgr� �
all_processed�step_limit_reached�obs�infos rV r| �EmailTriageEnv.step� sv � � � � � � ;�<� <� �:�:� � V�W� W� �0�0��8���� � � � !� !�&� )� �"�"�.� "� 1� 1� >� >�v�|�|� T� � $� �
���A� �� ���k�)��
� � �#�#��$�$�!�-�-� ���� �!�
%71� � �C�d�l�l�C�C�
� !� -� -�� � � @��"�8�&8��72��%�%�'��� �*�*��_�_���#����
73� �*�,�
� ����T�1�1rX c �� � [ [ U R 5 [ U R 5 U R U R74 U R U R U R U R S9$ )u� 75Return the complete internal state including ground truth labels.76Used by graders — never expose this to the agent during evaluation.77)rM �action_history�78step_countrp r� � total_rewardrJ rr )79r rE r_ rd r` ra rb rc re rf ri s rV �state�EmailTriageEnv.state. sY � �80 ��� � �%� �� 4� 4�5��'�'��o�o���� �+�+�����M�M� 81� 82rX c � � U R UR 5 nUc SSUR S34$ UR 5 ( a SSUR S34$ UR S:X a UR c gUR S:X a UR83 c gUR S :X a- UR b UR R 5 ( d g84g ) z3Validate action target and required payload fields.FzEmail 'z' not found in inboxz3' is already processed (resolved/escalated/ignored)�classify_email)Fz(classify_email requires 'category' field� set_priority)Fz#set_priority requires 'level' field� draft_reply)Fz+draft_reply requires non-empty 'text' field)TN)� _find_emailr~ r� r} rP �level�text�strip�rj r� �emails rV r� � EmailTriageEnv._validate_action@ s� � � � � �� � �1�� �=��G�F�O�O�#4�4H�I�I� I� � � � � ��G�F�O�O�#4�4g�h�h� h� � � �!1� 1�f�o�o�6M�D� � � � � /�F�L�L�4H�?� � � � � .�F�K�K�4G�v�{�{�O`�O`�Ob�Ob�G�rX c � � U R UR 5 nUc gUR S:X a UR Ul gUR S:X a UR Ul gUR S:X a SUl UR Ul gUR S:X a SUl gUR S:X a SUl85 gUR S:X a SUl gg) z(Mutate email state based on action type.Nr� r� r� T�
mark_resolved�escalate_email� ignore_email) r� r~ r} rP r� �priority�
reply_draftedr� �86reply_text�resolved� escalated�ignoredr� s rV r� � EmailTriageEnv._dispatch_actionU s� � �� � �� � �1�� �=� � � � �!1� 1� #�_�_�E�N�
�
�
�>�
1� #�\�\�E�N�
�
�
�=�
0�"&�E� � %�{�{�E� �
�
�
�?�
2� !�E�N�
�
�
�#3�
3� "�E�O�
�
�
�>�
1� �E�M� 2rX c �R � U R H nUR U:X d M Us $ g)z#Find an email by ID or return None.N)r_ r3 )rj r~ r� s rV r� �EmailTriageEnv._find_emailn s& � �� � �A��t�t�x� ��� � rX c � � / nU R H� nUR [ UR UR UR87 UR UR UR SS UR UR UR UR UR UR S9 5 M� [ S U R 5 5 n[ S U R 5 5 n[ S U R 5 5 n[! U R 5 U-88 U-89 U-90 nU R" S:� a U R$ U R" - OSn[' U[! U R 5 UUUUU R$ U R" US 9 $ )91z?Build the agent-facing Observation from current internal state.N�� ) r3 r4 r6 r7 r: � body_previewrP r� r� r� r� r� c 3 �J # � U H oR ( d M S v � M g7f�r N)r� r� s rV r� �4EmailTriageEnv._build_observation.<locals>.<genexpr>� s � � � C� �1�92�93�Q�Q� �� �#� #c 3 �J # � U H oR ( d M S v � M g7fr� )r� r� s rV r� r� � s � � � E� �A���a�a� �r� c 3 �J # � U H oR ( d M S v � M g7fr� )r� r� s rV r� r� � s � � �A�|�!�y�y�A�A�|�r� r r] ) rM � total_emails�
pending_count�resolved_count�escalated_count�
ignored_countr� rp �
elapsed_ratio)r_ rH r r3 r4 r6 r7 r: r5 rP r� r� r� r� r� �sum�lenra r` r )rj �94obs_emailsr� r� r� r� r� r� s rV rw �!EmailTriageEnv._build_observationu sC � ��95�� � �A� � � � .��4�4�� � ��x�x��+�+��+�+� �V�V�D�S�\�����������+�+�� � � �o�o�
�
� � � C�� � � C�C�� � E�� � � E�E���A�t�|�|�A�A�
��D�L�L�)�N�:�_�L�}�\�
� 37�/�/�A�2E�D� � �t��� .�3� � � � �T�\�\�*�'�)� +�'��'�'��o�o�'�9697� 98 99rX c � � Xl g)zQAttach a reward engine (called by Phase 2). engine must implement score_action().N)rh )rj �engines rV �attach_reward_engine�#EmailTriageEnv.attach_reward_engine� s � � $�rX )100rd rb r_ rg ra rh re r` rf rc N)�return�None)rx zDict[str, Any]r� r )r� r r� z/Tuple[Observation, float, bool, Dict[str, Any]])r� r )r� r r� zTuple[bool, Optional[str]])r� r r� r� )r~ rv r� zOptional[Email])r� r )r� r r� r� )�__name__�101__module__� __qualname__�__firstlineno__�__doc__rk ry r| r� r� r� r� rw r� �__static_attributes__� rX rV rZ rZ � s7 � � � #� )�@;2�z102�$�*!�2�&103�P%rX rZ )rI rt rJ rt r� z List[Email]) r� �104__future__r r; r r �typingr r r r r105 �modelsr r
r r r r r r r r rA r �__annotations__r r r$ rD rW rZ r� rX rV �<module>r� s� ��� #�
� '� 3� 3� � � � ��
����1 9� �5� �D
� ���+7� �3� �<
�!� �"� :� �6� �
� � � � 8� �4� � "�S�1� "�c�2�� � 0�fm%� m%rX