wakeupmh/alem-do-espectro
0
1�
2 t�g� � �t � d dl Z d dlmZmZ d dlZd dlmZ d dlm Z d dl3m Z d dl m
Z
dZ G d� d � � ZdS )4� N)�
AutoTokenizer�AutoModelForCausalLM)�Agent)�Ollama)�5ArxivTools)� PubmedToolszmeta-llama/Llama-3.2-1Bc � � e Zd Zd� Zd� Zeej ej d� � � � � � � Z de6de7fd�Z ede8fd�� � Z dS ) � ModelHandlerc � � d| _ d| _ d| _ d| _ d| _ d| _ | � � � dS )z Initialize the model handlerN)�model� tokenizer�9translator�10researcher�11summarizer� presenter�_initialize_model��selfs �K/Users/devopmh/Documents/devopmh/ama-autism-pt-br/services/model_handler.py�__init__zModelHandler.__init__ sD � ���12� ��� ��� ��� ��� ��� � � � � � � � � c � � t ddt d�� � ddg�� � | _ t dd t d�� � t � � t � � gg d13�d � � � | _ t d
dt d�� � g d�d d d �� � | _ t ddt d�� � g d�d �� � | _ dS )z Initialize model and tokenizer�14Translatorz'You will translate the query to Englishz llama3.2:1b)�idzTranslate to Englishz Translate the query to English)�name�roler �goal� instructions�15Researcherz>You are a research scholar who specializes in autism research.)z�You need to understand the context of the question to provide the best answer based on your tools.Be precise and provide just enough information to be usefulzTYou must cite the sources used in your answer.You must create an accessible summary.�8The content must be for people without autism knowledge.�MFocus in the main findings of the paper taking in consideration the question.zThe answer must be brief.T)r r r �toolsr �show_tool_calls�16SummarizerzXYou are a specialist in summarizing research papers for people without autism knowledge.)17z5You must provide just enough information to be usefulz.You must cite the sources used in your answer.z You must be clear and concise.z&You must create an accessible summary.r r! ztThe answer must be brief.Remove everything related to the run itself like: 'Running: transfer_', just use plain text�FYou must use the language provided by the user to present the results.�1Add references to the sources used in the answer.�YAdd emojis to make the presentation more interactive.Translaste the answer to Portuguese.)r r r r r# �markdown�add_references� PresenterzKYou are a professional researcher who presents the results of the research.)zYou are multilingualz;You must present the results in a clear and concise manner.z2Clenaup the presentation to make it more readable.z Remove unnecessary information.z[Remove everything related to the run itself like: 'Running: transfer_', just use plain textr% r& r' )r r r r r) N)r r r r r r r r r s r r z ModelHandler._initialize_model s � � � �:��M�*�*�*�'�0�� 18� 19� 20��� � �Q��M�*�*�*� �<�<�� � �/�� � � !� 21� 22� 23��� � �k��M�*�*�*�
�
�
� !�� �)24� 25� 26���. � �^��M�*�*�*�27� 28� 29� � 30� 31� 32����r c �� � t j t � � } t j t � � }|| fS # t $ r/}t j dt |� � � �� � Y d }~dS d }~ww xY w)NzError loading model: )NN)r �from_pretrained�33MODEL_PATHr � Exception�logging�error�str)r
r �es r � _load_modelzModelHandler._load_model] s} � � �%�5�j�A�A�I�(�8��D�D�E��)�#� #��� � � � �M�:�#�a�&�&�:�:� ;� ;� ;� �:�:�:�:�:����� ���s �58 �34A1�$A,�,A1�query�returnc � � | j � |d�� � }t j d� � | j � |j d�� � }t j d� � | j � |j d�� � }t j d� � | j � |j d�� � }t j d� � |j s| � � � S |j S # t $ rB}t j35 dt |� � � �� � | � � � cY d }~S d }~ww xY w)NF)�streamzTranslated queryzGenerated researchzGenerated summaryzGenerated presentationzError generating answer: ) r �runr/ �infor �contentr r �_get_fallback_responser. r0 r1 )r r4 r �research�summary� presentationr2 s r �generate_answerz ModelHandler.generate_answeri s@ � � 1� � �,�,�U�5�,�A�A�J� �L�,� -� -� -���*�*�:�+=�e�*�L�L�H� �L�.� /� /� /��o�)�)�(�*:�5�)�I�I�G� �L�-� .� .� .� �>�-�-�g�o�e�-�L�L�L� �L�2� 3� 3� 3� �'�
5��2�2�4�4�4� �'� '��� 1� 1� 1� �M�>�c�!�f�f�>�>� ?� ?� ?��.�.�0�0� 0� 0� 0� 0� 0� 0����� 1���s$ �C)C3 �,C3 �336D?�=7D:�4D?�:D?c � � dS )z-Provide a friendly, helpful fallback responseuz 37 Peço descula, mas encontrei um erro ao gerar a resposta. Tente novamente ou refaça a sua pergunta.38 � rA r r r; z#ModelHandler._get_fallback_response{ s � � � r N)
�__name__�39__module__� __qualname__r r � staticmethod�st�cache_resource�40cache_datar3 r1 r? r; rA r r r41 r42 s� � � � � � �!� !� !�D43� D44� D45�N ����]� � � �]� �� �\� �1�S� 1�S� 1� 1� 1� 1�$ � �C� � � � �\� � � r r46 )r/ � transformersr r � streamlitrF �47agno.agentr �agno.models.ollamar �agno.tools.arxivr �agno.tools.pubmedr r- r48 rA r r �<module>rO s� �� ���� <� <� <� <� <� <� <� <� � � � � � � � � � � %� %� %� %� %� %� '� '� '� '� '� '� )� )� )� )� )� )�
&�49�u � u � u � u � u � u � u � u � u � u r