mapleadmin/GPT
1
1�
2 X�e � �� � d dl mZmZ d dlmZ d dlmZ d dlmZ d dl m3Z4 d dl m Z d dl
ZdZd Zd5� Zd � Zd � Zd
� Zd� Zej d� � � Zej d� � � ZdS )� )� PyPDFLoader�DirectoryLoader)�PromptTemplate)�HuggingFaceEmbeddings)�FAISS��
CTransformers)� RetrievalQANzvectorstore/db_faissa Use the following pieces of information to answer the user's question.6If you don't know the answer, just say that you don't know, don't try to make up an answer.7 8Context: {context}9Question: {question}10 11Only return the helpful answer below and nothing else.12Helpful answer:13c �6 � t t ddg�� � } | S )z?14 Prompt template for QA retrieval for each vectorstore15 �context�question)�template�input_variables)r �custom_prompt_template)�prompts �'D:\Llama2-Medical-Chatbot-main\model.py�set_custom_promptr s+ � � �%;�-6�16�,C�E� E� E�F� �M� c �h � t j | d|� ddi�� � dd|i�� � }|S )N�stuff�k� )�
search_kwargsTr )�llm�17chain_type� retriever�return_source_documents�chain_type_kwargs)r18 �from_chain_type� as_retriever)r r �db�qa_chains r �retrieval_qa_chainr# sG � ��*�s�29�13� � �PS�UV�x� �1X�1X�?C�:B�F�9K� )� )� )�H� �Or c �, � t dddd�� � } | S )Nz TheBloke/Llama-2-7B-Chat-GGML�llamai g �?)�model�19model_type�max_new_tokens� temperaturer )r s r �load_llmr* ( s) � �20�/�� �� � � �C� �Jr c � � t dddi�� � } t j t | � � }t � � }t � � }t
|||� � }|S )Nz&sentence-transformers/all-MiniLM-L6-v2�device�cpu)�21model_name� model_kwargs)r r �22load_local�
DB_FAISS_PATHr* r r# )�23embeddingsr! r � qa_prompt�qas r �qa_botr5 3 s` � �&�2Z�5=�u�4E�G� G� G�J� � �-�� 4� 4�B�24�*�*�C�!�#�#�I� �C��B� /� /�B�
�Ir c � � t � � } |d| i� � }|� dd� � }|� dg � � }d}d}|r�t |d�� � D ]�\ }}|� d d25� � } |� d i � � }26d |� d
|27� dd� � � d�} || | z dz z
}| � � � |� � � v rd}��|s d|� d�|z }|� � � sd}|S )N�query�answerzNo answer found�source_documents� F� ��start� page_contentzNo content available�metadatazSource z - �sourcezUnknown Sourcez:28�29T�Answer:30�31 32zNo sources found)r5 �get� enumerate�lower�strip) r7 � qa_result�responser8 �sources�formatted_response�answer_found_in_sources�ir@ r> � source_info� source_texts r � final_resultrP ? sF � ����I��y�'�5�)�*�*�H�
�\�\�(�$5�
6�
6�F��l�l�-�r�2�2�G��� #��� /�"�7�!�4�4�4� 33 /� 34 /�I�A�v�!�:�:�n�6L�M�M�L� �*�*�Z��4�4�K�Z�A�Z�Z�+�/�/�(�DT�*U�*U�Z�Z�Z�K� �+� �"<�t�"C� C� � �!�!�#�#�v�|�|�~�~�5�5�*.�'�� "� K� 5�� 5� 5� 5�8J� J�� � #� #� %� %� 0� /�� � r c � � K � t � � } t j d�� � }|� � � � d {V �� d|_ |� � � � d {V �� t j � d| � � d S )NzStarting the bot...��contentz)Welcome to Maple Bot. What is your query?�chain)r5 �cl�Message�sendrS �update� user_session�set)rT �msgs r r= r= b s� � � � � �H�H�E�35 �*� 2�363�373�383�C�39
�(�(�*�*��������=�C�K�40
�*�*�,�,���������O�����'�'�'�'�'r c � � K � t j � d� � }t j dddg�� � }d|_ |� | |g�� � � d {V ��}|d }|d }|r%d }t
|d41� � � D ]\ }}|d |� d
|� �z
}�nd}d|� d|� �} t j | �� � � � � � d {V �� d S )NrT T�FINAL�ANSWER)�stream_final_answer�answer_prefix_tokens)� callbacks�resultr9 z 42Sources:r; r< rA z. z43No sources foundrB rC rR ) rU rY rD � AsyncLangchainCallbackHandler�answer_reached�acallrE rV rW )44�messagerT �cb�resr8 rJ � sources_textrM r@ �response_messages45 r �mainrk l s' � � � � �O� � �� (� (�E� � )� ���7J�46� 47� 48�B� �B��� � �G��t� �4�4�494�504�514�524�534�544�C�
��]�F��$�%�G�� ,�#� �"�7�!�4�4�4� /� /�I�A�v� � .�� .� .�f� .� .� .�L�L� /� ,� �=�6�=�=�|�=�=��55 �*� -�56.�57.�58.�593�603�615�625�5�5�5�5�5�5�5�5�5r )�langchain.document_loadersr r � langchainr �langchain.embeddingsr �langchain.vectorstoresr �langchain.llmsr �langchain.chainsr63 �chainlitrU r1 r r r# r* r5 rP �
on_chat_startr= �64on_messagerk � r r �<module>rv s" �� C� C� C� C� C� C� C� C� $� $� $� $� $� $� 6� 6� 6� 6� 6� 6� (� (� (� (� (� (� (� (� (� (� (� (� (� (� (� (� (� (� � � � �&�
�� �� � �� � �� � �� � � � � �F ��(� (� ��(� � �6� 6� � �6� 6� 6r