huynhdoo/mps-v2
0
1o
2 @j_ft � @ sH d dl mZmZmZmZmZmZmZmZ d dl m3Z4 d dl Z ej dd��
ddd�Ze�� � d dlZd dlZed � e j�d �e jd5< W d � n1 sMw Y ed ed �Zejd
dd�ZdZejdeeid�G dd� d��Zejdd�G dd� d��Z ej dd�edd�de6fdd ���Z ej dd�edd�de7fd d ���Z dS ) � )�Image�App�Secret� web_endpoint�Volume�enter�method�build)�DictNz3.12)�python_version�chromadbzsentence-transformerszpysqlite3-binary� pysqlite3�sqlite3zmps-api)�image�mpsF)�create_if_missingz/datai )�timeout�volumesc @ s0 e Zd Ze� e� dd� ��Ze� ddd��ZdS )�VECTORDBc C st ddl m} d}||d�| _td|� �� dd l}td }d}|j|d�}|j|| jd �| _t| j� � � d8�� d S ) Nr )�$SentenceTransformerEmbeddingFunctionz#Lajavaness/sentence-camembert-large)�9model_namezEmbedding model loaded: z/db�MPS)�path)�name�embedding_functionz documents loaded.)10�"chromadb.utils.embedding_functionsr r �printr � data_path�PersistentClient�get_collection�chroma_collection�count)�selfr r r �DB_PATH�COLLECTION_NAME�
chroma_client� r& �/content/mps-api.py�init s z
VECTORDB.init�11 c C sB | j j||dd|iig d�d�}|d }|d }|d }|||fS )N�originz$in�� documents� metadatas� distances)� query_texts� n_results�where�includer, r- r. )r �query)r" �queries�originsr0 �resultsr, r- r. r& r& r' �search- s 12�13zVECTORDB.searchN)r) )�__name__�14__module__� __qualname__r r r( r r7 r& r& r& r' r s r )r c @ s. e Zd Ze� e� dd� ��Ze� dd� �ZdS )�RANKINGc C s, ddl m} d}||�| _td|� �� d S )Nr )� CrossEncoderz'Lajavaness/CrossEncoder-camembert-largez Cross encoder model loaded: )�sentence_transformersr< �
cross_encoderr )r" r< r r& r& r' r( < s 15z RANKING.initc s: � fdd�|D �}| j �|�}t�|�d d d� �� }|S )Nc s g | ]}� |g�qS r& r& )�.0�doc�r3 r& r' �16<listcomp>G s z RANKING.rank.<locals>.<listcomp>�����)r> �predict�np�argsort�tolist)r" r3 r, �pairs�scores�rankingr& rA r' �rankE s z RANKING.rankN)r8 r9 r: r r r( r rK r& r& r& r' r; : s r; �POST)r r3 c C s@ t d| � d�� t� j�| d | d | d �\}}}|||d�S )NzRetrieve query: �...r3 r5 r0 r+ )r r r7 �remote)r3 r, r- r. r& r& r' �retrieveO s $ rO c C s0 t d| � d�� t� j�| d | d �}d|iS )Nz Rank query: rM r3 r, rJ )r r; rK rN )r3 rJ r& r& r' rK Y s rK ) �modalr r r r r r r r �typingr17 �sys� debian_slim� pip_install� model_image�imports�os�numpyrE �18__import__�modules�pop�app� from_name�volr �clsr r; �functionrO rK r& r& r& r' �<module> s: ( 1920�21 ���22 2324