HCKLab/BiBert-MultiTask-2
17
1B
2 N�sc� � @ s d dl mZmZmZ d dlmZ d dlZd dlmZ d dlm Z d dl3m Z d dl m
Z
d dlmZ d d lmZ d d4lmZ e jd e
ed � e�� e�d
�Ze�ej�� r�dnd�ZeG dd� d��Zed dddd�eddddd�gZ dddddd �Z d d d ddd �Z G d d � d �Z dS ) � )�Dict�List�Any)� dataclassN)�
AutoTokenizer)�pipeline)�PIPELINE_REGISTRY)�BiBert_MultiTaskPipeline)� BertForSequenceClassification)�logging)� perf_counterz bibert-multitask-classification)Zpipeline_classZpt_model� transformers�cuda�cpuc @ s. e Zd ZU eed< eed< eed< eed< dS )�Task�id�name�type�5num_labelsN)�__name__�6__module__� __qualname__�int�__annotations__�str� r r �&/content/BiBert-MultiTask-2/handler.pyr s 7r Zlabel_classificationZseq_classification� )r r r r � Zbinary_classification� ZNegative�NeutralZPositive)�0�1�2�3�4�����c @ s: e Zd Zddd�Zeeef eeeef d�dd�ZdS ) �EndpointHandler� c C sv t �dt� t� }t�|�}tj|td��t�}t d|d|td�| _8t d|d|td�| _ dt� | }t �d|� d S ) NzThe device is %s.)Z tasks_mapz bibert-multitask-classificationr! )�model�task_id� tokenizer�devicer" i� z.Models and tokenizer Polarity loaded in %d ms.) �logger�infor, r r Zfrom_pretrainedr9 �tasks�tor � classifier_s� classifier_p)�self�path�t0r+ r) �elapsedr r r �__init__& s 10zEndpointHandler.__init__)�data�returnc C s� |� d|�}t|t�r |g}t� }g }| �|�}| �|�}t�d|� t�d|� xzt|�D ]n\}}|| d } || d }11| dkr�|12dkr�|� dd d13�� q\|� t14� || d �t � || d �d15�� q\W d t� | } t�d | � |S )
z�16 data args:17 inputs (:obj: `str` | `PIL.Image` | `np.array`)18 kwargs19 Return:20 A :obj:`list` | `dict`: will be serialized and returned21 �inputszPrediction polarity %szPrediction subjective %s�labelZ probabilityr! g �?r r )r; �scorei� z Model prediction time: %d ms.)
�pop�22isinstancer r r2 r1 r- r. � enumerate�append� idtolabel�get� idtoscore) r3 r8 r: r5 Zprediction_resZclassifier_polZclassifier_subj�idx�xr; Zprobr6 r r r �__call__4 s$ 232425 0 zEndpointHandler.__call__N)r( ) r r r r7 r r r r rF r r r r r' % s 26r' ) �typingr r r Z dataclassesr Ztorchr
r r Ztransformers.pipelinesr Z bibert_multitask_classificationr Z bert_for_sequence_classificationr27 Ztransformers.utilsr �timer Zregister_pipelineZset_verbosity_info�28get_loggerr- r, r Z is_availabler r/ rA rC r' r r r r �<module> s& 29