Linhz/ViMNer
1
1a
2 ��df� � @ s2 d dl Zd dlmZ d dlmZ d dlZd dlmZm Z m3Z4 d dl Z d dl m
Z
mZ d dlmZmZmZmZmZmZ d dlmZ d dlmZ d d lmZ d dl Z d dl Z d d5l m Z d d l!m"Z" d d l#m$Z$ d
Z%dZ&e �'e j(�)� r�dnd�Z'e*ed�� Z+e+�,e �-e j.�/dd��� ee+de'�Z0dd� Z1dd� Z2dS )� N)�displacy)�ViTagger)�save_uploaded_image�convert_text_to_txt�add_string_to_txt)�
AutoTokenizer�6BertConfig)�format_predictions�process_predictions�combine_entities�remove_B_prefix�7load_model�predict)�get_test_examples_predict)�resnet)�myResnet)�MNERProcessor_2016)�show_mner_2016)�show_mner_2021zbert_config.jsonzpytorch_model.bin�cuda�cpuZ resnet152z)E:/demo_datn/pythonProject1/Model/Resnet/z
resnet152.pthTc C s t �dd| �� �}|S )Nz\s+� )�re�sub�strip)�text�processed_text� r �;E:\demo_datn\pythonProject1\Model\MultimodelNER\app_MNER.py� process_text s r c C s> t j�d� t j�dd�} t �d� | dkr4t� nt� d S )N�Datasets)�VLSP2016�VLSP2021zMultimodal NERr! )�st�sidebar�title� selectbox�headerr r )�datasetr r r � show_mner" s 8r) )3� streamlitr# �spacyr � Model.NER.VLSP2021.Predict_Nerr r Z
thunghiemxulyr r r �os� transformersr r Z+Model.MultimodelNER.VLSP2016.train_umt_2016r r9 r r r
r ZModel.MultimodelNER.predictr ZModel.MultimodelNERr Z Model.MultimodelNER.resnet_utilsr �torch�numpy�npZ,Model.MultimodelNER.VLSP2016.dataset_robertar Z&Model.MultimodelNER.VLSP2016.MNER_2016r Z&Model.MultimodelNER.VLSP2021.MNER_2021r � CONFIG_NAME� WEIGHTS_NAME�devicer � is_available�getattr�net�load_state_dict�load�path�join�encoderr r) r r r r �<module> s.