xdecoder/Instruct-X-Decoder
163
1U
2 E$�cL � @ s� d dl Z d dlZd dlmZ d dlmZ d dlmZ d dl m3Z4 d dl m Z g Z
e
�ejdejd�� e�e
�Ze �d �Zd5d � ZdS ) � N)�Image)�6transforms)�7Visualizer)� random_color)�MetadataCatalogi )�
interpolation�ade20k_panoptic_trainc O s. t | j_ |�� }dd� |�d�D �}t|�}t�� �� |jd }|jd }t� |�}t� |�} t�8|� � �� ddd��
� }9|10||d|id�g} | j�| d �} t| t d �}
| d d11 dk�� �� �� }t|�D ]4\}}td dd ��tj��� }|
j|||| d
�}q�|�� }W 5 Q R X tj
�� t� |�dd fS )Nc S s( g | ] }|� d �r|�� n|d g�qS )�.)�endswith�strip)�.0�text� r �&/data/arXiv/demo/Demo/tasks/ref_seg.py�12<listcomp> s z*referring_segmentation.<locals>.<listcomp>�,r � � �texts)�image�height�width�13groundings)�metadata�grounding_maskT)�rgb�maximum)�colorr
� ) r �modelr �split� transform�torch�no_grad�size�np�asarray�14from_numpy�copy�permute�cuda�evaluate_groundingr �float�cpu�numpy� enumerater �astype�int32�tolist�draw_binary_mask� get_image� empty_cacher � fromarray)r r r �inpainting_text�args�kwargs� image_orir r � image_ori_np�images� batch_inputs�outputs�visual�grd_mask�idx�maskr �demo�resr r r �referring_segmentation s( 1516171819 20rE )r" r. r% �PILr � torchvisionr �utils.visualizerr �detectron2.utils.colormapr �detectron2.datar �t�append�Resize�BICUBIC�Composer! �getr rE r r r r �<module> s 2122