xdecoder/Instruct-X-Decoder
163
1U
2 E$�c@ � @ s� d dl Z d dlZd dlmZ d dlmZ d dlmZ d dl m3Z4 d dl m Z d dl
mZ g Ze�ejdejd �� e�e�Ze �d5�Zd d � ZdS )
� N)�Image)�6transforms)�7Visualizer)� random_color)�MetadataCatalog)�BitMasksi )�
interpolationZade20k_panoptic_trainc O sn dd� |� d�D �}dd� tt|��D �}dd� tt|��D �}t�d�j|||d� t�� �� | jj j8j j |d g d9d � t�d�} | | j_
t|�| jj _t|�}10|11jd } |12jd
} t�|13�}t�|�� ��dd d
��� }
|
| | d�g}| �|�}t|14| d�}|d d }|j�� |_t|jd k�� � |_ |� |�}|� � }W 5 Q R X t� d� tj�!� t"�#|�dd fS )Nc S s g | ] }|� � �qS � )�strip��.0�xr r �(/data/arXiv/demo/Demo/tasks/open_inst.py�15<listcomp> s z open_instseg.<locals>.<listcomp>�,c S s$ g | ] }t d dd��tj��� �qS )T�� )�rgb�maximum)r �astype�np�int32�tolist)r �_r r r r s c S s i | ]16}||�qS r r r r r r �17<dictcomp> s z open_instseg.<locals>.<dictcomp>�demo)� thing_colors�
thing_classes�!thing_dataset_id_to_contiguous_id�18backgroundT)�is_evalr � � )�image�height�width)�metadata������ instances� )$�split�range�lenr �get�set�torch�no_grad�model� sem_seg_head� predictor� lang_encoder�get_text_embeddingsr% � num_classes� transform�sizer �asarray�19from_numpy�copy�permute�cuda�forwardr �20pred_masks�cpur �get_bounding_boxes�21pred_boxesZdraw_instance_predictions� get_image�remove� empty_cacher � fromarray)r0 r" �texts�inpainting_text�args�kwargsr r r r% � image_orir$ r# �images� batch_inputs�outputs�visualZinst_segr �resr r r � open_instseg s: 22�23 24252627 28 293031rP )r. �numpyr �PILr � torchvisionr Zutils.visualizerr Zdetectron2.utils.colormapr �detectron2.datar �detectron2.structuresr �t�append�Resize�BICUBIC�Composer6 r, r% rP r r r r �<module> s 3233