MLBench/ReaLens
0
1�
2 ���he � � � d Z ddlmZ ddlZddlZddlmZ ddlm Z ddl3m Z ddl
Z
ej fd�Zdd�Zd� Zd � Zdd4�Zdd �Zd � Zd
� Zy)z,This module contains simple helper functions� )�print_functionN)�Image)�Pathc � � t | t j � s�t | t j � r
| j5 }n| S |d j
� j � j � }|j d dk( rt j |d� }t j |d� dz dz dz }n| }|j |� S )z� "Converts a Tensor array into a numpy image array.6 7 Parameters:8 input_image (tensor) -- the input image tensor array9 imtype (type) -- the desired type of the converted numpy array10 r � )� r r )r � r g @g �o@)
�11isinstance�np�ndarray�torch�Tensor�data�cpu�float�numpy�shape�tile� transpose�astype)� input_image�imtype� image_tensor� image_numpys �\/home/kk/Downloads/projectOverview/choose_best_ldr/pytorch-CycleGAN-and-pix2pix/util/util.py� tensor2imr s� � � �k�2�:�:� .� �k�5�<�<� 0�&�+�+�L� � �"�1�o�)�)�+�1�1�3�9�9�;� � � � �Q� �1� $� �'�'�+�y�9�K��|�|�K��;�a�?�3�F��N� �!� � � � �f� %�%� c � � d}d}| j � D ]S }|j ��|t j t j |j j12 � � z
}|dz
}�U |dkD r||z }t
|� t
|� y)z�Calculate and print the mean of average absolute(gradients)13 14 Parameters:15 net (torch network) -- Torch network16 name (str) -- the name of the network17 g r Nr )�18parameters�gradr
�mean�absr �print)�net�namer! �count�params r �diagnose_networkr( ! s{ � � �D�
�E�� � �!� �� �:�:� !� �E�J�J�u�y�y���� � � 9�:� :�D� �Q�J�E��
�q�y��e�|�� �$�K� �$�Kr c �X � dt j v xr t t j d � dkD } | r~t j � st j19 d�� t t j d � }t
j d|� �� }t j j |� nht j j � r5t
j d� }t j j d� nt
j d � }t d20|� �� |S ) N�21WORLD_SIZEr �nccl)�backend�22LOCAL_RANKzcuda:zcuda:0r r zInitialized with device ) �os�environ�int�dist�is_initialized�init_process_groupr
�device�cuda�23set_device� is_availabler# )�is_ddp�24local_rankr4 s r �init_ddpr: 5 s� � �
�R�Z�Z�
'�
M�C��25�26�<�0H�,I�A�,M�F�
��"�"�$� � #� #�F� 3�����L�1�2�27�� � ��j�\� 2�3��
�28�29� � �j�)� ��� � � "�� � �h�'��
�30�31� � �a� �� � �e�$�� � $�V�H�32-�.� �Mr c �V � t j � rt j � y y )N)r1 r2 �destroy_process_group� r r � cleanup_ddpr> I s � � ��� � �"�"�$� r c �< � t j | � }| j \ }}}|dkD r.|j |t ||z � ft j33 � }|dk r.|j t ||z � |ft j34 � }|j
|� y)z�Save a numpy image to the disk35 36 Parameters:37 image_numpy (numpy array) -- input numpy array38 image_path (str) -- the path of the image39 � �?N)r � fromarrayr �resizer0 �BICUBIC�save)r �40image_path� aspect_ratio� image_pil�h�w�_s r �41save_imagerK N s� � � ��� �,�I�� � �G�A�q�!��c�� �$�$�a��Q� �-=�)>�%?�� � �O� ��c�� �$�$�c�!�l�*:�&;�Q�%?�� � �O� �
�N�N�:� r c 42 �| � | j t j � } |rt d| j � |r�| j � } t dt j | � t j | � t j | � t j | � t j | � fz � yy)z�Print the mean, min, max, median, std, and size of a numpy array43 44 Parameters:45 val (bool) -- if print the values of the numpy array46 shp (bool) -- if print the shape of the numpy array47 zshape,zAmean = %3.3f, min = %3.3f, max = %3.3f, median = %3.3f, std=%3.3fN) r r �float64r# r �flattenr! �min�max�median�std)�x�val�shps r � print_numpyrV ` s� � � 48������ �A�49�
�h���� �50�
�I�I�K��
�Q�UW�U\�U\�]^�U_�ac�ag�ag�hi�aj�ln�lr�lr�st�lu�wy� xA� xA� BC� xD� FH� FL� FL� MN� FO� UP� P� Q� r c � � t | t � r#t | t � s| D ]
}t |� � yt | � y)zxcreate empty directories if they don't exist51 52 Parameters:53 paths (str list) -- a list of directory paths54 N)r55 �list�str�mkdir)�paths�paths r �mkdirsr] o s6 � � �%�� �z�%��'=�� �D� �$�K� � �e� r c �< � t | � j dd�� y)zvcreate a single empty directory if it didn't exist56 57 Parameters:58 path (str) -- a single directory path59 T)�parents�exist_okN)r rZ )r\ s r rZ rZ | s � � ��J���T�D��1r )�network)r@ )TF)�__doc__�60__future__r r
r r �PILr �pathlibr �torch.distributed� distributedr1 r. �uint8r r( r: r> rK rV r] rZ r= r r �<module>ri sO �� 2� %� � � � � � � #%�(�(� &�*�(�(%�61 �$ Q� 62�2r