RuiTerrty/RemoteSensingChangeDetection-RSCD.HA2F
0
1a
2 8��g� � @ sd d dl Z d dlm mZ d dlZd dlmZ d dlZdd� Z dd� Z3dd� Z dd � Z d
d d �Z
dS )� Nc C s� | � � D �]�\}}td| � t|tj�rXtjj|jddd� |jd urVtj� |j� qt|tj4tj f�r�tj� |j� |jd ur�tj� |j� qt|tj
�r�tjj|jddd� |jd ur�tj� |j� qt|tj��r�|� � D ]�\}}td| � t|tj��r4tjj|jddd� |jd u�r�tj� |j� q�t|tj5tj f��rrtj� |j� |jd u�r�tj� |j� q�t|tj
�r�tjj|jddd� |jd ur�tj� |j� q�qt|tj��s�t|tj��s�t|tj��s�t|tj�rd}qqd S )Nz initialize: �fan_in�relu)�mode� nonlinearity� )�named_children�print�6isinstance�nn�Conv2d�init�kaiming_normal_�weight�bias�zeros_� BatchNorm2d� GroupNorm�ones_�Linear�7Sequential�AdaptiveAvgPool2d�AdaptiveMaxPool2d�8ModuleList�BCELoss)�module�n�m�f�g�a� r �;C:\Users\82607\Desktop\code\ChangeViT-master\model\utils.py� weight_init s@ 910 11 126r" c C s0 t �| � t j�| � t�| � tj�| � d S �N)�torch� manual_seed�cuda�random�seed�np)r( r r r! � init_seed, s 13 14r* c C sH t �| |�}| | �� }d}d| | | �� |�� | }|d | S )Ng�h㈵��>� r )�F�binary_cross_entropy�sum)�inputs�targets�bce�inter�epsZdicer r r! � BCEDiceLoss3 s15 r4 c C s t �| |�}|S r# )r, r- )r/ r0 r1 r r r! �BCE= s r5 r c 16 C s� | j dkr | jd|| j }nD| j dkrT|}|| j }| jd|d | d }ntd�| j ���|dkr�|d k r�| jd |d d d| j }||9 }|jD ] } || d17< q�|S ) N�stepg�������?�polyr g �?g�������?zUnknown lr mode {}r �� �lr)Zlr_moder9 Z step_lossZ18max_epochs�19ValueError�format� param_groups)20�args� optimizer�epoch�iterZ max_batchesZ lr_factorr9 Zcur_iter�max_iter� param_groupr r r! �adjust_learning_rateC s 212223 2425rC )r )r$ �torch.nn.functionalr26 �27functionalr, �numpyr) �torch.nnr' r" r* r4 r5 rC r r r r! �<module> s $28