CLYang617/RemoteSensingChangeDetection-RSCD.HA2F
0
1a
2 8��g4 � @ sB d dl mZ d dlZd dlmZ d dlmZ G dd� dej�ZdS )� )�UnionN)�Tensor)�nnc sB e Zd Zd3eeeef edd�� fdd�
Zeed�dd �Z � Z4S ) �5LayerScale��h㈵��>FN)�dim� init_values�inplace�returnc s* t � �� || _t�|t�|� �| _d S �N)�super�__init__r r � Parameter�torch�ones�gamma)�selfr r r �� __class__� �HC:\Users\82607\Desktop\code\ChangeViT-master\model\layers\layer_scale.pyr
s 6zLayerScale.__init__)�xr7 c C s | j r|�| j�S || j S r )r �mul_r )r r r r r �forward s zLayerScale.forward)r F) �__name__�8__module__� __qualname__�intr �floatr �boolr
r �
__classcell__r r r r r s �9�10r )�typingr r r r �Moduler r r r r �<module> s