huggan/FastGan
33
1a
2 �{]b3# � @ s� d dl Z d dlmZ d dlm mZ d dlmZ d dlm Z G dd� dej4�Z G dd� dej5�Z G dd � d ej6�Z
G d7d � d ej8�ZG d d
� d
ej9�ZG dd� dej10�ZG dd� dej11�ZG dd� dej12�ZG dd� dej13�ZG dd� dej14�ZdS )� N)� BatchNorm2d)�
spectral_normc s0 e Zd Z� fdd�Zejejd�dd�Z� ZS )�SpectralConv2dc s$ t � �� ttj|i |���| _d S �N)�super�__init__r �nn�Conv2d�_conv��self�args�kwargs�� __class__� �9H:\My Drive\Personal\HuggingFace\HugGAN\FastGan\layers.pyr 15 s 16�zSpectralConv2d.__init__��input�returnc C s17 | � |�S r �r18 �r r r r r �forward s zSpectralConv2d.forward��__name__�19__module__� __qualname__r �torch�Tensorr �
__classcell__r r r r r s r c s0 e Zd Z� fdd�Zejejd�dd�Z� ZS )�SpectralConvTranspose2dc s$ t � �� ttj|i |���| _d S r )r r r r �ConvTranspose2dr20 r r r r r s 21�z SpectralConvTranspose2d.__init__r c C s22 | � |�S r r r r r r r s z SpectralConvTranspose2d.forwardr r r r r r s r c s0 e Zd Z� fdd�Zejejd�dd�Z� ZS )�Noisec s$ t � �� tjt�d�dd�| _d S )N� T)�
requires_grad)r r r � Parameterr �zeros�_weight)r r r r r " s23 24�zNoise.__init__r c C s2 |j \}}}}tj|d|||jd�}| j| | S )Nr# )�device)�shaper �randnr( r' )r r �25batch_size�_�height�width�noiser r r r ) s z
Noise.forwardr r r r r r" s r" c s8 e Zd Zeed�� fdd� Zejejd�dd�Z� ZS )� InitLayer�� in_channels� out_channelsc 26 sF t � �� t�t||d ddddd�tj|d d�tjdd��| _d S ) N� � r# r F�r2 r3 � kernel_size�stride�padding�bias�� num_features��dim)r r r �27Sequentialr r �GLU�_layers�r r2 r3 r r r r 1 s 28�29�zInitLayer.__init__r c C s30 | � |�S r �rA r r r r r B s zInitLayer.forward� r r r �intr r r r r r r r r r0 / s �r0 c s< e Zd Zeed�� fdd� Zejejejd�dd�Z� ZS )�SLEBlockr1 c
sR t � �� t�tjdd�t||ddddd�t�� t||ddddd�t�� �| _d S )Nr5 �� output_sizer# r Fr6 ) r r r r? �AdaptiveAvgPool2dr �SiLU�SigmoidrA rB r r r r H s, 3132���zSLEBlock.__init__)�low_dim�high_dimr c C s || � |� S r rC )r rL rM r r r r b s zSLEBlock.forwardrD r r r r rF F s ��rF c s8 e Zd Zeed�� fdd� Zejejd�dd�Z� ZS )�UpsampleBlockT1r1 c sR t � �� t�tjddd�t||d ddddd�tj|d d �tjdd33��| _d S � Nr4 �nearest)� scale_factor�mode� r# �sameFr6 r; r= ) r r r r? �Upsampler r r@ rA rB r r r r i s 34 �35�zUpsampleBlockT1.__init__r c C s36 | � |�S r rC r r r r r { s zUpsampleBlockT1.forwardrD r r r r rN g s �rN c s8 e Zd Zeed�� fdd� Zejejd�dd�Z� ZS )�UpsampleBlockT2r1 c s� t � �� t�tjddd�t||d ddddd�t� t|d d �tjdd37�t||d ddddd�t� tj|d d �tjdd38�� | _ d S rO )39r r r r? rU r r" r r@ rA rB r r r r � s4 40 � 41�42�zUpsampleBlockT2.__init__r c C s43 | � |�S r rC r r r r r � s zUpsampleBlockT2.forwardrD r r r r rV s � rV c s8 e Zd Zeed�� fdd� Zejejd�dd�Z� ZS )�DownsampleBlockT1r1 c 44 s> t � �� t�t||ddddd�tj|d�tjdd��| _d S ) Nr5 r4 r# Fr6 r; 皙�����?��negative_slope)r r r r? r r � LeakyReLUrA rB r r r r � s 45�4647�zDownsampleBlockT1.__init__r c C s48 | � |�S r rC r r r r r � s zDownsampleBlockT1.forwardrD r r r r rW � s �rW c s8 e Zd Zeed�� fdd� Zejejd�dd�Z� ZS )�DownsampleBlockT2r1 c
s� t � �� t�t||ddddd�tj|d�tjdd�t||d dd49dd�tj|d�tjdd��| _t�tjddd �t||ddd dd�tj|d�tjdd��| _ d S )
Nr5 r4 r# Fr6 r; rX rY rS rT )r7 r8 r )50r r r r? r r r[ � _layers_1� AvgPool2d� _layers_2rB r r r r � sN 51�5253�5455���5657�zDownsampleBlockT2.__init__r c C s | � |�}| �|�}|| d S )Nr4 )r] r_ )r r �t1�t2r r r r � s 5859zDownsampleBlockT2.forwardrD r r r r r\ � s �,r\ c s8 e Zd Zeed�� fdd� Zejejd�dd�Z� ZS )�Decoderr1 c s� t � �� dddddddd�| _t�tjdd�t|| jd d �t| jd | jd d �t| jd | jd d �t| jd | jd d �t| jd |d60d d d
d�t�� �| _ d S )N� �@ � � � r5 )rf re rd rc � i i rG r1 rS r# rT Fr6 )61r r � _channelsr r? rI rN r �TanhrA rB r r r r � s2 62�6364��zDecoder.__init__r c C s65 | � |�S r rC r r r r r s zDecoder.forwardrD r r r r rb � s � rb )r �torch.nnr Ztorch.nn.functional�66functional�FZtorch.nn.modules.batchnormr Ztorch.nn.utilsr �Moduler r r" r0 rF rN rV rW r\ rb r r r r �<module> s !$4