OneScience-Group/DiffDock
031
1o
2 �aOj�< �
@ s: d dl Z d dlZd dlmZmZmZ d dlZd dlZd dl m3Z4 d dl m5 m Z
d dlmZ d dlmZ d dlmZmZ d dlmZmZ ddlmZ d d6� Zd d � ZG d
d� dej7j �Z d dd�Z d dejdee8j e9j f dej dej deej dej f dd�Z!G dd � d ej10j �Z"G d d � d ej11j �Z#dS ) � N)�List�Tuple�Union)�o3)� BatchNorm)�Linear�
TensorProduct)�scatter� scatter_mean� )�FCBlockc C s� |r;| � d�| � d|� d|� d�| � d|� d|� d|� d|� d�12| � d|� d|� d|� d|� d|r3|n| � d � g}|S | � d�| � d|� d13�| � d|� d|� d �| � d|� d|� d|r]|n| � d �g}|S ) NZx0ezx0e + zx1o + Zx2ezx2e + zx1e + Zx2ozx2o + Zx0oZx1oZx1e� )�nsZnvZuse_second_order_reprZreduce_pseudoscalarsZ irrep_seqr
r
�+modelscope/diffdock/models/tensor_layers.py�
get_irrep_seq s .�
�"�r c C sJ | � d�}d}|D ]}|� d�\}\}}|t|�dt|� d 7 }q |S )Nz + r �x� r )�split�int)ZirrepZirreps�size�ir�m�l�pr
r
r �
irrep_to_size# s 14 r c s$ e Zd Z� fdd�Zdd� Z� ZS )�FasterTensorProductc s t � �� t�|�t�d�ksJ d��t�|�| _t�|�| _ddddd�}ddddd�}| jD ]15\}}||t|�< q0| jD ]16\}}||t|�< q>|d |d |d f|d |d |d |d f|d |d |d |d f|d |d |d fd�| _td d17� | j� � D ��| _18d S ) Nz 1x0e+1x1oz7sh_irreps don't look like 1st order spherical harmonicsr ��0e�1o�1e�0or r r r c s s � | ] \}}|| V qd S )Nr
)�.0�a�br
r
r � <genexpr>C s � z/FasterTensorProduct.__init__.<locals>.<genexpr>) �super�__init__r �Irreps� in_irreps�19out_irreps�str�
weight_shapes�sum�values� weight_numel) �selfr( � sh_irrepsr) �kwargsZin_mulsZout_mulsr r �� __class__r
r r& . s$ 20� � z FasterTensorProduct.__init__c C sP i g g g g d�}}t | j| j�� �D ]2\\}}}|d|f |t|�< |d dkrE|t|� �t|t|� j�d d� ddg �|t|�< q|d |ddd �f } }21d|v rv|d �|d | �d� � |d �|d �d�|22�d23� � d |v r�|d �|d |24�d25� � d�t26� d� � |d �|d | �d��d� � |d �t j
j|d |27�d28�dd �t29� d
� � d |v r�|d �t j
j|d |30�d31�dd �t32� d
� � |d �|d | �d��d� � |d �|d |33�d34� � d�t35� d� � d|v �r |d �|d �d�|36�d37� � |d �|d | �d� � i } d} | jD ]1}
| j|
\}}|d| | || �f �t|j�d d� ||g �t38� |� | |
< | || 7 } �q'|d �r{t j|d dd �|d< t �|d �d39�| d ��d40�|d< |d �r�t j|d d41d �|d < |d �d42�| d �d� � d�|d < |d �t|d j�d d43� dg �|d < |d �r�t j|d d44d �|d < |d �d45�| d �d� � d�|d < |d �t|d j�d d46� dg �|d < |d �r
t j|d dd �|d< t �|d �d47�| d ��d48�|d< g }| jD ]\}}|�|t|� � �qt j|dd �S )Nr .r r ������ ).r r r �����r ��dimr r �����)�zipr( Zslicesr* Zreshape�list�shape�appendZ unsqueezer, �npZsqrt�torchZlinalgZcrossr+ �cat�matmulZsqueezer) )r/ Zin_�shZweightZin_dictZout_dictr r �slZsh_0eZsh_1oZ weight_dict�start�key�out�_r
r
r �forwardE s� �� ","$�$�",49" 50��51��52�*53�*54��zFasterTensorProduct.forward��__name__�55__module__� __qualname__r& rH �
__classcell__r
r
r2 r r , s r �mean� �?c C sz t |tj�s56J d��|j} |j}57|\} } ||��| ��|58�}
|
�|� | || ||
�} |p1|jd }t| | d||d�}|S )z�59 Perform TensorProduct + scatter operation, aka graph convolution.60 61 This function is only for edge_groups == 1. For multiple edge groups, and for larger graphs,62 use tp_scatter_multigroup instead.63 z\This function is only for a single edge group, so edge_attr must be a tensor and not a list.r �r8 Zdim_size�reduce) �64isinstancer? �Tensor�device�dtype�to�mul_r< r )�tp�fc_layer� node_attr�65edge_index� edge_attr�edge_sh� out_nodesrQ � edge_weight�_device�_dtype�edge_src�edge_dstr) rF r
r
r �tp_scatter_simple� s ��66rd rX rY rZ r[ �edge_attr_groupsr] c C s� t |t�s J d��|dv sJ d��|j} |j}67|\} } dd� |D �}
t|
�}||jd ks1J d��t|�}t|d�}|p@|jd }td68d� | jD ��}t j69||f| |70d �}t j71|| |72d �}d }t |�D ]c}|
| }|| }t ||�}| | | | }}t |t
j�r�|| n|}||| �} |r�| �|| � n| �|� | ||d d �f ||d d �f | �} |t| |d |d
d�7 }|t j||d�7 }|}~ ~ qc|dkr�t �|t �|73�j�}||d d �d f }|S )a' 74 Perform TensorProduct + scatter operation, aka graph convolution.75 76 To keep the peak memory usage reasonably low, this function does not concatenate the edge_attr_groups.77 Rather, we sum the output of the tensor product for each edge group, and then divide by the number of edges78 z/This function is only for a list of edge groups> r, rN z.Only 'mean' and 'sum' are supported for reducec S s g | ]}|j d �qS )r )r< )r! Z79_edge_attrr
r
r �80<listcomp>� s z)tp_scatter_multigroup.<locals>.<listcomp>r z<Sum of edge_attr_groups must be equal to edge_index.shape[1]� __getitem__r c S s g | ]}|j �qS r
r7 )r! r r
r
r rf � s )rT rU Nr, rP )Z minlengthrN )rR r; rT rU r, r< �len�hasattr�81irreps_outr? �zeros�range�slice�nn�82ModuleListrW r ZbincountZclampZfinfoZeps) rX rY rZ r[ re r] r^ rQ r_ r` ra rb rc Zedge_attr_lengthsZ83total_rowsZnum_edge_groupsZedge_weight_is_indexableZtotal_output_dimZ final_outZ div_factorsZ cur_start�iiZ84cur_lengthZcur_endZcur_edge_rangeZ cur_edge_srcZ cur_edge_dstZcur_fcZcur_out_irrepsZsummandr
r
r �tp_scatter_multigroup� sH �85 86 87$rq c s@ e Zd Z d� fdd � Z 88 dd d
�Z� ZS )�TensorProductConvLayerT� NFr r �reluc 89 s� t t���� |�_|�_|�_|�_|90�_t|��_ |
�_91�d u r$��|
r�t � |�}t � |�}t � |�}g }g }t
|�D ]1\}\}}t
|�D ]&\}\}}|| D ]}||v rlt|�}|�||f� |�|||ddf� qQqGq=t � |�}|�� \}�}�fdd�|D �}t||||ddd��_t|�� |ddd��_n| r�td� t|||��_n92t j|||dd ��_|93d94kr�t���jj��� ��_n� �����fd d�t |95�D ��_t � �j��_|r�t |��_ d S d �_ d S ) NZuvuTc s( g | ]\}}}}}||� | ||f�qS r
r
)r! Zi_in1Zi_in2Zi_out�modeZtrain)r r
r rf s ��z3TensorProductConvLayer.__init__.<locals>.<listcomp>F)�shared_weights�internal_weights)Z irreps_inrj rw rv zFaster Tensor Product�rv r c s" g | ]
}t ���jj��� ��qS r
)r rX r. )r! rG )�96activation�dropout�hidden_features�n_edge_featuresr/ �tp_weights_layersr
r rf C s ���)!r% rr r& r( r) r0 �residual� edge_groupsr �out_size� depthwiser r' � enumeraterh r= �sortr rX r Zsimplify�linear_2�printr �FullyConnectedTensorProductr r. �fcrl rn ro r �97batch_norm)r/ r( r0 r) r| r~ r� rz r{ Zfasterr r} ry r� Z98irreps_midZ instructions�i�mulZir_in�jrG Zir_edgeZir_out�kr2 )ry rz r{ r| r r/ r} r r& � s� 99100101102 ���103104�� 105��� � z TensorProductConvLayer.__init__rN rO c 106 C s� |j d dkr|j d dkrtd��|j}|j d dkr,tj|j d | jf||jd�} n2| jdkr@t| j | j107|||||||� } nt | j | j108|||||||� } | j rV| �
| �} | jr^| �| �} | jrut�|d| j d |j d f�}109| |110 } | �|�} | S )Nr r zNo edges and no nodes)rU rT r4 )r< �111ValueErrorrU r? rk r� rT r rd rX r� rq r� r� r� r~ �F�padrV ) r/ rZ r[ r\ r] r^ rQ r_ ra rF �paddedr
r
r rH R sJ 112 113� � 114115 116z TensorProductConvLayer.forward) TTrs NFr r rt F�NrN rO rI r
r
r2 r rr � s �j�rr c s2 e Zd Z d117� fdd� Z d dd �Z� ZS ) �OldTensorProductConvLayerTrs Nc 118 s� t t| ��� || _|| _|| _|| _|d u r|}tj|||dd� | _ } t119� t120� ||�t121�
� t122�|�t123� || j��| _|rEt|�| _d S d | _d S )NFrx )r% r� r& r( r) r0 r~ r r� rX rn Z124Sequentialr ZReLUZDropoutr. r� r r� )125r/ r( r0 r) r| r~ r� rz r{ rX r2 r
r r& � s" �126 � z"OldTensorProductConvLayer.__init__rN rO c 127 s� d}� j d } | | dkr| | n| | d }128t�t�| �|129�} � fdd�| D �} t| j| j||| ||||� }
| jrNt� |d|
j d |j d f�}|
| }
| j130rV| �131|
�}
|
� |j �}
|
S )Ni�� r r c s g | ]}� | �qS r
r
)r! Z cur_range�r\ r
r rf � s z5OldTensorProductConvLayer.forward.<locals>.<listcomp>r4 )
r< r> Z array_splitZarangerq rX r� r~ r� r� r� rV rU )r/ rZ r[ r\ r] r^ rQ r_ Zedge_chunk_sizeZ num_edgesZ132num_chunksZ edge_rangesre rF r� r
r� r rH � s4 133 �134�� 135 z!OldTensorProductConvLayer.forward)TTrs Nr� rI r
r
r2 r r� � s � �r� r� )$Zlogging�os�typingr r r Znumpyr> r? Ztorch.nnrn Ztorch.nn.functionalZ136functionalr� Ze3nnr Ze3nn.nnr Ze3nn.o3r r Z
torch_scatterr r137 Zlayersr r r ZModuler rd ro rS rq rr r� r
r
r
r �<module> sL e138�(������139�B