procgne/Plonk
0
1o
2 �B2gF � @ s� d dl Z d dlmZmZ d dlmZmZmZmZ G dd� d�Z G dd� d�Z3G dd � d �Z G d4d � d �Z G d d
� d
�Z
dd� ZdS )� N)�Sphere�geodesic)�vjp�jvp�vmap�jacrevc @ �$ e Zd Z ddd�Zd dd�ZdS )5�DDPMLoss� �labelc C � || _ || _|| _d S �N�� scheduler�cond_drop_rate�conditioning_key��selfr r r � r �2/home/dufour/Documents/diff_plonk/models/losses.py�__init__ � 6zDDPMLoss.__init__Nc C s |d }|j d }|j}tj|||j|d�}| �|��d�} tj|j |j||d�}7t�| �| t�d| �|8 } | |d< || j } | d urf| j9dkrftj|||d�| j10k }
t� | |
�| |
< | � � || j < | �
d��
d��
d�|d < |||�}||11 d12 }|S � N�x_0r ��device�dtype� generator�����)r r r � �y�r r �gamma� )�shaper �torch�randr r � unsqueeze�randn�sqrtr r �13zeros_like�detach�squeeze�r �preconditioning�network�batchr r �14batch_sizer �tr" �nr � conditioning� drop_mask�D_n�lossr r r �__call__ s( 15 16��17 zDDPMLoss.__call__�r18 r r
��__name__�19__module__� __qualname__r r8 r r r r r �20 21�22r c @ r )23�FlowMatchingLossr24 r c C r r
r r r r r r ) r zFlowMatchingLoss.__init__Nc C s� |d }|j d }|j}tj|||j|d�}| �|��d�} tj|j |j||d�}25| | d| |26 } | |d< || j } | d ur`| j dkr`tj|||d�| j k }
t�27| |
�| |
< | � � || j< | � d�� d�� d�|d < |||�}|||28 d29 }|S r )
r$ r r% r& r r r' r( r r r* r+ r, r- r r r r8 3 s( 3031��32zFlowMatchingLoss.__call__r9 r
r: r r r r r? ( r> r? c @ r )33�RiemannianFlowMatchingLossr34 r c C s$ || _ || _|| _t� | _d| _d S )N� )r r r r �manifold� manifold_dimr r r r r K s35 36z#RiemannianFlowMatchingLoss.__init__Nc s8 |d }|j d }|j}tj|||j|d�}� �|��d�} � j�|j d � j ��37|�}38� fdd�} t | �|39|| �\} }
| � |� j �} |
� |� j �}
| |d< |� j
}|d urw� jdkrwtj|||d�� jk }t�|| �||< |�� |� j
< | �d��d��d�|d < |||�}||
}� j�| ||��� � j }|S )40Nr r r r c s6 t � j| |�}t||ft�|��|�f�\}}||fS r
)r rB r r% � ones_like�to)�x0�x1r2 �path�x_t�u_t�r r r �cond_u_ s z3RiemannianFlowMatchingLoss.__call__.<locals>.cond_ur r! r" )r$ r r% r& r r r' rB � random_baserC rE r �reshaper r r* r+ r, �inner�mean)r r. r/ r0 r �x_1r1 r r2 r" r rL r rJ r4 r5 r6 �diffr7 r rK r r8 W s0 41 42��43z#RiemannianFlowMatchingLoss.__call__r9 r
r: r r r r r@ J s44 45� r@ c @ � e Zd Zddd�Zddd�ZdS ) �
VonFisherLossrA c C �46 || _ d S r
��dim�r rW r r r r x � 47zVonFisherLoss.__init__Nc C sd |d }|||�\}}t �|d �t �t jdt j |jd�� t|� ||| jddd� }| S )Nr �:�0�yE>� )r r T�rW �keepdim)r% �log�tensor�pir �log_sinh�sum) r r. r/ r0 r �x�mu�kappar7 r r r r8 { s ����zVonFisherLoss.__call__�rA r
r: r r r r rT w � 48rT c @ rS ) �VonFisherMixtureLossrA c C rU r
rV rX r r r r � rY z VonFisherMixtureLoss.__init__Nc
C s� |d }|||�\}}}d} t |jd �D ]D}49|d d �|50f } |d d �|51f �d�} | |d d �|52f �d�| t�| | | jddd�d � ddtj dt�d | � 7 } qt�| � S )53Nr r r r Tr\ rZ r# �����)�ranger$ r' r% �exprb r` r^ )
r r. r/ r0 r rc �54mu_mixture�
kappa_mixture�weightsr7 �ird re r r r r8 � s � �� z VonFisherMixtureLoss.__call__rf r
r: r r r r rh � rg rh c C s$ | t �ddt �d| � d � S )NrZ r ri r# )r% r^ rk )rc r r r ra � s $ra )r% �utils.manifoldsr r �55torch.funcr r r r r r? r@ rT rh ra r r r r �<module> s ""-