scrapegoat/Neural-Audio-Codec
2
1a
2 �!Pf$! � @ sF d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl3m m Z d dlm
Z d dlZd dlZd dlZd dlZd dlZd dlZe�d� d dlmZ dd� Zd(dd�Zd d4� Zd d � Z d
d� Z dd� Z d)dd�Z dd� Z dd� Z!G dd� de"�Z#d*dd�Z$d+e%e%d �d d �Z&d,d d �Z'd-d#d$�Z(d.d&d'�Z)dS )/� N)� distributedZAggc C sF t jdd�\}}|j| dddd�}t j||d� |j�� t �� |S )N)�5 � )�figsize�auto�lower�none)Zaspect�origin�
interpolation)�ax)�plt�subplotsZimshowZcolorbar�canvas�draw�close)� spectrogram�figr Zim� r �>/scratch/buildlam/codeclm/jiahaopan/codec_final/utils/utils.py�plot_spectrogram s 6�7r Fc C sP | dur4t �| � tj �| � t�| � tj�| � |rLdtjj_ t8� d� dS )z�9 Function that sets seed for pseudo-random number generators in:10 pytorch, numpy, python.random11 12 Args:13 seed: the integer value seed for global random state14 NTz�You have chosen to seed training. This will turn on the CUDNN deterministic setting, which can slow down your training considerably! You may see unexpected behavior when restarting from checkpoints.) �random�seed�np�torch� manual_seed�cuda�manual_seed_all�backends�cudnn�
deterministic�warnings�warn)r Zcudnn_deterministicr r r �seed_everything" s 15 16 17r" c C s18 t � dkS �Nr )�get_rankr r r r �19is_primary8 s r% c C s t �� s dS t �� sdS t �� S r# )�dist� is_available�is_initializedr$ r r r r r$ < s20 r$ c C s6 t | ��}t�|�}W d � n1 s(0 Y |S �N)�open�yaml� full_load)�path�f�configr r r �load_yaml_configE s 21(r0 c C sT |� d�sJ �t|d��(}|�t�| �� |�� W d � n1 sF0 Y d S )Nz.yaml�w)�endswithr* �writer+ �dumpr )r/ r- r. r r r �save_config_to_yamlK s r5 c C s t j| t|d�|d� d S )Nr1 )�indent)�jsonr4 r* )�dr- r6 r r r �save_dict_to_jsonR s r9 c C s t �t| d��S )N�r)r7 �loadr* )r- r r r �load_dict_from_jsonV s r< c s� t � fdd�t� �D ��}t|d���}|�d�tj�� |�d�tjj� � �� |�d� |�t22t j �� |�d� t
|�� �D ]"\}}|�dt23|�t24|�f � q�|�� W d � n1 s�0 Y d S ) Nc 3 s& | ] }|� d �s|t� |�fV qdS )�_N)�25startswith�getattr)�.0�name��argsr r � <genexpr>[ � z write_args.<locals>.<genexpr>�az==> torch version: {}26z==> cudnn version: {}27z ==> Cmd:28z 29==> args:30z %s: %s31)�dict�dirr* r3 �formatr � __version__r r �version�str�sys�argv�sorted�itemsr )rC r- Z args_dict� args_file�k�vr rB r �32write_argsZ s 3334 rT c @ sN e Zd Zdd� Zdd� Zddd�Zdd � Zd35d � Zd d
� Zdd� Z dd� Z36dS )�Loggerc C s� || _ |j| _t� | _| jr�tj| jdd� tj�| jd�| _tj| jdd� tj�| jd�}t ||� tj�| jd�}tj�37|�s�tj|dd� t tj�|d�d�| _ |j
r�| �d� tjj
j|d �| _nd | _d S )38NT)�exist_ok�configszargs.txtZlogszlog.txtrF zusing tensorboard)�log_dir)rC rX Zsave_dirr% �os�makedirsr- �join�39config_dirrT �existsr* � text_writer� tensorboard�log_infor �utilsZ
SummaryWriter� tb_writer)�selfrC � file_namerX r r r �__init__h s" 40 41zLogger.__init__c C s | j r t|tj�| jd�� d S )Nz config.yaml)r% r5 rY r- r[ r\ )rc r/ r r r � save_config� s zLogger.save_configTc C sb | j s42|s^t|� | j r^t|�}t�d�}d�||�}|�d�sH|d7 }| j�|� | j� � d S )Nz%Y-%m-%d-%H-%Mz{}: {}�43)44r% �printrL �time�strftimerI r2 r^ r3 �flush)rc �infoZ
check_primaryZtime_strr r r r` � s 4546 47 zLogger.log_infoc K s& | j r"| jdur"| jjf i |�� dS �zLog a scalar variable.N)r% rb �48add_scalar�rc Zkargsr r r rn � s 49zLogger.add_scalarc K s& | j r"| jdur"| jjf i |�� dS rm )r% rb � add_scalarsro r r r rp � s 50zLogger.add_scalarsc K s& | j r"| jdur"| jjf i |�� dS rm )r% rb � add_imagero r r r rq � s 51zLogger.add_imagec K s& | j r"| jdur"| jjf i |�� dS rm )r% rb �52add_imagesro r r r rr � s 53zLogger.add_imagesc C s | j r| j�� | j�� d S r) )r% r^ r rb )rc r r r r � s 54z Logger.closeN)T) �__name__�55__module__� __qualname__re rf r` rn rp rq rr r r r r r rU g s 56 rU � c C s� t dd� | �� D ��d d }d|� d|d�d�S ]$}||�� |�� 7 }||�� 7 }q2d}d}| �� D ]$}||�� |�� 7 }||�� 7 }qh|| d d }d|� d|d�d�S )57Nc s s | ]}|� � V qd S r) )�numel)r@ �pr r r rD � rE z!cal_model_size.<locals>.<genexpr>g �@zModel size of z: z.3fz MBr i )�sum�58parameters�nelement� element_size�buffers) �modelrA Zall_sizeZ59param_sizeZ param_sum�param� buffer_sizeZ60buffer_sum�bufferr r r �cal_model_size� s r� )�obj_path�default_obj_pathc C sb | � dd�}t|�dkr"|�d�n|} |d }t�| �}t||�sXtd|� d| � d���t||�S )a� Extract an object from a given path.61 Args:62 obj_path: Path to an object to be extracted, including the object name.63 e.g.: `src.trainers.meta_trainer.MetaTrainer`64 `src.models.ada_style_speech.AdaStyleSpeechModel`65 default_obj_path: Default object path.66 67 Returns:68 Extracted object.69 Raises:70 AttributeError: When the object does not have the given named attribute.71 72 �.� r zObject `z` cannot be loaded from `z`.)�rsplit�len�pop� importlib�
import_module�hasattr�AttributeErrorr? )r� r� Z
obj_path_list�obj_name�73module_objr r r �load_obj� s 7475r� c s t | t�r&� ���fdd�| �� D �S t�| �r`t | t�s`t| �� ���fdd�t�| �D �� S t | t�r�t| �tur�t| �� ���fdd�| D �� S t | ttf�r�t| �� ���fdd�| D ��S t | t j76�r�t t �
| ����� �S t | t j��r| ����� �S | S dS ) z'Change the device of object recursivelyc s" i | ]\}}|t |���� ��qS r �� to_device)r@ rR rS ��copy�device�dtype� non_blockingr r �77<dictcomp>� s z to_device.<locals>.<dictcomp>c s g | ]}t |���� ��qS r r� �r@ rS r� r r �78<listcomp>� s �z to_device.<locals>.<listcomp>c s g | ]}t |���� ��qS r r� )r@ �or� r r r� � rE c 3 s | ]}t |���� �V qd S r) r� r� r� r r rD � rE z to_device.<locals>.<genexpr>N)�79isinstancerG rP � dataclasses� is_dataclass�type�astuple�tuple�listr �ndarrayr� r �80from_numpy�Tensor�to)�datar� r� r� r� r r� r r� � s* 81���� r� �pthr c C sP t t�| �j�d|� ���}t|�|kr@dd� |d | � D � t�|| � d S )Nz*.c S s g | ]}t �|��qS r )rY �remove)r@ �cr r r r� � rE z#save_checkpoint.<locals>.<listcomp>)rO �pathlib�Path�parent�globr� r �save)�filepath�obj�extZ
num_ckpt_keepZckptsr r r �save_checkpoint� s r� �ckpt_c C s8 t j�| |d �}t�|�}t|�dkr,d S t|�d S )Nz ????????.pthr �����)rY r- r[ r� r� rO )Zcp_dir�prefix�patternZcp_listr r r �scan_checkpoint� s82 83 r� )F)N)rv )rv )NNFF)r� r )r� )*r� r� r� r �numpyr r r rY ri Ztorch.utils.tensorboardra r_ r r& rM r+ r7 �rer� �84matplotlibZuseZmatplotlib.pylabZpylabr r r" r% r$ r0 r5 r9 r< rT �objectrU r� rL r� r� r� r� r r r r �<module> sB 85 86 87
G8889 90