Aluode/PerceptionLabPortable
0
1o
2 0�Yi�= � @ s� d dl Z d dlZd dlZd dlmZ d dlmZ ddlm Z ddl3m Z m Z dd� Z
dd d4�Zd d � ZG d
d� d�ZG dd� de�ZG dd� de �ZdS )� N)�Optional� )�TrainerCallback)�IntervalStrategy�5has_lengthc C sZ t | �} | d | d d | d }}}|dkr$|� d|d�d|d��S |d�d|d��S )z$Format `t` (in seconds) to (h):mm:ssi �< r �:�02d)�int)�t�h�m�s� r ��E:\DocsHouse\542 percep lab latest\PerceptionLab\PerceptionLab_Portable\python_embed\Lib\site-packages\transformers/utils/notebook.py� format_time s 2r �, c C s$ d|� d| � d|� d|� d|� d� S )Nz6 <div>7 z8 <progress value='z' max='z' style='width:z<px; height:20px; vertical-align: middle;'></progress>9 z10 </div>11 r )�value�total�prefix�label�widthr r r �html_progress_bar! s �����r c C s� d}|d7 }| d D ]12}|d|� d�7 }q13|d7 }| dd� D ]$}|d 7 }|D ]}t |t�r2|d14�nt|�}|d |� d �7 }q'|d
7 }q |d7 }|S )z*Put the texts in `items` in an HTML table.z%<table border="1" class="dataframe">15z* <thead>16 <tr style="text-align: left;">17r z18 <th>z</th>19z </tr>20 </thead>21 <tbody>22� Nz <tr>23z.6fz24 <td>z</td>25z26 </tr>27z </tbody>28</table><p>)�29isinstance�float�str)�items� html_code�i�line�eltr r r �text_to_html_table, s 30r" c @ s~ e Zd ZdZdZdZ ddedee d e d31ed d ef32d
d�Z33d dede dee fdd�Z d dd�Z dd� Z
dd� ZdS ) �NotebookProgressBara� 34 A progress par for display in a notebook.35 36 Class attributes (overridden by derived classes)37 38 - **warmup** (`int`) -- The number of iterations to do at the beginning while ignoring `update_every`.39 - **update_every** (`float`) -- Since calling the time takes some time, we only do it every presumed40 `update_every` seconds. The progress bar uses the average time passed up until now to guess the next value41 for which it will call the update.42 43 Args:44 total (`int`):45 The total number of iterations to reach.46 prefix (`str`, *optional*):47 A prefix to add before the progress bar.48 leave (`bool`, *optional*, defaults to `True`):49 Whether or not to leave the progress bar once it's completed. You can always call the50 [`~utils.notebook.NotebookProgressBar.close`] method to make the bar disappear.51 parent ([`~notebook.NotebookTrainingTracker`], *optional*):52 A parent object (like [`~utils.notebook.NotebookTrainingTracker`]) that spawns progress bars and handle53 their display. If set, the object passed must have a `display()` method.54 width (`int`, *optional*, defaults to 300):55 The width (in pixels) that the bar will take.56 57 Example:58 59 ```python60 import time61 62 pbar = NotebookProgressBar(100)63 for val in range(100):64 pbar.update(val)65 time.sleep(0.07)66 pbar.update(100)67 ```� g�������?NTr r r �leave�parent�NotebookTrainingTrackerr c C s` || _ |d u r dn|| _|| _|| _|| _d | _d | _d | _d | _d | _ dt68j v r.d| _ d S d S )N� Z69VSCODE_PIDg �?)
r r r% r& r �70last_value�comment�outputr r �os�environ� update_every)�selfr r r% r& r r r r �__init__e s 7172�z NotebookProgressBar.__init__Fr � force_updater* c C s� || _ |dur73|| _| jdu r1t�� | _| _| | _| _d | _| _| j | _74d| _ | � |� dS || jkr:|s:dS |sM| j75dksM|t
| j| j | j�kr�| j76dkrY| j77d8 _78t�� }|| j | _|| jkrr| j|| j | _nd| _|| jkr�| j}d| _| js�| �� n| jdur�| j| j| | _| � |� || _|| _| jdu s�| jdkr�d| _ dS tt| j| j �d�| _ dS dS )a� 79 The main method to update the progress bar to `value`.80 81 Args:82 value (`int`):83 The value to use. Must be between 0 and `total`.84 force_update (`bool`, *optional*, defaults to `False`):85 Whether or not to force and update of the internal state and display (by default, the bar will wait for86 `value` to reach the value it predicted corresponds to a time of more than the `update_every` attribute87 since the last update to avoid adding boilerplate).88 comment (`str`, *optional*):89 A comment to add on the left of the progress bar.90 Nr r )r r* r) �time�91start_timeZ last_timeZ start_value� elapsed_time�predicted_remaining�warmupZ first_calls�wait_for�92update_bar�minr �average_time_per_itemr% �close�maxr93 r. )r/ r r1 r* � current_timer r r �update{ sF 94 &95 9697�9899100 �zNotebookProgressBar.updatec C s dt t| j��t t|�� t|� }| jd u r$d|� d| j� d�| _nH| jd u r:d|� d| j� dt| j�� �| _n2d|� d| j� dt| j�� dt| j�� �| _| jdkr]| jd7 _n| jdd | j d101�d �7 _| j| jd u s{t | j�dkr}d nd| j� d �7 _| � � d S )
N� �[�/z : < :z < r z , +inf it/sz, r �.2fz it/s�])102�lenr r r4 r r5 r r: r* �display)r/ r r* Z spaced_valuer r r r8 � s &103104" ��105 4 z NotebookProgressBar.update_barc C sr t | j| j| j| j| j�| _| jd ur| j�� d S | j d u r-t106jt107� | j�dd�| _ d S | j � t108� | j�� d S �NT)Z109display_id)
r r r r r r r r& rE r+ �disp�HTMLr> �r/ r r r rE � s 110111112 zNotebookProgressBar.displayc C s2 | j du r| jdur| j�t�d�� dS dS dS )zCloses the progress bar.Nr( )r& r+ r> rG rH rI r r r r; � s �zNotebookProgressBar.close)NTNr )FN�N)�__name__�113__module__� __qualname__�__doc__r6 r. r114 r r �boolr0 r> r8 rE r; r r r r r# = s. $�����115� 1163 r# c sD e Zd ZdZd� fdd� Zdd� Zdd� Zdd117d �Zd d
� Z� Z S )r' a� 118 An object tracking the updates of an ongoing training with progress bars and a nice table reporting metrics.119 120 Args:121 num_steps (`int`): The number of steps during training. column_names (`list[str]`, *optional*):122 The list of column names for the metrics table (will be inferred from the first call to123 [`~utils.notebook.NotebookTrainingTracker.write_line`] if not set).124 Nc s* t � �|� |d u r d n|g| _d | _d S rJ )�superr0 � inner_table� child_bar)r/ Z num_steps� column_names�� __class__r r r0 � s 125z NotebookTrainingTracker.__init__c C s� t | j| j| j| j| j�| _| jd ur | jt| j�7 _| j d ur+| j| j j7 _| j126d u r>t j t �
| j�dd�| _127d S | j128�t �
| j�� d S rF )r r r r r r r rQ r" rR r+ rG rE rH r> rI r r r rE � s 129130131 z NotebookTrainingTracker.displayc s | j du rt��� �t��� �g| _ dS | j d }�D ] }||vr&|�|� q|| j d< t| j �dkrx| j d }| j d d }|d �| krV| j ��fdd�|D �� dS �� |D ]}|� vri||�|� � |< qZ� fdd�|D �| j d< dS | j ��fdd�|D �� dS ) z�132 Write the values in the inner table.133 134 Args:135 values (`dict[str, float]`): The values to display.136 Nr r �����c s g | ]}� � |d ��qS )zNo Log)�get��.0�c��valuesr r �137<listcomp> s z6NotebookTrainingTracker.write_line.<locals>.<listcomp>c � g | ]}� | �qS r r rX )�138new_valuesr r r] � c r^ r r rX r[ r r r] r` )rQ �list�keysr\ �appendrD �index)r/ r\ �columns�key� last_values� first_columnrZ r )r_ r\ r �139write_line� s( 140 141142�143144 � z"NotebookTrainingTracker.write_liner c C s t ||| |d�| _| jS )a� 145 Add a child progress bar displayed under the table of metrics. The child progress bar is returned (so it can be146 easily updated).147 148 Args:149 total (`int`): The number of iterations for the child progress bar.150 prefix (`str`, *optional*): A prefix to write on the left of the progress bar.151 width (`int`, *optional*, defaults to 300): The width (in pixels) of the progress bar.152 )r r& r )r# rR )r/ r r r r r r � add_child s 153z!NotebookTrainingTracker.add_childc C s d| _ | �� dS )z0154 Closes the child progress bar.155 N)rR rE rI r r r � remove_child s z$NotebookTrainingTracker.remove_childrJ )Nr )156rK rL rM rN r0 rE ri rj rk �
__classcell__r r rT r r' � s 157
r' c @ sV e Zd ZdZdd� Zdd� Zdd� Zdd d158�Zd d � Zdd
d�Z ddd�Z159dd� Z dS )�NotebookProgressCallbackz�160 A [`TrainerCallback`] that displays the progress of training or evaluation, optimized for Jupyter Notebooks or161 Google colab.162 c C s d | _ d | _d| _d S )NF)�training_tracker�prediction_bar�_force_next_updaterI r r r r0 & s 163z!NotebookProgressCallback.__init__c K sX |j tjkrdnd| _d| _d| _| jgdg }|j tjkr#|�d� t|j |�| _164d S )N�Epoch�Stepr �
Training Loss�Validation Loss) �
eval_strategyr �EPOCHrh Z
training_lossZlast_log�NOrc r' Z max_stepsrn )r/ �args�state�control�kwargsrS r r r �on_train_begin+ s 165z'NotebookProgressCallback.on_train_beginc K sV t |j�|jkr
t |j�n|jd�}| jj|jd d|� d|j� �| jd� d| _d S )NrB r �Epoch rA �r* r1 F)r166 �epochrn r> � global_step�num_train_epochsrp )r/ rx ry rz r{ r r r r � on_step_end4 s $�167z$NotebookProgressCallback.on_step_endNc K sj t |�sd S | jd u r)| jd ur| j�t|��| _ntt|��| _| j�d� d S | j�| jjd � d S )Nr )r ro rn rj rD r# r> r )r/ rx ry rz Zeval_dataloaderr{ r r r �on_prediction_step= s 168169z+NotebookProgressCallback.on_prediction_stepc K s | j d ur170| j �� d | _ d S rJ )ro r; �r/ rx ry rz r{ r r r �171on_predictI s 172173174z#NotebookProgressCallback.on_predictc K sB |j tjkr d|v r d|d i}|j|d< | j�|� d S d S d S )N�lossrs rr )ru r rw r� rn ri )r/ rx ry rz Zlogsr{ r\ r r r �on_logN s175 176�z NotebookProgressCallback.on_logc K s\ | j d ur�ddd�}t|j�D ]}d|v r |d |d< nq| jdkr+t|j�|d< n|j|d< d}|D ]} | �d�rBt� d d177| �}q4|�178d d �}179|�180d d �}181|�182|� d
�d �}183|�184|� d�d �}185|�186|� d�d �}187|�188|� d�d �}189|� � D ]!\} } | � d�} d�
dd� | dd � D ��}
|
dkr�d}
| ||
< qw| j �|� | j �� d | _d| _d S d S )NzNo log)rs rt r� rs rq rr �evalZ_lossz\_loss$r( Z190total_flosr Z_runtimeZ_samples_per_secondZ_steps_per_secondZ_jit_compilation_time�_r? c S s g | ]}|� � �qS r )�191capitalize)rY �partr r r r] n r` z8NotebookProgressCallback.on_evaluate.<locals>.<listcomp>r ZLossrt T)rn �reversedZ log_historyrh r192 r r� �endswith�re�sub�popr �split�joinri rk ro rp )r/ rx ry rz Zmetricsr{ r\ �logZmetric_key_prefix�kr� �vZsplits�namer r r � on_evaluateV s@ 193194 �195196197� 198 199 200201�z$NotebookProgressCallback.on_evaluatec K s2 | j j|jdt|j�� d|j� �dd� d | _ d S )Nr} rA Tr~ )rn r> r� r202 r r� r� r r r � on_train_endy s �203z%NotebookProgressCallback.on_train_endrJ ) rK rL rM rN r0 r| r� r� r� r� r� r� r r r r rm s 204 205206 #rm )r )r, r� r2 �typingr �IPython.displayrE rG Ztrainer_callbackr Z
trainer_utilsr r r r r" r# r' rm r r r r �<module> s 207 N