Aditya02/IndicF5
4425
1o
2 3�g� � @ s� d dl mZ d dlZd dlZd dlmZ d dlmZ d dlZd dl m3Z4 d dl Z d dl m
Z
mZ d;dd�Zd d5� Zd d � Zd<d=dd�Zd>dd�Zd?d d �Zd<d@d!d"�ZdAdBd'd(�Z #dAdCd,d-�ZdDdEd1d2�Ze �� ed3� dFd5d6�ZdGd9d:�Z dS )H� )� annotationsN)� defaultdict)�files�� pad_sequence)� lazy_pinyin�Stylec C sR t �| � t| �tjd< t�| � tj�| � tj�| � dtj j6_ dtj j7_ d S )NZPYTHONHASHSEEDTF)
�random�seed�str�os�environ�torch� manual_seed�cuda�manual_seed_all�backends�cudnn�
deterministic� benchmark)r8 � r �?/projects/data/ttsteam/repos/f5_hf/models/f5_tts/model/utils.py�seed_everything s 910 11r c C s | d uS �Nr )�vr r r �exists s r c C s t | �r| S |S r )r )r �dr r r �default# s r �t�int['b']�length�12int | None�return� bool['b n']c C s@ t |�s| �� }tj|| jd�}|d d d �f | d d �d f k S �N��device)r �amaxr �aranger& )r r �seqr r r � lens_to_mask* s r* �seq_len�start�endc C sh | � � �� }tj||jd��� }|d d d �f |d d �d f k}|d d d �f |d d �d f k }||@ S r$ )�max�itemr r( r& �long)r+ r, r- � max_seq_lenr) Z13start_maskZend_maskr r r �mask_from_start_end_indices2 s14 r2 � frac_lengths�15float['b']c C sF || � � }| | }t�|�}|| � � jdd�}|| }t| ||�S )Nr ��min)r0 r � rand_like�clampr2 )r+ r3 �lengthsZ max_start�randr, r- r r r �mask_from_frac_lengths: s 16 r; �float['b n d']�mask� float['b d']c C sl t |�s17| jdd�S t�|d d �d d �d f | tjd| jd��} | jdd�}|�� jdd�}||jdd� S )N� )�dimg r% g �?r5 ) r �meanr �where�tensorr& �sum�floatr8 )r r= �num�denr r r �maybe_masked_meanE s , rH ������text� list[str]� int['b nt']c C s dd� | D �}t ||dd�} | S )Nc S s g | ] }t �g t|d ����qS )�UTF-8)r rC �bytes��.0r r r r �18<listcomp>R s z&list_str_to_tensor.<locals>.<listcomp>T��
padding_value� batch_firstr )rJ rS Z list_tensorsr r r �list_str_to_tensorQ s rU �list[str] | list[list[str]]�vocab_char_map�dict[str, int]c s$ � fdd�| D �}t ||dd�} | S )Nc s$ g | ]}t �� fd d�|D ���qS )c s g | ]}� � |d ��qS �r )�get)rP �c�rW r r rQ ] s z.list_str_to_idx.<locals>.<listcomp>.<listcomp>)r rC rO r\ r r rQ ] s $ z#list_str_to_idx.<locals>.<listcomp>TrR r )rJ rW rS Zlist_idx_tensorsr r\ r �list_str_to_idxX s r] �pinyin� tokenizerr c C s( |dv rRt j�td��d�| � d|� d��}t|ddd��}i }t|�D ] \}}|||d d19� < q$W d � n1 s;w Y t|�}|d d ksNJ d
��||fS |dkr^d }d}||fS |dkr�t| ddd��}i }t|�D ] \}}|||d d20� < qpW d � n1 s�w Y t|�}||fS )aI 21 tokenizer - "pinyin" do g2p for only chinese characters, need .txt vocab_file22 - "char" for char-wise tokenizer, need .txt vocab_file23 - "byte" for utf-8 tokenizer24 - "custom" if you're directly passing in a path to the vocab.txt you want to use25 vocab_size - if use "pinyin", all available pinyin types, common alphabets (also those with accent) and symbols26 - if use "char", derived from unfiltered character & symbol counts of custom dataset27 - if use "byte", set to 256 (unicode byte range)28 )r^ �char�f5_ttsz29../../data�_z30/vocab.txt�rzutf-8)�encodingNrI � r zHmake sure space is of idx 0 in vocab.txt, cuz 0 is used for unknown char�byte� �custom)r �path�joinr �joinpath�open� enumerate�len)� dataset_namer_ Ztokenizer_path�frW �ir` �31vocab_sizer r r �
get_tokenizere s0 32$� �
� �� �rs z,Word segmentation module jieba initialized.33Tc 34 C sN g }t �dddddd��}dd� }| D ]�}g }|�|�}t�|�D ]}}tt|d��}|t|�krG|rA|dkrA|d d35vrA|�d � |�|� q!|rs|d t|� krst |t36j d
d�} t |�D ]\}37} || �rj|�d � |�| |38 � q]q!|D ](} t
| �dk r�|�| � qu|| �r�|�d � |�t | t39j d
d�� qu|�| � quq!|�|� q|S )N�,�"�')�;u “u ”u ‘u ’c S s d| ko dkS S )Nu u 鿿r )r[ r r r �40is_chinese� s ��z*convert_char_to_pinyin.<locals>.is_chineserM r? rI z :'"re � T)�styleZ tone_sandhirg )r � maketrans� translate�jieba�cutrn rN �append�extendr r ZTONE3rm �ord) � text_listZ polyphone�final_text_listZ custom_transrx rJ Z char_list�segZ seg_byte_len�seg_rq r[ r r r �convert_char_to_pinyin� s> �41 42 43� 44 � r� � �45 c C sf t t�}tt| �| d �D ]}| ||| � }|| d7 < q|�� D ] \}}||kr0 dS q%dS )Nr? TF)r �int�rangern �items)rJ r � toleranceZ
pattern_countrq �pattern�countr r r �repetition_found� s �r� rY r )r r r r! r" r# )r+ r r, r r- r )r+ r r3 r4 )r r< r= r# r" r> )rI )rJ rK r" rL )rJ rV rW rX r" rL )r^ )r_ r )T)r� r� ) �46__future__r r r � collectionsr �importlib.resourcesr r �torch.nn.utils.rnnr r} Zpypinyinr r r r r r* r2 r; rH rU r] rs �47initialize�printr� r� r r r r �<module> s0 48
4950 51 �
#52+