Aluode/PerceptionLabPortable
0
1o
2 .�Yi� � @ s� d dl mZ d dlZd dlmZmZmZ ddlmZm Z m3Z4 e5� e �Z
dededed ed6ed f7d d
�Zd ededefdd�Zdedefdd�Zddefdd�ZdS )� )�OptionalN)�8Discussion�HfApi�get_repo_discussions� )� cached_file�http_user_agent�logging�api�model_id�pr_title�token�returnr c C sl | j ||d�d j}t||d�D ]#}|j|kr3|jdkr3|jr3| j ||j|d�}||d jkr3| S qd S )N�r
r )Zrepo_idr
�open��revisionr
r )Zlist_repo_commits� commit_idr �title�statusZis_pull_requestZ
git_reference)r9 r r r
Z main_commitZ10discussionZcommits� r ��E:\DocsHouse\542 percep lab latest\PerceptionLab\PerceptionLab_Portable\python_embed\Lib\site-packages\transformers/safetensors_conversion.py� previous_pr s �r �privatec C s� t �d� d}|� d�}dd� }d||| gi}tj|d|d��� }|d }tj|� d11|� �dd ��9} z t �d � || � W n tyY }12 zt �d
t |13�� �� W Y d }14~15n
d }16~17ww W d � d S W d � d S 1 smw Y d S )Nz;Attempting to convert .bin model on the fly to safetensors.z$https://safetensors-convert.hf.spacez /call/runc S s~ | � � D ]8}|�� }|�d�r7|dd � }t�d|� �� |dkr$ d S |dkr.t�d� qt�d|� �� qt�|� qd S )Nzevent:� z Safetensors conversion status: Zcomplete� heartbeatZ HeartbeatzUnknown status )�18iter_lines�decode�19startswith�logger�debug)Z_sse_connection�liner r r r �start s 20 �z spawn_conversion.<locals>.start�dataT)�stream�json�event_id�/)r$ z*Spawning safetensors automatic conversion.zError during conversion: )21r �info�requests�postr% �getr � Exception�warning�repr) r
r r Z safetensors_convert_space_urlZsse_urlr" r# �resultr& Zsse_connection�er r r �spawn_conversion s& 222324 ����"�r1 c K s� | � |�j}t�d� d}|�d�}t| |||d�}|d u s%|s4|jdkr4t|||� t| |||d�}nt�d� d|j� �}|S )Nz(Attempting to create safetensors variantz*Adding `safetensors` variant of this modelr
r Z SFconvertbotzSafetensors PR existszrefs/pr/) Z25model_infor r r( r+ r �authorr1 �num)r26 r �kwargsr r r
�pr�shar r r �get_conversion_pr_reference: s 2728 29 r7 F� pretrained_model_name_or_pathc 30 K s� zDt |�d�dt� id�}t|| fi |��}|d u r W dS ||d< |d= |j| d||�d�d�}|r4dnd }t| |fi |��}|||fW S ty[ } z |sP|�W Y d }~d S d }~ww )31Nr
z32user-agent)r
�headers)NNr Z _commit_hashz model.safetensors.index.jsonr zmodel.safetensors)r r+ r r7 Z file_existsr r, ) r8 Z ignore_errors_during_conversionZcached_file_kwargsr33 r6 Zsharded�filenameZresolved_archive_filer0 r r r �auto_conversionQ s, � ���r; )F)�typingr r) Zhuggingface_hubr r r �utilsr r r Z34get_logger�__name__r �strr �boolr1 r7 r; r r r r �<module> s 35" #