fred-dev/comfy_ui_ali
0
1�
2 ���g? � � � d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dl m3Z4 e5rd dl m Z d dl
mZ d dlmZ d� Zd� Zdd �Zd6� Zd � Zddd �Zd
� Zddd�Zd� Zdd�Zy)� )� annotationsN)�
TYPE_CHECKING)� ModelPatcher)� BaseModel)� ControlBasec �` � t j j | |� j |� S �N)�comfy�utils� reshape_mask�to)�7noise_mask�shape�devices �`/Users/fredrodrigues/Library/CloudStorage/Dropbox/Code/comfyui_hardware/comfy/sampler_helpers.py� prepare_maskr s$ � � �;�;� #� #�J�� 6� 9� 9�&� A�A� c �l � g }| D ], }||v s�t || t � r ||| z
}�$||| gz
}�. |S r )�8isinstance�list)�cond�9model_type�models�cs r �get_models_from_condr sK � �
�F�
�� ��?��!�J�-��.��!�J�-�'���1�Z�=�/�)�� � �Mr c �~ �� g }| D ]D }d|v r%|d j D ] }|j |� � d|v s�1|j |d � �F d�fd� �g }t |� }|D ] } �||� �
t j j10 j
|� }|�"|j D ] }|j |� � |S )N�hooks�controlc � �� | j �|j | j � | j �|S �| j |� S r )� extra_hooks�append�previous_controlnet)�cnet�_list�get_extra_hooks_from_cnets �r r% z6get_hooks_from_cond.<locals>.get_extra_hooks_from_cnet% sE �� � � � � '� �L�L��)�)� *� � #� #� +��L�(��)A�)A�5�I�Ir )r# r r$ r )r �addr! �setr11 � HookGroup�combine_all_hooks) r �12full_hooks�cnetsr �hook�13hooks_list� base_cnetr r% s @r �get_hooks_from_condr/ s� �� � !�E�
�� �a�<��'�14�(�(�����t�$� )� ��>� �L�L��9� � &� �J� �J� ��J�E�� �!�)�Z�8� ��+�+�'�'�9�9�*�E�K�� � �%�%�D� �N�N�4� � &� �r c �� � g }| D ]a }|d j � }|j di � }|d �|d |d< ||d< t j � |d< |j |� �c |S )N� � model_condsr �15cross_attn�uuid)�copy�getr4 �uuid4r! )r �outr �tempr2 s r � convert_condr: 7 st � �16 �C�
����t�y�y�{���h�h�}�b�1� � �Q�4� �!"�1��D� � � )��]���z�z�|��V� � �17�18�4�� � �Jr c �H � g }g }g }| D ]8 }|t | | d� z
}|t | | d� z
}|t | | d� z
}�: t |� }d}g }|D ]) } || j � z
}|| j |� z
}�+ |D �19cg c] }20|21d �� }}22||z |z } | |fS c c}23w )z'loads additional models in conditioningr �gligen�additional_modelsr r1 )r r' �24get_models� inference_memory_requirements) �conds�dtyper+ r< �25add_models�k� control_nets�inference_memory�control_models�m�xr s r �get_additional_modelsrI C s� � � !�E�
�F��J�
��
�%�e�A�h� �:�:���&�u�Q�x��:�:���*�5��8�5H�I�I�26� �27 �u�:�L����N�
���!�,�,�.�(���A� ;� ;�E� B�B�� � #�
#�F�q�a��d�F�F�
#�
�f�
$�z�
1�F� �#� #�#�� $s � B c �� � g }| �\d| v rX| d }|j t j j j � D ] }|j |j � � |S )z7loads additional models from registered AddModels hooks�registered_hooks)�get_typer28 r � EnumHookType�AdditionalModels�extendr )�
model_optionsr �29registeredr, s r �(get_additional_models_from_model_optionsrR [ s] � �
�F�� �%7�=�%H�,9�:L�,M�30� �'�'�� � �(@�(@�(Q�(Q�R�D� �M�M�$�+�+� &� S� �Mr c �L � | D ] }t |d� s�|j � �! y)z*cleanup additional models that were loaded�cleanupN)�hasattrrT )r rG s r �cleanup_additional_modelsrV e s � �
�� �1�i� �
�I�I�K� r c � � d }t || j � � \ }}|t |� z
}|| j � z
}| j |d dz gt |dd � z � |z }| j |d gt |dd � z � |z }t j j | g|z ||�� | j }|||fS )Nr � r1 )�memory_required�minimum_memory_required)31rI � model_dtyperR � get_nested_additional_modelsrY r r32 �model_management�load_models_gpu�model) r_ � noise_shaper@ rP �33real_modelr rE rY rZ s r �prepare_samplingrb l s� � � �J� 4�U�E�<M�<M�<O� P� �F� �34�6�}�E�E�F�35�e�0�0�2�2�F��+�+�[��^�a�-?�,@�4� �TU�TV��CX�,X�Y�\l�l�O� #� 3� 3�[��^�4D�t�K�XY�XZ�O�G\�4\� ]�`p� p�� ���*�*�E�7�V�+;�_� wN�*� O����J� �u�f� $�$r c �x � t |� g }| D ] }|t | | d� z
}� t t |� � y )Nr )rV r r' )r@ r �control_cleanuprC s r �cleanup_modelsre x s> � � �f�%��O�
���/��a��)�D�D�� � �c�/� 2�3r c � � t j j � }|D ] }t || |� � t j j | j � |d d< t j j | j � |d d< t j j � }t j j t j j j � }|j t j j j � D ] }|j | |||� � |j t j j j � D ] }|j | |||� � | j! ||||� t# |� dkD r||d< |j% di � }dD ]: } t j j' |j% | i � |d | d� � �< |S )36z%37 Registers hooks from conds.38 �transformer_options�wrappers� callbacksr rK �to_load_options)rh ri F)�39copy_dict1)r40 r r( r/ �patcher_extension�copy_nested_dictsrh ri �create_target_dict�EnumWeightTarget�ModelrL rM �TransformerOptions�add_hook_patchesrN �register_all_hook_patches�len�41setdefault�merge_nested_dicts)42r_ r@ rP r rC rQ � target_dictr, rj �wc_names43 r �prepare_model_patcherry � s� � �44
�K�K� !� !� #�E�
���E�!�H�e�,� � 8=�7N�7N�7`�7`�af�ao�ao�7p�M�'�(��4�8=�8O�8O�8a�8a�bg�bq�bq�8r�M�'�(��5����&�&�(�J��+�+�0�0����1M�1M�1S�1S�T�K����u�{�{� 7� 7� J� J�K�� � � �e�]�K��L� L� ���u�{�{� 7� 7� H� H�I�� � � �e�]�K��L� J� 45�#�#�E�;�
�z�R�46�:����,6�
�(�)�!.�!9�!9�:K�R�!P�O�,��
� � �2�2�?�3M�3M�g�WY�3Z�\i�j� ]A� BI� ]J�?D� 3� F� -� �r )r* zcomfy.hooks.HookGroupr )rP z dict[str])r_ r )r_ z'ModelPatcher'rP �dict)�47__future__r r4 �comfy.model_managementr48 � comfy.conds� comfy.utils� comfy.hooks�comfy.patcher_extension�typingr �comfy.model_patcherr �comfy.model_baser �comfy.controlnetr r r r/ r: rI rR rV rb re ry � r r �<module>r� s\ �� "� � � � � � � ��0�*�,�B���849�$�0��50%�4� r