hololens/stable-diffusion-webui-depthmap-script
1
1o
2 ��fx � @ s| d dl Z d dlZd dlmZ d dlZd dlZd dlmZ d dlm Z d dl3m Z ddd�Z
dd d4�Zdd d
�Zddd�ZdS )� N)�Image)�core)�backbone)�GenerationOptionsFc 5 C s: t �| �j}|�� dkr1g }t�| �}t|j�D ]}|�|� |� |�6d�� qd|j d |fS |�� dkrwddl }ddl
}|�| �}g }|jdd�D ]} | �� D ]}7|8jd d9�} t�| �} |� | � qRqLt|jjd j�}
|�� |
|fS |�� d v r�|r�zSddl }|j| d d
d�}t|�}|d d kr�|d \}}g }|D ]}10tj|11dd�}||f|_|t�|�g7 }q�|d |fW dt � v r�|�� S S W dt � v r�|�� n dt � v r�|�� w w |�� dv r�ddl m } || �}dd� t |� � �D �}|j!|fS z dt�| �gfW S t"�y } zt"d|� ��|�d}~ww )zOTakes the filepath, returns (fps, frames). Every frame is a Pillow Image objectz.gif�RGBi� �durationz.mtsr N)�videoZrgb24)�format)�.avi�gray16le� )�pix_fmtZbits_per_pixelr
�size�uint16)�dtype�fps�gen)z.webmz.mp4r12 )�
VideoFileClipc S � g | ]}t �|��qS � )r � fromarray��.0�xr r �FF:\3dpicmaker\stable-diffusion-webui-depthmap-script\src\video_mode.py�13<listcomp>= � z'open_path_as_images.<locals>.<listcomp>� z%Probably an unsupported file format: )#�pathlib�Path�suffix�lowerr �open�range�n_frames�seek�append�convert�info�imageio_ffmpeg�avZdemux�decodeZ14to_ndarrayr �float�streamsr Z average_rate�closeZ read_frames�next�np�15frombuffer�shape�localsZ moviepy.video.io.VideoFileClipr �listZ iter_framesr � Exception)�path�maybe_depthvideor �frames�img�ir) r* � containerZpacket�frameZ numpy_frame�imager r Z16video_info�width�height�resultr �clip�er r r �open_path_as_images
sp 1718 19 20 � 21 2223��24 �25�26� 27��rC c C s4 |d j dkrAdd l}|jtj�||� d��|d jdd| ddd�}z|�d � |D ]28}|�t� |�� q*W |�29� d S |�30� w dd � |D �}dd31l m } | || d �}32d } g d
�} |r`t
| �} | D ]/\}
}z"|dvrp|� d�nd }|33jtj�||� d|
� ��||d� d} W n t�� Y qb| s�td��d S )Nr zI;16r34 r Zffv1r )�codecZmacro_block_sizec S r r )r0 �asarray)r r< r r r r T r z#frames_to_video.<locals>.<listcomp>)�ImageSequenceClip)r F))�avi�png)rG �rawvideo)�mp4�libx264)�webmZlibvpx)rH rI �k�.)rD �bitrateTzSaving the video failed!)�moder) Z write_frames�osr6 �joinr �sendr0 �arrayr. Z"moviepy.video.io.ImageSequenceCliprF �reversedZwrite_videofile� traceback� print_excr5 )r r8 r6 �name�colorvids_bitrater) �writerr< �arrsrF rA �done�priorityZv_formatrD �brr r r �frames_to_videoG s< "�35� $ �r_ �nonec s� d dd�}t d� |dkr|� �S |dkr^g }� fdd�}tt� ��D ]'}t�� | �}tg d��D ]\}}||� |||d � 7 }q2||g7 }q#t�t�|�d36d g�\} }37|� | |38�S � S )
Nc S sd g }|dur|nt dd� | D ��}|dur|ntdd� | D ��}| D ]
}||| || g7 }q"|S )zYNormalizes objs, but uses (a, b) instead of (minimum, maximum) value of objs, if suppliedNc S � g | ]}|� � �qS r )�min�r �objr r r r k � z?process_predicitons.<locals>.global_scaling.<locals>.<listcomp>c S ra r )�maxrc r r r r l re )rb rf )�objs�a�b�39normalized� min_value� max_valuerd r r r �global_scalingh s z+process_predicitons.<locals>.global_scalingz Processing generated depthmapsr` � experimentalc s t td| �t� �d �S )Nr r )rb rf �len)�val�� predictionsr r �<lambda>w s z%process_predicitons.<locals>.<lambda>)皙�����?皙�����?g�������?ru rt � g �?g �X@)NN)�printr# ro r0 �40zeros_like� enumerate�41percentile�stack) rr � smootheningrm � processedrA r: �f�u�mulrh ri r rq r �process_predicitonsg s 42 r� c 43 s� |t jj�� s|t jj�� rdS ttj�| j��\}}tj t44� � dd� |d u rqt d� t j
t jt jt jt jt jg�dd� �D ���fdd�|�� D �}d|t j< d |t jj< t�d |d d |�} d45d� t| �D �}46t|47|�}48n+t d � ttj�|j�dd �\} }49t|50�t|�ks�J d
��|51d j|d jkr�t d� t d� tt�d ||52d |��} tt t dd� | ���}
t d� |
D ]+� � dkr�|d ur�q�� fdd�| D �}� � d�}t |||dt53� ||�� d|� �|� q�t d� t|
�dkr�dS t|
�dkr�d S d S ) Nz_Creating mesh-videos is not supported. Please split video into frames and use batch processing.T)�exist_okz)Generating depthmaps for the video framesc S s g | ]}|j �� �qS r )rX r! r r r r r � r z gen_video.<locals>.<listcomp>c s i | ] \}}|� v r||�qS r r )r rM �v)� needed_keysr r �54<dictcomp>� s z gen_video.<locals>.<dictcomp>Fc S s g | ]}|d �qS )rv r r r r r r � re zUsing custom depthmap video)r7 z>Custom depthmap video length does not match input video lengthr zCWarning! Input video size and depthmap video size are not the same!zGenerating output framesc S s | d S )Nr r )r r r r rs � s zgen_video.<locals>.<lambda>z(Saving generated frames as video outputs�depthc s g | ] }|d � kr|d �qS )r rv r r )r r r r � s Z_videoz depthmap-�-zAll done. Video(s) saved!r z<h3>Videos generated</h3>z<h3>Video generated</h3>zD<h3>Nothing generated - please check the settings and try again</h3>) �go�GEN_SIMPLE_MESHrX r! �GEN_INPAINTED_MESHrC rQ r6 �abspath�makedirsr � get_outpathrw �COMPUTE_DEVICE�55MODEL_TYPE�BOOST�NET_SIZE_MATCH� NET_WIDTH�56NET_HEIGHT�itemsZDO_OUTPUT_DEPTH_PREDICTION�DO_OUTPUT_DEPTHr �core_generation_funnelr4 r� ro r �set�mapr_ �get_next_sequence_number)r �outpath�inp�custom_depthmaprY r| r Z input_imagesZfirst_pass_inp�gen_objZ input_depthsZcdm_fps� img_resultsZgensZimgs�basenamer )r r� r � gen_video� sF 57 58 � �r� )F)N)r` )NNr` )r rV �PILr �numpyr0 rQ �srcr r �src.common_constantsr r� rC r_ r� r� r r r r �<module> s 5960:61