Aluode/PerceptionLabPortable
0
1o
2 ��Yi# � @ s� d dl Z d dlZd dlZd dlZd dlZd dlmZmZ d dlZddl m3Z4 ddl m Z e�
d�ZG dd� de5�Zd d6� Zd d � ZdS )
� N)�S_ISDIR�S_ISLNK� )�AbstractFileSystem��infer_storage_optionsz fsspec.sftpc s� e Zd ZdZdZ� fdd�Zdd� Zedd� �Ze d d7� �Z8d&d
d�Z d'dd�Z dd� Z
dd� Ze d(dd��Zd)dd�Zd(dd �Zd d � Zd*d d!�Zd"d#� Zd$d%� Z� ZS )+�SFTPFileSystemz�Files over SFTP/SSH9 10 Peer-to-peer filesystem over SSH using paramiko.11 12 Note: if using this with the ``open`` or ``open_files``, with full URLs,13 there is no way to tell if a path is relative, so all paths are assumed14 to be absolute.15 )�sftp�sshc sB | j rdS t� jdi |�� |�dd�| _|| _|| _| �� dS )a� 16 17 Parameters18 ----------19 host: str20 Hostname or IP as a string21 temppath: str22 Location on the server to put files, when within a transaction23 ssh_kwargs: dict24 Parameters passed on to connection. See details in25 https://docs.paramiko.org/en/3.3/api/client.html#paramiko.client.SSHClient.connect26 May include port, username, password...27 N�temppathz/tmp� )�_cached�super�__init__�popr �host�28ssh_kwargs�_connect)�selfr r �� __class__r ��E:\DocsHouse\542 percep lab latest\PerceptionLab\PerceptionLab_Portable\python_embed\Lib\site-packages\fsspec/implementations/sftp.pyr s zSFTPFileSystem.__init__c C sP t �d| j� t�� | _| j�t�� � | jj| jfi | j �� | j�29� | _ d S )Nz Connecting to SFTP server %s) �logger�debugr �paramikoZ SSHClient�clientZset_missing_host_key_policyZ
AutoAddPolicy�connectr Z open_sftp�ftp�r r r r r 2 s30 31zSFTPFileSystem._connectc C s t |�d S )N�pathr )�clsr r r r �_strip_protocol9 s z SFTPFileSystem._strip_protocolc C s$ t | �}|�dd � |�dd � |S )Nr �protocol)r r )Zurlpath�outr r r �_get_kwargs_from_urls= s z$SFTPFileSystem._get_kwargs_from_urlsT�� c C sR | � |�}t�d|� | �|�rtd|� ���|r | �|� d S | j�||� d S )NzCreating folder %s�
File exists: )r! r r �exists�FileExistsError�makedirsr �mkdir)r r Zcreate_parents�moder r r r* D s 32 33zSFTPFileSystem.mkdirFc C s~ | � |�r|std|� ���|�d�}|d d� dkr dnd}|D ]}|r<|r.|� d|� �n|}| � |�s<| j�||� q!d S )Nr& �/� � )r' r( �splitr r* )r r �exist_okr+ �parts�new_path�partr r r r) O s 3435��zSFTPFileSystem.makedirsc C s& | � |�}t�d|� | j�|� d S )NzRemoving folder %s)r! r r r �rmdir�r r r r r r4 \ s 36 zSFTPFileSystem.rmdirc C s( | � |�}| �| j�|��}||d< |S )N�name)r! � _decode_statr �stat)r r r8 r r r �infoa s 37zSFTPFileSystem.infoNc 38 C s� t | j�rd}n39t| j�rd}nd}d| j|| j| jtjj| jtj j40d�tjj| j tj j41d�d�}|r@d� |�
d�| jg�|d< |S ) N� directory�link�filer. )�tz)r6 �size�type�uid�gid�time�mtimer, r6 )r �st_moder �st_size�st_uid�st_gid�datetime�
fromtimestamp�st_atime�timezone�utc�st_mtime�join�rstrip�filename)r8 � parent_path�tr# r r r r7 g s( 424344�45��
zSFTPFileSystem._decode_statc sP �� � �� t�d� � � �fdd��j�� �D �}|r |S dd� |D �}t|�S )NzListing folder %sc s g | ]}�� |� ��qS r )r7 ��.0r8 �r r r r �46<listcomp>� s z%SFTPFileSystem.ls.<locals>.<listcomp>c S s g | ]}|d �qS )r6 r rS r r r rV � s )r! r r r Z listdir_iter�sorted)r r �detail�stats�pathsr rU r �ls� s 47 zSFTPFileSystem.lsc K s* | � |�}t�d||� | j�||� d S )NzPut file %s into %s)r! r r r �put)r �lpath�rpath�callback�kwargsr r r r\ � s 48zSFTPFileSystem.putc K s4 | � |�rtj|dd� d S | j�| �|�|� d S )NT)r0 )�isdir�osr) r �getr! )r r^ r] r` r r r �get_file� s 49zSFTPFileSystem.get_file�rbc K s� t �d|� |�dd�du r@d�| jtt�� �g�}| jj |||r#|ndd�}||_||_50| |_ t �
t|�|_t �
t|�|_|S | jj |||rI|ndd�}|S )z�51 block_size: int or None52 If 0, no buffering, if 1, line buffering, if >1, buffer that many53 bytes, if None use default from paramiko.54 zOpening file %sZ55autocommitTFr, �����)�bufsize)r r rc rN r �str�uuid�uuid4r �open�56targetpath�fs�types�57MethodType�
commit_a_file�commit�discard_a_file�discard)r r r+ �58block_sizer` Zpath2�fr r r �_open� s �zSFTPFileSystem._openc C s* | � |�r
| j�|� d S | j�|� d S �N)ra r r4 �remover5 r r r �_rm� s 59zSFTPFileSystem._rmc C s4 | � |�}| � |�}t�d||� | j�||� d S )NzRenaming %s into %s)r! r r r Z posix_rename)r �old�newr r r �mv� s 6061zSFTPFileSystem.mv)Tr% )Fr% rw )F)re N)�__name__�62__module__� __qualname__�__doc__r" r r � classmethodr! � staticmethodr$ r* r) r4 r9 r7 r[ r\ rd rv ry r| �
__classcell__r r r r r s* 63646566
6768 6970r c C s | j �| j| j� d S rw )rm r| r rl r r r r rp � s rp c C s | j �| j� d S rw )rm ry r r r r r rr � s rr )rH �loggingrb rn ri r8 r r r r. r �utilsr � getLoggerr r rp rr r r r r �<module> s 71 '