hymenjj/llama-cpp-python-prebuilt
0
1�
2 00�i� � � � d dl mZ d dlZd dlmZmZmZmZmZm Z m3Z4m Z m Z d dl
Z
d dlmZmZmZmZ d dlmZ d dlmZmZ erd dlmZ dZej � d� � Z e �C e
j ej � ej � e!� � � � � � d z n e
j � � Z" eee"� � Z# ee#� � Z$ ed5e%� � Z&e Z' G d � d e � � Z( e$d
ej) e'ge� � d0d�� � Z* e$de'e e6e� � eg e7e(� � � � d1d�� � Z+ e$d e'eeg e8e(� � � � d2d �� � Z, e$d e9e(� � gd� � d3d"�� � Z- e$d#ej) e10e(� � e e11e� � ge� � d4d'�� � Z. e$d(eege'� � d5d,�� � Z/ e$d-e'gd� � d6d/�� � Z0dS )7� )� annotationsN) �c_bool�c_char_p�c_int�c_uint8�c_float�c_void_p�POINTER�_Pointer� Structure)�Union�NewType�Optional�
TYPE_CHECKING)�load_shared_library�"ctypes_function_for_shared_library)� CtypesArray�llava�
LLAVA_CPP_LIB�lib�12clip_ctx_pc �0 � e Zd Zd ee� � fdefgZdS )�llava_image_embed�embed� n_image_posN)�__name__�13__module__� __qualname__r14 r r �_fields_� � �>/usr/local/lib/python3.11/site-packages/llama_cpp/llava_cpp.pyr r < s/ � � � � � � �'�'�'�"�"�#� �� ��H�H�Hr! r �llava_validate_embed_size� ctx_llama�llama_cpp.llama_context_p�ctx_clip�return�boolc � � d S �Nr )r$ r& s r" r# r# E � � � �Cr! �!llava_image_embed_make_with_bytes� n_threads�Union[c_int, int]� image_bytes�CtypesArray[c_uint8]�image_bytes_length� '_Pointer[llava_image_embed]'c � � d S r* r )r& r- r/ r1 s r" r, r, R s � � �Cr! �$llava_image_embed_make_with_filename�15image_path�bytesc � � d S r* r )r& r- r5 s r" r4 r4 c r+ r! �llava_image_embed_freer c � � d S r* r )r s r" r8 r8 p � � ��Cr! �llava_eval_image_embed�n_batch�n_past�'_Pointer[c_int]'c � � d S r* r )r$ r r< r= s r" r; r; w s � �" �Cr! �clip_model_load�fname� verbosity�Optional[clip_ctx_p]c � � d S r* r )rA rB s r" r@ r@ � s � � �Cr! � clip_free�ctxc � � d S r* r )rF s r" rE rE � r: r! )r$ r% r& r r' r( )16r& r r- r. r/ r0 r1 r. r' r2 )r& r r- r. r5 r6 r' r2 )r r2 )17r$ r% r r2 r< r. r= r> r' r( )rA r6 rB r. r' rC )rF r )1�18__future__r �os�ctypesr r r r r r r19 r r �pathlib�typingr
r r r �llama_cpp.llama_cpp� llama_cpp� llama_cpp._ctypes_extensionsr r r �_libllava_base_name�environ�get�_libllava_override_path�Path�path�abspath�dirname�__file__�_libllava_base_path� _libllava�ctypes_function�intr �clip_ctx_p_ctypesr �llama_context_p_ctypesr# r, r4 r8 r; r@ rE r r! r" �<module>r_ s �� "� "� "� "� "� "� � � � �20� 21� 22� 23� 24� 25� 26� 27� 28� 29� 30� 31� 32� 33� 34� 35� 36� 37� 38� 39� 40� 41� ����� � � � � � � � � � � � (� '� '� '� '� '�� � � � � � � �42 � �� � � � � � � � �*�.�.� �9�9� �Zq�Zy�l�g�l�2�7�?�?�2�7�?�?�8�3L�3L�#M�#M�N�N�QV�V�V� @L� @G� @L� @N� @N� �
� � 3�5H� I� I� �4�4�Y�?�?�� �W�\�3�
'�
'�43� � �� � � � � � � � � � � ��%�'8�9�44�� �45� � � � �46� � �'���w�w�w� /� /��7� �G� � � �� �47� � � � �48� � �*���x�(� �G� � � �� �49� � � � �50� � �)�G�G�4E�,F�,F�+G��N�N�� � � O�N�� � � ��(���!�"�"�
������ � � � �� � � � ��" � �"�X�u�$5�7H�I�I�� � � J�I�� � �� 0� 1�4�8�8�� � � 9�8�� � r!