q121/01
0
1a
2 ���gp' � @ sH d dl mZmZmZmZmZ d dlmZmZ ddl m3Z4m Z m Z m
Z
ddlmZ ddlmZmZmZ d dlZd dlZd dlZd dlZd dlZd dlmZ d dlZe� d �Z ej � d5d �� � d kZ!e �"e!r�ej!nej#� e�$e!s�d
nd�Z%e�&ej'�Z(e(�)e%� e �*e(� dD ]Z+e� e+��"ej,� �q e-e-d�dd�Z.dd� Z/e/e_0e� Z1ej � dd��2d�a3t3�sle4d��ej � dd�Z5e6ej � dd ��Z7e6ej � d d ��Z8g a9d d � Z:d!d"� Z;e1�<d#�d$d%� �Z=e1j d&e
d'�d(d)� �Z>ed*�d+d,�Z?e6eed- e@eAd.�d/d0�ZBe1jCd1e d'�ee?�fe7edd2�d3d4��ZDe1�EeF�eeFd5�d6d7��ZGdS )8� )�FastAPI�
HTTPException�Request�Depends�status)� JSONResponse�StreamingResponse� )�ChatCompletionRequest�ChatCompletionResponse�
ErrorResponse� ModelList)� GeminiClient)�handle_gemini_error�protect_from_abuse� test_api_keyN)�LiteralZ8gemini_app�DEBUG�false�truezC[%(key)s]-%(request_type)s-[%(model)s]-%(status_code)s: %(message)szt%(asctime)s - %(levelname)s - [%(key)s]-%(request_type)s-[%(model)s]-%(status_code)s-%(message)s - %(error_message)s)�uvicornzuvicorn.accessz
uvicorn.error)�message�returnc C sT d| � � v rdS d| � � v r dS d| � � v r0dS d| � � v r@dS d | � � v rPd9S | S ) Nzquota exceededu API 密钥配额已用尽zinvalid argumentu 无效参数zinternal server erroru 服务器内部错误zservice unavailableu 服务不可用Zblockedu 请求被阻止)�lower)r � r �D:\gemini\app\main.py�translate_error s r c C sf t | t�r t�| ||� d S tt|��}ddddts8dn|d�}tjd| tsRd n| ||f|d� d S )N�N/A� ��key� request_type�model� status_code�
error_messageu 未捕获的异常: %s��exc_info�extra) �10issubclass�KeyboardInterrupt�sys�__excepthook__r �strr �logger�error)�exc_type� exc_value�
exc_tracebackr$ � log_extrar r r �handle_exception& s 11 r3 ZGEMINI_API_KEYSz+111,AIzaSyCnmiWgVV5El2JAcWbny7HeSaWJg8PrsRk�,u& 请设置 GEMINI_API_KEYS 环境变量�PASSWORDZ123�MAX_REQUESTS_PER_MINUTEZ30�MAX_REQUESTS_PER_DAY_PER_IPZ600c C s t S )u 获取 API 密钥)�api_key_stack_globalr r r r �get_api_key_stack< s r9 c � sr g } t D ]d}t|�I d H }|r"dnd}tjd|d d� � d|� d�|d d� dddd d12�d � |r| �|� q| S ) Nu 有效u 无效zAPI Key �13 z... �.�startupr r r �r' )�API_KEYSr r- �info�append)�available_keysr Zis_validZ14status_msgr r r �15check_keys@ s 8 rB r< c � s� t jddddddd�d� t� I d H } | sLt jddddddd�d� td��| d }t�|�}d d16� |D �t_t jd |d d � � d
�|d d � ddddd�d� | at� � a17t � t18� t jdt
t�� �dddddd�d� d S )Nz Starting Gemini API proxy...r r< r r r= u 没有可用的 API 密钥！r c S s g | ]}|d d� �qS )� Nr ��.0r" r r r �19<listcomp>Y � z!startup_event.<locals>.<listcomp>z#Available models loaded using key: r: z...u 可用 API 密钥数量：)r- r? rB r. �20ValueErrorr Zlist_available_models�AVAILABLE_MODELSr> �copyr8 �random�shuffle�len)rA Zfirst_valid_keyZ21all_modelsr r r �
startup_eventJ s 22223rN z24/v1/models)Zresponse_modelc C s0 t jddddddd�d� tdd � tjD �d25�S ) Nz Received request to list modelsr � list_models�� r r r= c S s g | ]}|d ddd��qS )r" i��dzorganization-owner)�id�object�createdZowned_byr rD r r r rF e rG z list_models.<locals>.<listcomp>)�data)r- r? r
r rI r r r r rO b s rO )�requestc � sP t rL| j�d�}|r |�d�s*tddd��|�d�d }|t krLtddd��d S ) N�
AuthorizationzBearer i� z&Unauthorized: Missing or invalid token�r# Zdetail� r zUnauthorized: Invalid token)r5 �headers�get�26startswithr �split)rU Z auth_header�tokenr r r �verify_passwordg s r^ )�stream�27non-stream)� chat_request� http_requestr! �
api_key_stack� used_keysc
� s� t |tt� �jtjvrNd}tj|d��jdtr4|ndd�d� t t28j |d��|�rl|� � � � |v rfqN|�
� � t� ��� ���fdd �}�jr�t|� d29d �S zX����}td d
d�jdd|d�dd�gd�}tjd� d d� ��jddd�d� |W S t�yh } zXt| �}30d|31� �} tj| t�s*d nd� d d� ��jdt�rH|32ndd�d� W Y d } ~ qNd } ~ 0 0 qNd } tj| d ��jdt�r�| ndd�d� t t33j| d��d S ) Nu 无效的模型r i� r r r= rW c s* zZ�� ��2 zB3 d H W } ddd�jd| d�dd d�gd�}d t�|�� d34�V q 6 d V W n� tjy� tjd � d d
� ��jdtr�dndd�d� Y n� t �y$ } zrt35|�}d|� �}tj |ts�d nd� d d
� ��jdtr�|ndd�d� d t�d|dd�i�� d36�V W Y d }~n37d }~0 0 d S )N�chatcmpl-someidzchat.completion.chunki�� � assistant��role�contentr )�delta�index�
finish_reason�rQ rR rS r" �choiceszdata: z38 39zdata: [DONE]40 41zClient disconnectedr: r u 客户端已断开连接r r r= �API Key failed: T�� r% r. Z gemini_error�r �type) Z stream_chatr" �json�dumps�asyncio�CancelledErrorr- r? r � Exceptionr r. )�chunkZformatted_chunk�e� error_detail� log_message�Zapi_keyra Z
gemini_clientr! r r �stream_generator} s �420436z)process_request.<locals>.stream_generatorztext/event-stream)Z44media_typere zchat.completioni��Ir rf rg �stop)rk r rl rm zRequest successfulr: rP ro Trp r% u' 所有API密钥或重试次数均失败ZALL)r r6 r7 r" r rI r- r. r r r ZHTTP_400_BAD_REQUEST�pop�addr_ r Z
complete_chatr r? rw r � HTTP_500_INTERNAL_SERVER_ERROR)
ra rb r! rc rd Z error_msgr} Zresponse_content�responsery rz r{ �msgr r| r �process_requestp s8 $4546 �$47R&r� z/v1/chat/completions)rU rb �_c � s, t � }t� }t| || jr dnd||�I d H S )Nr_ r` )r9 �setr� r_ )rU rb r� rc rd r r r �chat_completions� s r� )rU �excc � sb t t|��}dddd|d�}tjd|jj� d|� �ts:d nd|d� ttj t48t|�dd �� � d49�S ) Nr rp r zUnhandled exception (z): Tr% Zinternal_errorrq )r# ri ) r r, r- r. � __class__�__name__r r r r� r �dict)rU r� r$ r2 r r r �global_exception_handler� s (r� )HZfastapir r r r r Zfastapi.responsesr r Zmodelsr50 r r r
�geminir �utilsr r r �osrs �loggingr* ru �typingr rK � getLoggerr- �environrZ r r �setLevel�INFO� Formatter� formatter�
StreamHandler�stdoutZstream_handler� setFormatter�51addHandlerZ logger_name�WARNINGr, r r3 �52excepthook�appr\ r> rH r5 �intr6 r7 r8 r9 rB Zon_eventrN rO r^ �listr� r� Zpostr� Zexception_handlerrw r� r r r r �<module> sZ 53 � 54555657 58 /