mydatascraper/competitor_compare
0
1�
2 h/2jo � �\ � S SK JrJrJrJr S SKJr S SKJr S SK J3r4J r S SK J
r
S SKJr S SKr\" SS /S59r\R# S \ S 9\" \5 4S
\6S\S\4S jj5 r\R) S5 \" \5 4S\S\4S jj5 r\R# S5 S\" \5 4S\S\4S jj5 rg)� )� APIRouter�Depends�BackgroundTasks�
HTTPException)� FileResponse)�verify_api_key)�BulkExportRequest�BulkExportResponse)�BulkExportService)�datetimeNz/bulkz Bulk Export)�prefix�tagsz/export)�response_model�request�background_tasks�_api_keyc � � # � [ 5 nU R ( a& U R Vs/ s H oDR PM snOSnU R ( a& U R Vs/ s H ofR PM snOSn UR UUU R7 U R S9n[ SSUR S5 =( d US US8 US S [ R R US 5 3[ R " 5 [ R " 5 S
9$ s snf s snf ! [ a n [ SS[ U 5 3S9eSn A ff = f7f)aC 9Trigger a bulk data export.10 11- **retailers**: Filter to specific retailers (default: all MVP retailers)12- **categories**: Filter to specific categories (default: all)13- **format**: `parquet`, `csv`, or `json`14- **destination**: `local`, `s3`, or `gcs`15 16For S3/GCS delivery, configure credentials in environment variables.17N)� retailers�18categories� file_format� destinationi� zExport failed: �� status_code�detail� � completed�19cloud_path�filepath� record_count�file_size_bytesz/bulk/download/)� export_id�status� file_pathr r � download_url�20started_at� completed_at)r r �valuer �export_full_dataset�formatr � Exceptionr �strr21 �get�os�path�basenamer �utcnow)22r r r �export_service�rr �cr �result�es23 �LC:\Users\sundrani.raza\PycharmProjects\grocery-price-api\app\routers\bulk.py�trigger_bulk_exportr7 s3 � � � '�(�N�8?�8I�8I�'�"3�"3�4�"3�Q���"3�4�t�I�:A�:L�:L�7�#5�#5�6�#5�a�'�'�#5�6�RV�J�P� �3�3� �!� ��� �+�+� 4� 24�� ����*�*�\�*�@�f�Z�.@��N�+� � 0�1�&�r�w�w�'7�'7��z�8J�'K�&L�M��?�?�$� �_�_�&� � �� 5��6�� � P���o�c�!�f�X�4N�O�O��P�sA �*E�D �$E�%D%�:E� &D* �&BE�*25E�4E26�27E�Ez/download/{filename}�filenamec � �@ # � SSK Jn [ R R UR28 U 5 n[ R R
U5 ( d29 [ SSS9eSnU R S5 ( a SnOU R S 5 ( a S30n[ X0US 9$ 7f) z,Download a previously generated export file.r )�settingsi� zExport file not foundr zapplication/octet-streamz.csvztext/csvz.jsonzapplication/json)r8 �31media_type)32�33app.configr: r- r. �join� EXPORT_PATH�existsr �endswithr )r8 r r: r r; s r6 �download_exportrA 7 s� � � � $��w�w�|�|�H� 0� 0�(�;�H�
�7�7�>�>�(� #� #���4K�L�L�+�J����� � � �34� � � �7� #� #�'�35� ��36� K�K�s �B B z/daily-snapshot�localr c � � # � [ 5 nUR U S9nSU[ R " 5 R 5 S.$ 7f)zo37Trigger the daily snapshot export (both Parquet and CSV).38 39This is what would run on the daily cron schedule.40)r r )r" �exports� timestamp)r �export_daily_snapshotr r0 � isoformat)r r r1 �resultss r6 �trigger_daily_snapshotrI L sE � � � '�(�N� �2�2�{�2�K�G� �� �_�_�&�0�0�2� � �s �AA)�fastapir r r r �fastapi.responsesr �app.authr � app.schemasr r41 � app.services.bulk_export_servicer r r- �router�post�dictr7 r, r+ rA rI � � r6 �<module>rT s� �� F� F� *� #� =� >� � � �'� �� 8�� ���Y�'9��:� �^�,�'�
�'�%�'� �'� ;�'�T ��� "�#� �^�,�L��L��L� $�L�( ���
� � � �^�,������ �rS