Juliabelloni/weather-forecasting
0
1�
2 "!g� � �R � d dl m Z d dlZd dlZd dlZddlmZ G d� de� � ZdS )� )�datetimeN� )�LoadABCc �Z � e Zd Zdedefd�Zdedej fd�Zde dededej fd �Z3d4S ) � LoadWeather�line�returnc �p � |� d� � }|D ]�}|� � � }|� d� � r2|dd� � ddd� � � � � }n;|� � � � ddd� � � � � }|s�� dS dS )z�Check if a line is numeric.5 6 Args:7 line (str): The line to check.8 9 Returns:10 bool: True if the line is numeric, False otherwise.11 �,�-r N�.� T)�split�strip�12startswith�replace�isdigit)�selfr �parts�part�
stripped_part�
part_is_digits �L/Users/juliabelloni/Desktop/ML_industry/ML4IProject/src/data/load_weather.py�_is_numeric_linez LoadWeather._is_numeric_line s� � � �13�14�3����� � �D� �J�J�L�L�M� �'�'��,�,�
K� +�A�B�B� /� 7� 7��R�� C� C� K� K� M� M�
�
� $�15�16� � � 4� 4�S�"�a� @� @� H� H� J� J�
� �
���4�4� � � �txt_filec � � d}|� � � }t |� � D ]!\ }}| � |� � r|dz17 } n�"t j t j d� ||d� � � � � d�� � }|S )z�18 Convert a .txt file to a pandas DataFrame.19 20 Args:21 txt_file (str): The contents of the .txt file as a string.22 23 Returns:24 pd.DataFrame: The DataFrame of the numeric data.25 Nr �26r )�sep)�27splitlines� enumerater �pd�read_csv�io�StringIO�join)r r � start_idx�lines�ir �dfs r �28_txt_to_dfzLoadWeather._txt_to_df# s� � � � ��#�#�%�%�� ��'�'� � �G�A�t��$�$�T�*�*�
� ��E� ���
� �[���T�Y�Y�u�Y�Z�Z�/@�%A�%A�B�B��
L�
L�
L��� r �29station_id�30start_date�end_datec � � d}t j |� � � d� � }t j |� � � d� � }||d|dd�}t j ||�� � }|j dk rBd|� d |� d31|� �} | j � | � � � | � |j � � }32|33S t d |j � �� � �)
a� 34 Retrieves data from the KNMI website for a given station and time period.35 36 Args:37 station_id (int): The id of the station to retrieve data from.38 start_date (str): The start date of the data to retrieve (inclusive).39 end_date (str): The end date of the data to retrieve (inclusive).40 41 Returns:42 pd.DataFrame: The DataFrame containing the retrieved data.43 44 Raises:45 KeyError: If the request fails.46 z8https://www.daggegevens.knmi.nl/klimatologie/daggegevensz%Y-%m-%d�ALL�csv)�start�end�vars�stns�fmt)�data�� z(Data successfully retrieved for station z from z to )�info_strzFailed to retrieve data: ) r �
fromisoformat�strftime�requests�post� status_code�_logs� load_logsr+ �text�KeyError) r r, r- r. �url�start_date_str� end_date_str�params�responser9 r* s r �get_datazLoadWeather.get_data7 s� � � I�� "�/�47�;�;�D�D�Z�P�P�� �.�x�8�8�A�A�*�M�M� � $� �� �� 48� 49�� �=��6�2�2�2�� � �3� &� &�v�*�v�v�Tb�v�v�ht�v�v�H� �J� � �H� � 5� 5� 5�� � �� �/�/�B��I��M�x�7K�M�M�N�N� Nr N) �__name__�50__module__� __qualname__�str�boolr r" � DataFramer+ �intrH � r r r r s� � � � � � ��C� �D� � � � �.�#� �"�,� � � � �(&O�3� &O�C� &O�3� &O�2�<� &O� &O� &O� &O� &O� &Or r )r r$ r< �pandasr" �load_abcr r rP r r �<module>rS s� �� � � � � � � � � � � ���� � � � � � � � � � �TO� TO� TO� TO� TO�'� TO� TO� TO� TO� TOr