TurneR0und/etl-dashboard

implementing async

removing json imports- - adding to the top of the file instead

updating from print() statements to logging setup

updated get_data_for_region to allow sqlite or postgresql for testing pipeline

Refactor test client setup and enhance database handling in API tests

Update README and add API tests

missed import redis

adding back indexhtml

Switching to redis caching

Implementing a cache clear mechanism

Fix for space owner on hf

Fix for pushing to Hugging face spaces

adding redis caching

add pytest

Refactor ETL pipeline to include data validation using Pydantic, enhance error handling, and update requirements for improved dependency management.

Refactor database handling to use environment variables for configuration, improve error handling, and streamline data processing in ETL pipeline. Update requirements for PostgreSQL support.

Refactor database path resolution and enhance error handling in API endpoints. Add health check endpoint and improve caching for root responses.

Refactor database initialization and API endpoints to improve error handling, streamline database path resolution, and enhance data retrieval efficiency.

Refactor index.html to enhance loading state management, improve error handling, and ensure the region selection dropdown is disabled until data is loaded.

Refactor index.html to improve UI elements, enhance loading and error handling, and update chart configuration for better data visualization.

Enhance error handling in API endpoints and add health check endpoint. Update database connection logic to support multi-threading.

Refactor database path resolution to improve flexibility and ensure writable directory options. Update logic to handle multiple fallbacks for database file location.

Refactor Dockerfile and configuration to use environment variable for database path, ensuring persistence in container environments. Update README and API calls for clarity on configuration.

Update .gitignore to include IDE settings and ensure proper formatting

Refactor data fetching and cleaning logic to improve error handling, column renaming, and data selection in the ETL pipeline.

Refactor database configuration to use a writable directory for the database in container environments

Refactor initialize_database function to streamline database creation by removing old file handling and clarifying ETL pipeline execution.

Refactor initialize_database function to ensure a fresh database on startup by removing the old database file and re-running the ETL pipeline.

Refactor api.py to implement database initialization, enhance endpoint functionality, and improve data retrieval logic.

Update .gitignore to include compiled Python files and refactor api.py for Docker compatibility

Update Dockerfile to correct exposed port to 7860 and enhance comments for clarity

Refactor api.py to update TABLE_NAME to 'uk_hpi_cleaned', enhance middleware comments, and improve endpoint documentation.

Fix app_file reference in README.md to point to api.py

Remove unused app_port variable from README.md and refine project description for clarity and extendability.

Update README.md to include additional metadata for SDK version, app file, and pinned status

Refactor README.md for improved formatting and clarity; add project notes and enhance feature descriptions.

Add initial README.md with project overview, setup instructions, and project structure

Fix typo in Hugging Face remote URL in deployment step

Update GitHub Actions workflow to enhance repository checkout and deployment steps for improved functionality

Update GitHub Actions workflow to use latest versions of checkout and Hugging Face action for improved compatibility and stability

Update Hugging Face action version and correct repo ID in deployment step

Add GitHub Actions workflow for Python ETL CI/CD pipeline

adding the actions workflow file

Initial commit of ETL project