E4DRR/gik-gefs-par

GIK-GEFS-PAR: Virtual Reference Parquets for NOAA GEFS Ensemble Forecasts Lightweight parquet reference files that turn 24+ GB of daily NOAA GEFS GRIB data into ~250 MB of monthly virtual references, enabling Dask-based parallel analysis without downloading the raw GRIBs. What These Parquets Do Each reference contains [zarr_key, [s3_url, byte_offset, byte_length]] tuples pointing into NOAA GEFS GRIB files on AWS S3 (s3://noaa-gefs-pds/). Instead of downloading… See the full description on the dataset page: https://huggingface.co/datasets/E4DRR/gik-gefs-par.