datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
hilam-kerchunkhrrr-kerchunkThis dataset is comprised of the output from kerchunk's scan_grib across the entire AWS-hosted HRRR forecast files, including pressure levels, surface, and sub-hourly, but not native levels.
Each grib message is its own json file, and each init time is its own zip containing the whole extracted json files for all the forecast times for that init time. Once the kerchunk extraction is
complete, the plan is to combine them so that they can be opened in a single call to Xarray as one very large… See the full description on the dataset page: https://huggingface.co/datasets/jacobbieker/hrrr-kerchunk.gk2a-kerchunkgrib-index-kerchunk-templatestags:
zarr
AWS S3 NOAA GEFS and ECMWF IFS made into refrences and stored as template paraquet file
This template helps in recreate The zarr tree (dimension names, chunk layouts, coordinate schemas).
Cloned from https://huggingface.co/datasets/Nishadhka/gfs_s3_gik_refs
Based on the methods discussed in https://github.com/icpac-igad/grib-index-kerchunk
gfs-kerchunkhimawari8-kerchunkhimawari9-kerchunkgdas-kerchunk