Lemoni/ERA5_SR
This dataset contains modified Copernicus Climate Change Service information [2026]. Source: ERA5 reanalysis data from the Copernicus Climate Data Store (CDS/ECMWF). Licensed under CC BY 4.0, consistent with the source dataset terms. Dataset Description ERA5 reanalysis data prepared for 4x super-resolution training. The dataset provides paired low-resolution (LR) and high-resolution (HR) atmospheric fields covering 2010–2020. Variables Name Description Units… See the full description on the dataset page: https://huggingface.co/datasets/Lemoni/ERA5_SR.
This dataset contains modified Copernicus Climate Change Service information [2026].
Source: ERA5 reanalysis data from the Copernicus Climate Data Store (CDS/ECMWF).
Licensed under CC BY 4.0, consistent with the source dataset terms.
Dataset Description
ERA5 reanalysis data prepared for 4x super-resolution training. The dataset provides paired low-resolution (LR) and high-resolution (HR) atmospheric fields covering 2010–2020.
Variables
Files
Temporal Coverage
- Period: 2010-01-01 00:00 UTC – 2020-12-31 18:00 UTC
- Interval: 6-hourly
- Total timesteps: 16,072
Super-Resolution Setup
- Scale factor: 4×
- LR resolution: 1.0° × 1.0° (180 × 360 grid)
- HR resolution: 0.25° × 0.25° (720 × 1440 grid, last row at −90° removed for exact 4× divisibility)
- LR was generated from HR using MATLAB-style bicubic downsampling with antialiasing (equivalent to
imresize(HR, 1/4)default settings).
Normalization
train_stats.json contains per-variable min/max computed over the training split (2010–2018). Use it for min-max normalization to [0, 1] before training or evaluation.
from era5_dataset import load_stats, normalize, unnormalize
from era5_dataset import normalize_batch, unnormalize_batch
stats = load_stats() # loads train_stats.json alongside this file
# numpy array or scalar
x_norm = normalize(x, 'msl', stats) # raw → [0, 1]
x_raw = unnormalize(x_norm, 'msl', stats) # [0, 1] → raw
# torch tensor (C, H, W) or (B, C, H, W)
t_norm = normalize_batch(tensor, stats)
t_raw = unnormalize_batch(t_norm, stats)Training-set statistics:
Usage
from era5_dataset import ERA5SRDataset
from torch.utils.data import DataLoader
# normalize=True (default): returns torch.FloatTensor in [0, 1]
ds = ERA5SRDataset(data_dir='/path/to/data', split='train')
loader = DataLoader(ds, batch_size=4, shuffle=True, num_workers=4)
for hr, lr in loader:
# hr: (B, 4, 720, 1440), lr: (B, 4, 180, 360) — normalized to [0, 1]
...
# normalize=False: returns raw np.ndarray in physical units
ds_raw = ERA5SRDataset(data_dir='/path/to/data', split='train', normalize=False)
hr, lr = ds_raw[0] # np.ndarray, raw physical valuesNote:train_stats.jsonmust be present indata_dirwhennormalize=True.
