3.86 TB
75,314 files
Updated 1 day ago
Name
Size
1deg-8layer-6hourly
1deg-8layer-daily
4deg-8layer-daily
climatological-forcing
normalization-stats
LICENSE117 Bytes
xet
README.md3.64 kB
xet
README.md

ACE2S-ERA5 reference data

This bucket contains the ERA5 reanalysis datasets used in training and evaluating models described in the ACE2S-ERA5 manuscript. Each dataset is a zarr store derived from ERA5 reanalysis data, regridded to the indicated resolution and vertically interpolated to 8 pressure levels using the ACE data pipeline. We refer readers to the ACE2 and ACE2S-ERA5 papers for details on the data processing.

Directory Description Resolution Timestep Time range
1deg-8layer-daily Daily ERA5 store for 1° daily models (training and evaluation) 1° (180×360) 24 h (00Z snapshots + daily-mean diagnostics) 1940-01-03 through 2025-01-01
1deg-8layer-6hourly 6-hourly ERA5 store for 1° 6h models (training and evaluation) 1° (180×360) 6 h 1940-01-01 through 2025-01-01
4deg-8layer-daily Daily ERA5 store for 4° daily models (training and evaluation) 4° (46×90) 24 h (00Z snapshots + daily-mean diagnostics) 1940-01-03 through 2025-01-01
normalization-stats Global-mean centering and standard-deviation scaling files (1990–2019 climatology) for network input/output normalization 1° and 4° — —
climatological-forcing/1deg-daily 30-year (1991–2020) climatological SST, sea ice, and CO₂ forcing for 1° daily 1000-year free-running simulations 1° (180×360) 24 h Repeating annual cycle
climatological-forcing/1deg-6hourly As above, for 1° 6-hourly 1000-year runs 1° (180×360) 6 h Repeating annual cycle
climatological-forcing/4deg-daily As above, for 4° daily 1000-year runs 4° (46×90) 24 h Repeating annual cycle

Variables

Each store contains the following 8 pressure-level fields (interpolated to approximately 50, 100, 200, 300, 500, 700, 850, and 1000 hPa):

  • air_temperature_{0..7} — temperature
  • specific_total_water_{0..7} — specific total water (vapor + condensate)
  • eastward_wind_{0..7} — zonal wind
  • northward_wind_{0..7} — meridional wind

Plus surface and diagnostic fields including PRESsfc, TMP2m, UGRD10m, VGRD10m, PRATEsfc, surface_temperature, sea_ice_fraction, ocean_fraction, land_fraction, HGTsfc, DSWRFtoa, global_mean_co2, and radiative fluxes. The daily stores additionally include daily-mean variants (e.g. TMP2m_mean, PRATEsfc_mean).

Opening data with xarray

With the huggingface_hub Python package installed, you can open these datasets directly with xarray:

import xarray as xr

STORE = "hf://buckets/allenai/ACE2S-ERA5-reference-data/1deg-8layer-daily/era5-1deg-8layer-daily-1940-2025.zarr"
ds = xr.open_zarr(STORE, chunks={"time": 360})

The chunks={"time": 360} argument overrides the native inner chunk size along the time dimension (which is 1 for optimal training performance) to the shard size for more efficient analytical reads.

License

This dataset is licensed under CC BY 4.0. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines.

The underlying ERA5 data is provided by the Copernicus Climate Change Service (C3S) and is subject to the Copernicus licence.

Total size
3.86 TB
Files
75,314
Last updated
Nov 19
Pre-warmed CDN
US EU US EU

Contributors