Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch ARCO-ERA5 to update daily with a ~5 day delay #82

Open
shoyer opened this issue Aug 7, 2024 · 3 comments
Open

Switch ARCO-ERA5 to update daily with a ~5 day delay #82

shoyer opened this issue Aug 7, 2024 · 3 comments

Comments

@shoyer
Copy link
Collaborator

shoyer commented Aug 7, 2024

Currently, ARCO-ERA5 is updated monthly with a 3 month delay. This matches when the "final" version of ERA5 is available, ~2 months delayed.

However, there is also a preliminary version of ERA5 called ERA5T, which is updated daily with a ~5 day delay. In theory, ERA5T could look different from the final version of ERA5, but according to ECMWF this has only happened once.

In practice, I think we could safely update ARCO-ERA5 to update much more frequently, which would be quite useful for downstream operations. Let's look into this after solving the current race condition involved with resizing datasets: #81

@dgilford
Copy link

Quick note to check my own understanding. Which specific files are updated monthly with that delay?

@shoyer
Copy link
Collaborator Author

shoyer commented Aug 19, 2024

I think all of the Zarr files listed in the README should be updated with that cadence.

@sahildabhi0101
Copy link

sahildabhi0101 commented Aug 30, 2024

@shoyer @dgilford One small correction: All of the zarr file which mentioned into the readme.md except this 'gs://gcp-public-data-arco-era5/ar/model-level-1h-0p25deg.zarr-v1' are updated on monthly cadence.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants