Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Storing IODC, RSS, 0 Degree EUMETSAT data in GCP #42

Open
jacobbieker opened this issue Dec 13, 2023 · 0 comments
Open

Add Storing IODC, RSS, 0 Degree EUMETSAT data in GCP #42

jacobbieker opened this issue Dec 13, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@jacobbieker
Copy link
Member

We got approval to put more satellite imagery in our v4 bucket to be available in Google Public Datasets. I think we should add then the IODC data, and the 15 minutely full-disk 0 degree data as well.

Detailed Description

There are already dagster tasks (that are slightly broken....) for downloading and processing the EUMETSAT data. If we can clean those up, and upload/append to folders on our private GCP bucket that gets copied to the public one each Saturday, then we can keep adding to the archive.

Context

Currently, there are public archives of GOES (Over Atlantic, and Pacific/Americas), and Himawari (Over Pacific/Japan/part of India on edge), but none of Europe/Africa/Indian Ocean. There is some data from the Global Mosaic of Geostationary Satellite Imagery but that is more limited in channels and such than these.

This could be a really cool opportunity to fill in the missing gap of publicly accessible, free to access, satellite imagery, covering not only Europe, but other parts of the world that are less well studied. One paper already used the RSS imagery to do irradiance forecasting in Europe back 15 years, and this could open up much more research.

Possible Implementation

Satip to do processing and uploading. Might want a smarter way to do the uploads to limit costs for GCP.

@jacobbieker jacobbieker added the enhancement New feature or request label Dec 13, 2023
@jacobbieker jacobbieker self-assigned this Dec 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant