From 38b1a58af489f29bbb32f1055fdefc8f2911f53c Mon Sep 17 00:00:00 2001 From: Bex Dunn Date: Wed, 21 Feb 2024 12:16:12 +1100 Subject: [PATCH 1/4] test waterbodies group in prod catalog --- dev/terria/terria-cube-v8.json | 91 ++++++++++++++++++++++++++++++++++ 1 file changed, 91 insertions(+) diff --git a/dev/terria/terria-cube-v8.json b/dev/terria/terria-cube-v8.json index 9d0ce93ed..5ec844272 100644 --- a/dev/terria/terria-cube-v8.json +++ b/dev/terria/terria-cube-v8.json @@ -2766,6 +2766,97 @@ } ] }, + { + "id": "hryA22", + "type": "group", + "name": "DEA Waterbodies", + "members": [ + { + "type": "wms", + "name": "DEA Waterbodies (version 3.0)", + "shortReport": "Click to highlight a hatched Waterbody polygon. View the DEA Waterbodies timeseries of the percentage of the waterbody surface area observed as wet and the estimated latest open water surface area.

For more information and to download data, visit the DEA Waterbodies product description", + "url": "https://nonprod.geoserver.dea.ga.gov.au/geoserver/dea/wms", + "description": "Digital Earth Australia Waterbodies v3.0 provides up to date information about the extent and location of surface water, providing all Australians with a common understanding of this valuable and increasingly scarce resource. It supports users to understand and manage water across Australia. For example, users can gain insights into the severity and spatial distribution of drought or monitor critical lakes and dams, including hard-to-reach waterbodies in remote areas and on large properties.

The product indicates changes in the wet surface area of waterbodies. This can be used to identify when waterbodies are increasing or decreasing in wet surface area.

DEA Knowledge Hub product details: https://docs.dea.ga.gov.au/data/product/dea-waterbodies-landsat/?tab=overview.

Scientific paper: Krause et al. 2021.

DEA Website pages: https://www.dea.ga.gov.au/products/dea-waterbodies", + "info": [ + { + "name": "Accuracy and limitations", + "content": "This product shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water. Larger waterbodies are easier to detect and smaller or narrower waterbodies are harder to detect. Area estimates should be compared to additional data for verification.

Many of the inaccuracies and limitations of the waterbody analysis are inherited from DEA Water Observations (WO), with this product a reanalysis and mapping product built off the WO datasets. WO has a number of known limitations, and these manifest as misclassified waterbodies within this analysis. WO uses the spectral signature of water to classify wet pixels, and is known to be suboptimal in locations where water and vegetation are mixed. This includes locations such as rivers with vegetated riparian zones and vegetated wetlands.

Due to the way WO calculates the percentage of the water body observed and the way that satellite passes observe the water body, some of the larger salt lakes in Australia have very few records currently available. If less than 90% of the total waterbody is observed on any one day, due to cloud cover or missing data, than that observation is marked as a missing value. For larger bodies, which may cross multiple swath boundaries or suffer from misclassifications (salt lakes can be misclassified as cloud due to their brightness) this can be problematic.

For a full discussion of the limitations and accuracy of WO, see Mueller et al., 2016.

The update from version 2 to version 3.0 of the DEA Waterbodies product and service was created through a collaboration between Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI to make the product more useful in hazard applications.

Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI advise that the information published by this service comprises general statements based on scientific research. The reader is advised and needs to be aware that such information may be incomplete or unable to be used in any specific situation. No reliance or actions must therefore be made on that information without seeking prior expert professional, scientific and technical advice. To the extent permitted by law, FrontierSI, Geoscience Australia, the National Aerial Firefighting Centre and Natural Hazards Research Australia (including its employees and consultants) are excluded from all liability to any person for any consequences, including but not limited to all losses, damages, costs, expenses and any other compensation, arising directly or indirectly from using this publication (in part or in whole) and any information or material contained in it. " + }, + { + "name": "Software", + "content": "DEA Waterbodies uses the DEA conflux Python package. The code base used to generate DEA Waterbodies is available on GitHub. The WO product is used as an upstream package by DEA Waterbodies." + }, + { + "name": "Full Product Description", + "content": "Please visit the DEA Waterbodies(Landsat) Product Description " + }, + { + "name": "Licence", + "content": "DEA Waterbodies plots and data are provided under a CC BY Attribution 4.0 International License. The reference paper to cite for this product is Krause et al. 2021 and the dataset citation is Dunn et al., 2024." + } + ], + "chartDisclaimer": "Digital Earth Australia Waterbodies shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://docs.dea.ga.gov.au/data/product/dea-waterbodies-landsat/", + "layers": "dea:DigitalEarthAustraliaWaterbodies_v3", + "featureInfoTemplate": { + "template": "
{{>wb_title}}{{>customised}}{{>graph_title}}{{>disclaimer}}{{>information}}
", + "partials": { + "wb_title":"Waterbody Identifier: {{uid}}
", + "graph_title":"Percentage of surface area (not volume) observed as wet for waterbody {{uid}}
", + "disclaimer": "This graph shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water. For more detailed information see: https://docs.dea.ga.gov.au/data/product/dea-waterbodies-landsat/?tab=overview", + "customised":"

Waterbody {{uid}} was last observed as wet at {{#terria.formatDateTime}}{format: \"UTC:dd-mm-yyyy HH:MM:ss\"}{{dt_wetobs}}{{/terria.formatDateTime}} (UTC) and last observed by a satellite on {{#terria.formatDateTime}}{format: \"UTC:dd-mm-yyyy HH:MM:ss\"}{{dt_satpass}}{{/terria.formatDateTime}} (UTC). At last observation, estimated open water surface area of the waterbody was {{wet_sa_m2}} square metres. Data was last updated {{#terria.formatDateTime}}{format: \"UTC:dd-mm-yyyy HH:MM:ss\"}{{dt_updated }}{{/terria.formatDateTime}} (UTC).

Larger waterbodies are easier to detect and smaller or narrower waterbodies are harder to detect. Area estimates should be compared to additional data for verification.

", + "information": "

The update from version 2 to version 3.0 of the DEA Waterbodies product and service was created through a collaboration between Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI to make the product more useful in hazard applications.

Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI advise that the information published by this service comprises general statements based on scientific research. The reader is advised and needs to be aware that such information may be incomplete or unable to be used in any specific situation. No reliance or actions must therefore be made on that information without seeking prior expert professional, scientific and technical advice. To the extent permitted by law, FrontierSI, Geoscience Australia, the National Aerial Firefighting Centre and Natural Hazards Research Australia (including its employees and consultants) are excluded from all liability to any person for any consequences, including but not limited to all losses, damages, costs, expenses and any other compensation, arising directly or indirectly from using this publication (in part or in whole) and any information or material contained in it.

" + } + }, + "legends": [ + { + "url": "https://dea-public-data.s3.ap-southeast-2.amazonaws.com/derivative/dea_waterbodies/waterbodies_legend_full.png", + "imageScaling": 0.5 + } + ], + "id": "AS145r" + }, + { + "type": "wms", + "name": "DEA Waterbodies (version 2)", + "url": "https://nonprod.geoserver.dea.ga.gov.au/geoserver/dea/wms", + "chartDisclaimer": "Digital Earth Australia Waterbodies shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies", + "layers": "dea:DigitalEarthAustraliaWaterbodies_v2", + "featureInfoTemplate": { + "template": "

Waterbody Identifier: {{uid}}
Percentage of surface area (not volume) observed as wet


{{>disclaimer}}
", + "partials": { + "disclaimer": "This graph shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies." + } + }, + "legends": [ + { + "url": "https://dea-public-data.s3.ap-southeast-2.amazonaws.com/derivative/dea_waterbodies/waterbodies_legend_full.png", + "imageScaling": 0.5 + } + ], + "id": "AS145s" + }, + { + "type": "wms", + "name": "DEA Waterbodies (version 1, deprecated)", + "url": "https://nonprod.geoserver.dea.ga.gov.au/geoserver/dea/wms", + "chartDisclaimer": "Digital Earth Australia Waterbodies shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies", + "layers": "dea:DigitalEarthAustraliaWaterbodies_v1", + "featureInfoTemplate": { + "template": "

Waterbody Identifier: {{uid}}
Percentage of surface area (not volume) observed as wet


{{>disclaimer}}
", + "partials": { + "disclaimer": "This graph shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies." + } + }, + "legends": [ + { + "url": "https://dea-public-data.s3.ap-southeast-2.amazonaws.com/derivative/dea_waterbodies/waterbodies_legend_full.png", + "imageScaling": 0.5 + } + ], + "id": "AS145t" + } + ] + }, { "id": "ii4445", "type": "group", From 5bf0a015a604ad667cd9653e26a629a7d6ea4da2 Mon Sep 17 00:00:00 2001 From: BexDunn Date: Wed, 21 Feb 2024 14:18:19 +1100 Subject: [PATCH 2/4] shift to prod geoserver, new ids, remove colour format in hrefs --- dev/terria/terria-cube-v8.json | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/dev/terria/terria-cube-v8.json b/dev/terria/terria-cube-v8.json index 5ec844272..015dfc1aa 100644 --- a/dev/terria/terria-cube-v8.json +++ b/dev/terria/terria-cube-v8.json @@ -2767,7 +2767,7 @@ ] }, { - "id": "hryA22", + "id": "hryA8923", "type": "group", "name": "DEA Waterbodies", "members": [ @@ -2775,24 +2775,24 @@ "type": "wms", "name": "DEA Waterbodies (version 3.0)", "shortReport": "Click to highlight a hatched Waterbody polygon. View the DEA Waterbodies timeseries of the percentage of the waterbody surface area observed as wet and the estimated latest open water surface area.

For more information and to download data, visit the DEA Waterbodies product description", - "url": "https://nonprod.geoserver.dea.ga.gov.au/geoserver/dea/wms", - "description": "Digital Earth Australia Waterbodies v3.0 provides up to date information about the extent and location of surface water, providing all Australians with a common understanding of this valuable and increasingly scarce resource. It supports users to understand and manage water across Australia. For example, users can gain insights into the severity and spatial distribution of drought or monitor critical lakes and dams, including hard-to-reach waterbodies in remote areas and on large properties.

The product indicates changes in the wet surface area of waterbodies. This can be used to identify when waterbodies are increasing or decreasing in wet surface area.

DEA Knowledge Hub product details: https://docs.dea.ga.gov.au/data/product/dea-waterbodies-landsat/?tab=overview.

Scientific paper: Krause et al. 2021.

DEA Website pages: https://www.dea.ga.gov.au/products/dea-waterbodies", + "url": "https://geoserver.dea.ga.gov.au/geoserver/dea/wms", + "description": "Digital Earth Australia Waterbodies v3.0 provides up to date information about the extent and location of surface water, providing all Australians with a common understanding of this valuable and increasingly scarce resource. It supports users to understand and manage water across Australia. For example, users can gain insights into the severity and spatial distribution of drought or monitor critical lakes and dams, including hard-to-reach waterbodies in remote areas and on large properties.

The product indicates changes in the wet surface area of waterbodies. This can be used to identify when waterbodies are increasing or decreasing in wet surface area.

DEA Knowledge Hub product details: https://docs.dea.ga.gov.au/data/product/dea-waterbodies-landsat/?tab=overview.

Scientific paper: Krause et al. 2021.

DEA Website pages: https://www.dea.ga.gov.au/products/dea-waterbodies", "info": [ { "name": "Accuracy and limitations", - "content": "This product shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water. Larger waterbodies are easier to detect and smaller or narrower waterbodies are harder to detect. Area estimates should be compared to additional data for verification.

Many of the inaccuracies and limitations of the waterbody analysis are inherited from DEA Water Observations (WO), with this product a reanalysis and mapping product built off the WO datasets. WO has a number of known limitations, and these manifest as misclassified waterbodies within this analysis. WO uses the spectral signature of water to classify wet pixels, and is known to be suboptimal in locations where water and vegetation are mixed. This includes locations such as rivers with vegetated riparian zones and vegetated wetlands.

Due to the way WO calculates the percentage of the water body observed and the way that satellite passes observe the water body, some of the larger salt lakes in Australia have very few records currently available. If less than 90% of the total waterbody is observed on any one day, due to cloud cover or missing data, than that observation is marked as a missing value. For larger bodies, which may cross multiple swath boundaries or suffer from misclassifications (salt lakes can be misclassified as cloud due to their brightness) this can be problematic.

For a full discussion of the limitations and accuracy of WO, see Mueller et al., 2016.

The update from version 2 to version 3.0 of the DEA Waterbodies product and service was created through a collaboration between Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI to make the product more useful in hazard applications.

Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI advise that the information published by this service comprises general statements based on scientific research. The reader is advised and needs to be aware that such information may be incomplete or unable to be used in any specific situation. No reliance or actions must therefore be made on that information without seeking prior expert professional, scientific and technical advice. To the extent permitted by law, FrontierSI, Geoscience Australia, the National Aerial Firefighting Centre and Natural Hazards Research Australia (including its employees and consultants) are excluded from all liability to any person for any consequences, including but not limited to all losses, damages, costs, expenses and any other compensation, arising directly or indirectly from using this publication (in part or in whole) and any information or material contained in it. " + "content": "This product shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water. Larger waterbodies are easier to detect and smaller or narrower waterbodies are harder to detect. Area estimates should be compared to additional data for verification.

Many of the inaccuracies and limitations of the waterbody analysis are inherited from DEA Water Observations (WO), with this product a reanalysis and mapping product built off the WO datasets. WO has a number of known limitations, and these manifest as misclassified waterbodies within this analysis. WO uses the spectral signature of water to classify wet pixels, and is known to be suboptimal in locations where water and vegetation are mixed. This includes locations such as rivers with vegetated riparian zones and vegetated wetlands.

Due to the way WO calculates the percentage of the water body observed and the way that satellite passes observe the water body, some of the larger salt lakes in Australia have very few records currently available. If less than 90% of the total waterbody is observed on any one day, due to cloud cover or missing data, than that observation is marked as a missing value. For larger bodies, which may cross multiple swath boundaries or suffer from misclassifications (salt lakes can be misclassified as cloud due to their brightness) this can be problematic.

For a full discussion of the limitations and accuracy of WO, see Mueller et al., 2016.

The update from version 2 to version 3.0 of the DEA Waterbodies product and service was created through a collaboration between Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI to make the product more useful in hazard applications.

Geoscience Australia, the National Aerial Firefighting Centre, Natural Hazards Research Australia, and FrontierSI advise that the information published by this service comprises general statements based on scientific research. The reader is advised and needs to be aware that such information may be incomplete or unable to be used in any specific situation. No reliance or actions must therefore be made on that information without seeking prior expert professional, scientific and technical advice. To the extent permitted by law, FrontierSI, Geoscience Australia, the National Aerial Firefighting Centre and Natural Hazards Research Australia (including its employees and consultants) are excluded from all liability to any person for any consequences, including but not limited to all losses, damages, costs, expenses and any other compensation, arising directly or indirectly from using this publication (in part or in whole) and any information or material contained in it. " }, { "name": "Software", - "content": "DEA Waterbodies uses the DEA conflux Python package. The code base used to generate DEA Waterbodies is available on GitHub. The WO product is used as an upstream package by DEA Waterbodies." + "content": "DEA Waterbodies uses the DEA conflux Python package. The code base used to generate DEA Waterbodies is available on GitHub. The WO product is used as an upstream package by DEA Waterbodies." }, { "name": "Full Product Description", - "content": "Please visit the DEA Waterbodies(Landsat) Product Description " + "content": "Please visit the DEA Waterbodies(Landsat) Product Description " }, { "name": "Licence", - "content": "DEA Waterbodies plots and data are provided under a CC BY Attribution 4.0 International License. The reference paper to cite for this product is Krause et al. 2021 and the dataset citation is Dunn et al., 2024." + "content": "DEA Waterbodies plots and data are provided under a CC BY Attribution 4.0 International License. The reference paper to cite for this product is Krause et al. 2021 and the dataset citation is Dunn et al., 2024." } ], "chartDisclaimer": "Digital Earth Australia Waterbodies shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://docs.dea.ga.gov.au/data/product/dea-waterbodies-landsat/", @@ -2813,7 +2813,7 @@ "imageScaling": 0.5 } ], - "id": "AS145r" + "id": "AS1fd43505r" }, { "type": "wms", From 4f40f695147c626a956c41158c24408f7733aa92 Mon Sep 17 00:00:00 2001 From: BexDunn Date: Wed, 21 Feb 2024 14:23:17 +1100 Subject: [PATCH 3/4] remove waterbodies dev versions from prod terria catalogue, now that v3 updated here: --- dev/terria/terria-cube-v8.json | 40 ---------------------------------- 1 file changed, 40 deletions(-) diff --git a/dev/terria/terria-cube-v8.json b/dev/terria/terria-cube-v8.json index 015dfc1aa..4021c35a4 100644 --- a/dev/terria/terria-cube-v8.json +++ b/dev/terria/terria-cube-v8.json @@ -2814,46 +2814,6 @@ } ], "id": "AS1fd43505r" - }, - { - "type": "wms", - "name": "DEA Waterbodies (version 2)", - "url": "https://nonprod.geoserver.dea.ga.gov.au/geoserver/dea/wms", - "chartDisclaimer": "Digital Earth Australia Waterbodies shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies", - "layers": "dea:DigitalEarthAustraliaWaterbodies_v2", - "featureInfoTemplate": { - "template": "

Waterbody Identifier: {{uid}}
Percentage of surface area (not volume) observed as wet


{{>disclaimer}}
", - "partials": { - "disclaimer": "This graph shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies." - } - }, - "legends": [ - { - "url": "https://dea-public-data.s3.ap-southeast-2.amazonaws.com/derivative/dea_waterbodies/waterbodies_legend_full.png", - "imageScaling": 0.5 - } - ], - "id": "AS145s" - }, - { - "type": "wms", - "name": "DEA Waterbodies (version 1, deprecated)", - "url": "https://nonprod.geoserver.dea.ga.gov.au/geoserver/dea/wms", - "chartDisclaimer": "Digital Earth Australia Waterbodies shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies", - "layers": "dea:DigitalEarthAustraliaWaterbodies_v1", - "featureInfoTemplate": { - "template": "

Waterbody Identifier: {{uid}}
Percentage of surface area (not volume) observed as wet


{{>disclaimer}}
", - "partials": { - "disclaimer": "This graph shows the wet surface area of waterbodies as estimated from satellites. It does not show depth, volume, purpose of the waterbody, nor the source of the water.
For more detailed information see https://www.dea.ga.gov.au/products/dea-waterbodies." - } - }, - "legends": [ - { - "url": "https://dea-public-data.s3.ap-southeast-2.amazonaws.com/derivative/dea_waterbodies/waterbodies_legend_full.png", - "imageScaling": 0.5 - } - ], - "id": "AS145t" } ] }, From ad8bfcd30b2d88b261a11a3e55db8c6c07d251d4 Mon Sep 17 00:00:00 2001 From: BexDunn Date: Wed, 21 Feb 2024 14:24:07 +1100 Subject: [PATCH 4/4] check ids are unique --- dev/terria/terria-cube-v8.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/dev/terria/terria-cube-v8.json b/dev/terria/terria-cube-v8.json index 4021c35a4..04355c6ba 100644 --- a/dev/terria/terria-cube-v8.json +++ b/dev/terria/terria-cube-v8.json @@ -2813,7 +2813,7 @@ "imageScaling": 0.5 } ], - "id": "AS1fd43505r" + "id": "AS1fd43i505r" } ] },