Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add sentinel1 rtc seasonal notebook #157

Draft
wants to merge 3 commits into
base: develop
Choose a base branch
from

Conversation

emileten
Copy link
Contributor

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@emileten emileten requested a review from wildintellect March 21, 2023 07:03
@emileten emileten self-assigned this Mar 21, 2023
@emileten emileten added the documentation Improvements or additions to documentation label Mar 21, 2023
@review-notebook-app
Copy link

review-notebook-app bot commented Mar 21, 2023

View / edit / reply to this conversation on ReviewNB

wildintellect commented on 2023-03-21T16:26:00Z
----------------------------------------------------------------

Check the other materials, I don't think we typically expect a whole new conda env for each. In this case is pystac_client the only library not in the base? If so maybe just list that as the additional dependency?


emileten commented on 2023-03-21T22:56:31Z
----------------------------------------------------------------

@wildintellect I did this because I am encountering incompatibilities between the base environment of the ADE and stackstac . In particular, stackstac requires python <= 3.8 and in the base ADE we have Python 3.7.8.

At a higher level this indicates we might want to upgrade python in our base environment.

emileten commented on 2023-03-21T23:08:22Z
----------------------------------------------------------------

So I thought that for now providing a fresh environment configuration is the way to go, but let me konw if you have better ideas. I do not see examples of stackstac usage in the other dataset specific tutorials.

@review-notebook-app
Copy link

review-notebook-app bot commented Mar 21, 2023

View / edit / reply to this conversation on ReviewNB

wildintellect commented on 2023-03-21T16:26:02Z
----------------------------------------------------------------

This feels like a blocker for inclusion in the main docs. Wonder if this example should go in https://github.com/maap-project/maap-documentation-examples for now?


emileten commented on 2023-03-22T01:07:39Z
----------------------------------------------------------------

I think that we will have to solve this anyways. I could leave this as a draft PR until the problem is actually solved instead of putting the notebook somewhere else ?

@review-notebook-app
Copy link

review-notebook-app bot commented Mar 21, 2023

View / edit / reply to this conversation on ReviewNB

wildintellect commented on 2023-03-21T16:26:03Z
----------------------------------------------------------------

Client/variable might be more intuitive than object.


emileten commented on 2023-03-22T01:09:34Z
----------------------------------------------------------------

changed to 'client'.

@wildintellect
Copy link
Collaborator

I've invited @nmt28 to review this notebook.

@review-notebook-app
Copy link

review-notebook-app bot commented Mar 21, 2023

View / edit / reply to this conversation on ReviewNB

nmt28 commented on 2023-03-21T19:47:15Z
----------------------------------------------------------------

I think the data is in UTM so should be 326XX


emileten commented on 2023-03-22T01:08:10Z
----------------------------------------------------------------

fixed

@review-notebook-app
Copy link

review-notebook-app bot commented Mar 21, 2023

View / edit / reply to this conversation on ReviewNB

nmt28 commented on 2023-03-21T19:47:16Z
----------------------------------------------------------------

We can typically refer to the outlier noise here as " radar speckle". But it's safe to treat them as you would outliers. Note that radar linear units are from 0-0.1 with most occurring in the range 0.001-0.3. This may help with visualization


emileten commented on 2023-03-22T01:08:39Z
----------------------------------------------------------------

I added this terminology. In addition, I changed my approach for visualization (see my other comment).

@review-notebook-app
Copy link

review-notebook-app bot commented Mar 21, 2023

View / edit / reply to this conversation on ReviewNB

nmt28 commented on 2023-03-21T19:47:17Z
----------------------------------------------------------------

typically minimums/maximums should be avoided with radar data but as it's for a basic use example for increasing speed it's not really an issue


emileten commented on 2023-03-22T01:09:17Z
----------------------------------------------------------------

I changed my approach to coarsen the data -- I am now taking the mean, I think it makes more sense ? Also, now I am just clipping whatever is above the end of the bulk of the distribution, so 0.07, and the visualization looks much better.

Copy link
Contributor Author

@wildintellect I did this because I am encountering incompatibilities between the base environment of the ADE and stackstac . In particular, stackstac requires python <= 3.8 and in the base ADE we have Python 3.7.8.


View entire conversation on ReviewNB

Copy link
Contributor Author

So I thought that for now providing a fresh environment configuration is the way to go, but let me konw if you have better ideas. I do not see examples of stackstac usage in the other dataset specific tutorials.


View entire conversation on ReviewNB

Copy link
Contributor Author

I think that we will have to solve this anyways. I could leave this as a draft PR until the problem is actually solved instead of putting the notebook somewhere else ?


View entire conversation on ReviewNB

Copy link
Contributor Author

fixed


View entire conversation on ReviewNB

Copy link
Contributor Author

I added this terminology. In addition, I changed my approach for visualization (see my other comment).


View entire conversation on ReviewNB

Copy link
Contributor Author

I changed my approach to coarsen the data -- I am now taking the mean, I think it makes more sense ? Also, now I am just clipping whatever is above the end of the bulk of the distribution, so 0.07, and the visualization looks much better.


View entire conversation on ReviewNB

Copy link
Contributor Author

changed to 'client'.


View entire conversation on ReviewNB

@emileten
Copy link
Contributor Author

@nmt28 @wildintellect I resolved the discussions with my changes addressing your comments, except @wildintellect's ones regarding (1) specifying a full conda environment (2) moving this to another repository. I answered there Alex, let me know what you think.

@emileten
Copy link
Contributor Author

Side note regarding the .load() statement where I say that the first time it systematically fails due to a time out error. It's quite interesting, because if instead, I try to directly read one of the tif files with rioxarray + xarray, so not through stackstac, I do not get this error. So I have the feeling it has to do with stackstac's reading strategy. I will try to dig a little bit into this tomorrow and if that's indeed the case, file an issue to the stackstac repository.

@nmt28
Copy link
Collaborator

nmt28 commented Mar 22, 2023

Changes look good to me. The move to the mean reducer is a better idea and the visualization looks much better

@emileten
Copy link
Contributor Author

Great, thank you @nmt28 ! We probably don't want to merge this until we can avoid the hack I have in stackstac in the notebook. So, until then, if you need that notebook you can find it in this branch.

@wildintellect
Copy link
Collaborator

I'm going to put this back into Draft until we're ready to look at this again.

@wildintellect wildintellect marked this pull request as draft April 3, 2023 22:58
@wildintellect wildintellect added this to the V3 milestone Apr 4, 2023
@emileten
Copy link
Contributor Author

emileten commented Apr 5, 2023

When this is solved, we will be removing the stackstac hack from the notebook and merge this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants