Skip to content

Conversation

mikala-nsidc
Copy link
Contributor

@mikala-nsidc mikala-nsidc commented Sep 17, 2025

Added some SMAP Harmony examples to the notebook and renamed the notebook to be more general.

This won't need to be merged until after October 21, when we publicly release SMAP data sets and Harmony services.

mikala-nsidc and others added 6 commits September 15, 2025 20:46
fixed markdown cells that I couldn't due to wandering Jupyter notebook cell bug.
edited output format explanation in L4 section
mikala-nsidc and others added 3 commits October 6, 2025 18:27
@mikala-nsidc mikala-nsidc marked this pull request as ready for review October 9, 2025 17:31
@mikala-nsidc
Copy link
Contributor Author

@jules32 Would you mind giving this a review?

@mikala-nsidc mikala-nsidc requested a review from jules32 October 9, 2025 17:34
@jules32 jules32 requested a review from ateucher October 9, 2025 18:48
Copy link
Member

@ateucher ateucher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks really good @mikala-nsidc! I was able to run it all locally except for the s3 direct streaming, which was expected. Your explanations of all of the concepts are just at the right level so that people understand what's going on without getting bogged down in the weeds.

I have one question - I had to restart the notebook partway through, and when I submitted the request the second time I was a bit surprised to see Harmony processing the whole request again. Does it do any caching on s3 so it doesn't have to reprocess identical requests?

I don't think it's necessary for this notebook, but it would be interesting to demonstrate how to submit a request that puts the processed data in a user's own S3 bucket, does that exist anywhere? If so, it might be worth linking to?

@mikala-nsidc
Copy link
Contributor Author

@ateucher Those are good questions! You can access a previously processed request using the Harmony job id - it's staged in a Harmony S3 bucket for 30 days. But yes, if you run the request again from the notebook, you are making a new request and it will create a new Harmony job.
I will try to find instructions for sending Harmony output to a user defined S3 bucket. I've read that it's an option, but haven't looked for actual instructions yet.
Would it be okay to merge the updates to this notebook as is, for now?

@ateucher
Copy link
Member

ateucher commented Oct 9, 2025

Thanks Mikala! Yes, I think it's good to merge as-is, I'll do that now, and make an issue based on your comment :)

@ateucher ateucher merged commit ea6fe6b into NASA-Openscapes:main Oct 9, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants