Documenting how to create a custom odc-stats plugin #197
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* update to 1.9 and use odc.geo; most tests passing * expect dataset sources as list * update test * set XYSCALE=None explicitly to use odc-geo warp * update reqs * tests requirement with odc>1.9 * change time to timezone aware * relocate loading from odc-algo * delete cached stage periodically * rename docker image workflow yaml * update basics with pass * update tflite runtime name * add back stats and install newest numexpr * switch from ubuntu to debian * remove odc-stats * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix plugin import * upgrade to odc>1.9 * update integration test * add indexing test (#191) Co-authored-by: Emma Ai <emma.ai@ga.gov.au> * [pre-commit.ci] pre-commit autoupdate (#193) updates: - [github.com/adrienverge/yamllint.git: v1.37.0 → v1.37.1](https://github.com/adrienverge/yamllint.git/compare/v1.37.0...v1.37.1) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * update dependencies in test * remove dask client from unit test * update odc-algo hash * update env variable with datacube>1.9 * remove pin on sqlalchemy * lower pin numexpr * update dependencies version * remove expr_eval * install numexpr from pypi * fix typos * update dependencies in test * more typos * save and retrieve info on fused product from properties explicitly * always some typos * update typing to 3.10 * unhacking lineage and metadata assemble --------- Co-authored-by: Ariana Barzinpour <ariana.barzinpour@ga.gov.au> Co-authored-by: Emma Ai <emma.ai@ga.gov.au> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
updates: - [github.com/PyCQA/flake8: 7.2.0 → 7.3.0](PyCQA/flake8@7.2.0...7.3.0) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
for more information, see https://pre-commit.ci
* add cloud probability plugin * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix linting * rm unneeded package * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update version * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
for more information, see https://pre-commit.ci
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## develop_1.8 #197 +/- ##
==============================================
Coverage ? 81.50%
==============================================
Files ? 53
Lines ? 4824
Branches ? 0
==============================================
Hits ? 3932
Misses ? 892
Partials ? 0 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
…rt stac2ds from there. (#200)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Notebook and accompanying plugin code and config that shows a simple example of creating a custom odc-stats plugin. The overall goal of the notebook is to provide guidance to EO scientists on how to translate their analysis code to odc-stats.
The notebook represents the limit of my understanding of odc-stats, so could do with input from others who may know a lot more than I do and can provide clarifications or edits to either the analysis or descriptions. There is also no descriptions of how and when to use fuser functions.
Aims:
This notebook was tested on the following odc libraries.
odc-algo 0.2.5.dev7+gadb1856
odc-cloud 0.2.5
odc-dscache 0.2.3
odc-geo 0.4.8
odc-io 0.2.2
odc-stac 0.3.10
odc-stats 1.0.78.dev6+gc38367b.d20250630
odc-ui 0.2.1
datacube 1.8.19