Skip to content

Conversation

Bai-Chiang
Copy link
Contributor

@Bai-Chiang Bai-Chiang commented Sep 25, 2025

27d0d72 ignore 'archive' field defined in preprocess_config. So that it ignore the preprocess archive database and force compute preprocess steps on the fly. Based on this tutorial, section: How to selectively apply processing to TODs (interactive preprocess).

7653673 fix a minor bug when checking pointing_model and hwp_angle_model in preprocess config file.

The `preconfig["process_pipe"]` is a list of dict like
`[{'name': 'pointing_model', ...}, {'name': 'hwp_angle_model', ...}, ...]`
So need an extra step like `[i['name'] for i in preconfig["process_pipe"]]`
to get a list of preprocessing name.
Ignore 'archive' field defined in `preprocess_config`. So that it ignore
the preprocess archive database and force compute preprocess steps on the fly.
Copy link
Member

@tskisner tskisner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, this looks good. And useful when running data where the preprocessing archive does not yet exist.

@Bai-Chiang Bai-Chiang merged commit 7f11c59 into simonsobs:master Oct 2, 2025
5 checks passed
@Bai-Chiang Bai-Chiang deleted the toast_preprocess branch October 2, 2025 18:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants