Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unify preprocessing site_pipeline and utils function into class objects. #1083

Open
mmccrackan opened this issue Jan 3, 2025 · 0 comments
Open
Assignees

Comments

@mmccrackan
Copy link
Contributor

The scripts preprocess_tod and multilayer_preprocess_tod call a number of lower level functions from the site_pipeline util.py and the preprocess pipeline_util.py. This results in duplicated code and the recalculation of many parameters several times (such as the groups which calls context.obsfiledb.get_detsets(obs_id). This, along with things like error handling can probably be better handled inside of a class object structure that tracks the state of a preprocessing run at either the per obs-id or per wafer level. Many of the preprocess_util.py functions can be moved into a class and one can be instantiated for each process in a multiprocessing run.

@mmccrackan mmccrackan self-assigned this Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant