train rf model in background thread#1178

Open

bbudescu wants to merge 21 commits intoautoml:mainfrom

bbudescu:async_train_rf

Commits on Dec 4, 2024

- train rf model in the background while worker processes use older version
Bogdan Budescu
committed

Commits on Dec 10, 2024

work in progress: replace threads by multiprocessing, use shared memory (backed by mmap on posix-compliant OSs) for data, and queues for synchronization
Bogdan Budescu
committed

Commits on Dec 11, 2024

work in progress: keep handle to shared memory until change instead of re-opening every time
Bogdan Budescu
committed
refactor: encapsulation: move multiprocessing implementation to dedicated subpackage
Bogdan Budescu
committed
delete metadata
Bogdan Budescu
committed
- refactor: encapsulation of some code in growing array class
Bogdan Budescu
committed
- refactor: encapsulation: move training data init where it can be used within background thread
Bogdan Budescu
committed
minor fixes in sync semantics
Bogdan Budescu
committed
minor fixes in sync
Bogdan Budescu
committed

Commits on Dec 12, 2024

add flag to allow user switch to emulating the old behavior, i.e., to wait until training is done before being able to query the model to suggest a new config to try
Bogdan Budescu
committed
- fix bugs in arrays backed by shared memory
Bogdan Budescu
committed
disable resource tracking for shared memory instances to avoid warnings
Bogdan Budescu
committed
use uuids instead of incremental ids to avoid collisions when running multiple sessions in parallel, e.g., when running tests
Bogdan Budescu
committed
minor aesthetic refactors
Bogdan Budescu
committed
more minor aesthetic refactors
Bogdan Budescu
committed

Commits on Dec 13, 2024

- add cleanup semantics in hierarchy of objects containing random forests to terminate the training loop process gracefully (to as high as an extent as possible)
Bogdan Budescu
committed
- improve sync between optimization and training loops
Bogdan Budescu
committed
add flag to switch off (concurrent) background training entirely (default to old behavior)
Bogdan Budescu
committed
fix typo that caused bug
Bogdan Budescu
committed

Commits on Dec 17, 2024

default enable background training to run tests
Bogdan Budescu
committed

Commits on Dec 18, 2024

use setproctitle, if available to rename rf trainer process, so it's more easily identifiable in monitoring tools
Bogdan Budescu
committed