Add memory monitoring to livereduce

[rosswhitfield]

Ref: 6960: [LIVEREDUCTION] Add memory monitoring

It works by creating function running in it's own thread that is checking the memory usage. If it gets above the set percentage it will stop live data, clear the workspaces and restart live data. This seemed like a better solution then running mantid in a subprocess, MonitorLiveData is already running in it's own thread anyway.

To test I created another example in the test folder using FakeISISEventDAE where it's producing lots of events and the proceeding will just accumulated all the events quickly using up the available memory.

Start the fake server

python test/fake_event_server.py

start livereduce

python scripts/livereduce.py test/fake_event.conf

and you should see live data getting restarted after it uses 25% of your memory.

[backmari]

Successfully ran the test. The livereduce process is stopped when it reaches 25% of my system memory and restarted after 1 s.

The log file shows a message about exceeding the memory limit:

2024-11-25 09:08:47,229 - livereduce - ERROR - Memory usage 8442.67 MB exceeds limit
2024-11-25 09:08:47,229 - livereduce.LiveDataManager - INFO - Restarting Live Data and clearing workspaces
2024-11-25 09:08:47,229 - livereduce.LiveDataManager - INFO - stopping live data processing
2024-11-25 09:08:47,299 - Mantid - WARNING - Plus: Execution cancelled by user.
2024-11-25 09:08:47,339 - Mantid - WARNING - MonitorLiveData: Execution cancelled by user.
2024-11-25 09:08:48,537 - livereduce.LiveDataManager - INFO - StartLiveData({
  "AccumulationMethod": "Add",
  "FromNow": false,
  "FromStartOfRun": true,
  "Instrument": "ISIS_Event",
  "OutputWorkspace": "result",
  "PreserveEvents": true,
  "ProcessingScriptFilename": "/home/u5z/projects/livereduce/test/reduce_ISIS_Event_live_proc.py",
  "UpdateEvery": 3
})
2024-11-25 09:08:48,706 - Mantid - INFO - StartLiveData started

[peterfpeterson]

Looks good to me. I appreciate the extra information in the README for configuring this option.

[backmari]

small change

[backmari]

Looks good to me.