-
Notifications
You must be signed in to change notification settings - Fork 1
Description
Issue Description
When nested operations are run and a keyboard interrupt stops the child operation, the operations are not shown as related with ado show related operation ....
How to reproduce
Steps to reproduce the behavior:
Go to the branch dl_operator_trim, my git log -1 is
commit:
a83053c
Install Trim, from root
uv pip install plugins/operators/trim
Install the custom experiments, from root
uv pip install -e examples/trim_custom_experiments
Create the resources as follows.
cd in the config folder, i.e. from root
cd examples/trim_custom_experiments/trim_custom_experiments/configs
run ado create space -f space_pressure.yaml --new-sample-store
and finally run ado create space -f space_pressure.yaml --new-sample-store
Interrupt after you see autogluon models that start to be trained
(RandomWalk pid=95739) 2025-12-16 17:16:25,277 INFO AsyncIO Thread: default trim.trim_sampler: iterator : Fitting AutoGluon TabularPredictor, iteration 19...
(RandomWalk pid=95739) Preset alias specified: 'medium' maps to 'medium_quality'.
(RandomWalk pid=95739) Verbosity: 2 (Standard Logging)
(RandomWalk pid=95739) =================== System Info ===================
(RandomWalk pid=95739) AutoGluon Version: 1.4.0
(RandomWalk pid=95739) Python Version: 3.12.7
(RandomWalk pid=95739) Operating System: Darwin
(RandomWalk pid=95739) Platform Machine: arm64
(RandomWalk pid=95739) Platform Version: Darwin Kernel Version 24.6.0: Mon Jul 14 11:30:55 PDT 2025; root:xnu-11417.140.69~1/RELEASE_ARM64_T6031
(RandomWalk pid=95739) CPU Count: 16
(RandomWalk pid=95739) Memory Avail: 29.98 GB / 64.00 GB (46.8%)
(RandomWalk pid=95739) Disk Space Avail: 557.37 GB / 1858.19 GB (30.0%)
Note:
The custom experiment calculate_pressure_ideal_gas is
defined following the guide at https://ibm.github.io/ado/actuators/creating-custom-experiments/#decorating-your-custom-experiment-function
Expected behaviour
I expected
455 operation-trim-v0.1-41cea64c null finished error 2m40s
456 randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8 null finished error 2m38s
ad-orchestrator/pg/configurations on dl_operator_trim [$] via v3.12.7 (ado-core)
❯ ado show related operation operation-trim-v0.1-41cea64c
discoveryspace
- space-1b82fb-86dfba
operation
- randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8
ad-orchestrator/pg/configurations on dl_operator_trim [$] via v3.12.7 (ado-core)
❯ ado show related operation randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8
discoveryspace
- space-1b82fb-86dfba
operation
- operation-trim-v0.1-41cea64c
operation
- operation-trim-v0.1-20680ddd
Screenshots/Logs
I got instead
455 operation-trim-v0.1-41cea64c null finished error 2m40s
456 randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8 null finished error 2m38s
ad-orchestrator/pg/configurations on dl_operator_trim [$] via v3.12.7 (ado-core)
❯ ado show related operation operation-trim-v0.1-41cea64c
discoveryspace
- space-1b82fb-86dfba
ad-orchestrator/pg/configurations on dl_operator_trim [$] via v3.12.7 (ado-core)
❯ ado show related operation randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8
discoveryspace
- space-1b82fb-86dfba
Python/ado/system info
ad-orchestrator/pg/configurations on dl_operator_trim [$] via v3.12.7 (ado-core)
❯ ado version
1.3.1.dev46+81ae02a4.dirty
ad-orchestrator/pg/configurations on dl_operator_trim [$] via v3.12.7 (ado-core)
❯ python --version
Python 3.12.7
(macOS)