Skip to content

bug: relationships between nested operations are not stored in keyboard interrupt #313

@michael-johnston

Description

@michael-johnston

Issue Description

When nested operations are run and a keyboard interrupt stops the child operation, the operations are not shown as related with ado show related operation ....

How to reproduce

Steps to reproduce the behavior:

Go to the branch dl_operator_trim, my git log -1 is
commit:
a83053c

Install Trim, from root
uv pip install plugins/operators/trim

Install the custom experiments, from root
uv pip install -e examples/trim_custom_experiments

Create the resources as follows.

cd in the config folder, i.e. from root
cd examples/trim_custom_experiments/trim_custom_experiments/configs

run ado create space -f space_pressure.yaml --new-sample-store

and finally run ado create space -f space_pressure.yaml --new-sample-store

Interrupt after you see autogluon models that start to be trained

(RandomWalk pid=95739) 2025-12-16 17:16:25,277 INFO      AsyncIO Thread: default trim.trim_sampler: iterator            : Fitting AutoGluon TabularPredictor, iteration 19...
(RandomWalk pid=95739) Preset alias specified: 'medium' maps to 'medium_quality'.
(RandomWalk pid=95739) Verbosity: 2 (Standard Logging)
(RandomWalk pid=95739) =================== System Info ===================
(RandomWalk pid=95739) AutoGluon Version:  1.4.0
(RandomWalk pid=95739) Python Version:     3.12.7
(RandomWalk pid=95739) Operating System:   Darwin
(RandomWalk pid=95739) Platform Machine:   arm64
(RandomWalk pid=95739) Platform Version:   Darwin Kernel Version 24.6.0: Mon Jul 14 11:30:55 PDT 2025; root:xnu-11417.140.69~1/RELEASE_ARM64_T6031
(RandomWalk pid=95739) CPU Count:          16
(RandomWalk pid=95739) Memory Avail:       29.98 GB / 64.00 GB (46.8%)
(RandomWalk pid=95739) Disk Space Avail:   557.37 GB / 1858.19 GB (30.0%)

Note:

The custom experiment calculate_pressure_ideal_gas is
defined following the guide at https://ibm.github.io/ado/actuators/creating-custom-experiments/#decorating-your-custom-experiment-function

Expected behaviour

I expected

455                  operation-trim-v0.1-41cea64c               null  finished      error   2m40s
456  randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8               null  finished      error   2m38s
ad-orchestrator/pg/configurations on  dl_operator_trim [$] via  v3.12.7 (ado-core) 
❯ ado show related operation operation-trim-v0.1-41cea64c                                            
discoveryspace
  - space-1b82fb-86dfba
  operation
  - randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8
ad-orchestrator/pg/configurations on  dl_operator_trim [$] via  v3.12.7 (ado-core) 
❯ ado show related operation randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8                            
discoveryspace
  - space-1b82fb-86dfba
 operation
  - operation-trim-v0.1-41cea64c

operation

  • operation-trim-v0.1-20680ddd

Screenshots/Logs

I got instead

455                  operation-trim-v0.1-41cea64c               null  finished      error   2m40s
456  randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8               null  finished      error   2m38s
ad-orchestrator/pg/configurations on  dl_operator_trim [$] via  v3.12.7 (ado-core) 
❯ ado show related operation operation-trim-v0.1-41cea64c                                            
discoveryspace
  - space-1b82fb-86dfba
ad-orchestrator/pg/configurations on  dl_operator_trim [$] via  v3.12.7 (ado-core) 
❯ ado show related operation randomwalk-1.3.1.dev46+81ae02a4.dirty-d74de8                            
discoveryspace
  - space-1b82fb-86dfba

Python/ado/system info

ad-orchestrator/pg/configurations on  dl_operator_trim [$] via  v3.12.7 (ado-core) 
❯ ado version                                                            
1.3.1.dev46+81ae02a4.dirty
ad-orchestrator/pg/configurations on  dl_operator_trim [$] via  v3.12.7 (ado-core) 
❯ python --version                                                                            
Python 3.12.7

(macOS)

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions