[Feature Request] unify cleanup for the runtimes

[JINO-ROHIT]

Required prerequisites

• I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• Consider asking first in a Discussion.

Motivation

i feel like the way cleanup is implemented in each runtime is done differently, ie one is using a context manager, one is uses a private stop(),

a good idea could be to unify this and add to the base class implementation also.

Solution

i think we can add to the base class an abtrsact method something like

cleanup(self) -> None:
   xyz stuff

Alternatives

No response

Additional context

No response

[Wendong-Fan]

thanks @JINO-ROHIT , it makes sense to unify the clean up function, let's do this!