Tentatively eliminate graph break overhead#3741

Draft

cehongwang wants to merge 18 commits intomainfrom

Commits on Sep 19, 2025

Commits on Sep 22, 2025

Reduced memory usage of use_python_runtime=True with the new API
cehongwang
committed

Commits on Sep 23, 2025

ready for review
cehongwang
committed

Commits on Sep 24, 2025

Revised according to comments
cehongwang
committed

Commits on Sep 29, 2025

Cleared 2x+ dangling memory after compilation
cehongwang
committed

Commits on Sep 30, 2025

Added testcases and try catch
cehongwang
committed

Commits on Oct 2, 2025

Revert back to support lazy init while reducing the memory consumption
cehongwang
committed

Commits on Oct 3, 2025

Added a potential solution for windows
cehongwang
committed

Commits on Oct 10, 2025

Revert windows solution. Not working
cehongwang
committed

Commits on Oct 13, 2025