Support cherry-pick #1811
Description
We have a customer workflow where they want to run inference on independent boxes and write these to separate branches. Then they want to merge all these branches to main. Because the boxes are independent, there are no real conflicts.