`Add to .gitpod.yml` command breaks .gitpod.yml in some cases

[jeanp413]

See videoclip in #15353 (comment)

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.