Figure out how to keep our deployments and environments cleaned up

Figure out how to keep our deployments and environments cleaned up #13127