Disable host `cargo` fallback on errors

[Emilgardis]

This feature has only caused confusion, it mainly existed to prevent general CI failures, but that has since been touched on through #661

We should disable default fallback and make it opt-in