It would be nice to be able to immediately use the bluetooth config menu when provisioning of a
device completes, but rebooting is fairly fast anyway.
Note that logging in via ssh and restarting both bluetooth and bluetooth-autopair doesn't fix this.