Similar to #469: #547 disables the `pytorch` backend tests due to https://github.com/scikit-hep/pyhf/issues/2554. Add back this backend test once supported via `pyhf` again.