Improve E2E nightly tests

[ThibeauWouters]

Add tests that sample from the prior since that is fast enough for CPU so we can run it in nightly to catch breaking changes that otherwise would slow down the CI/CD. Likely will do this after the jester review.