Description
We often have CI passing when the resulting package is actually broken. In fact, we've released packages to getsentry/unity
that had missing dependencies.
Resolving this issue is likely to require multiple steps done through mulitiple PRs.
Validations to issues we've had in the past include. We can tackle them starting from the high-impact and low-effort.
- The package can be imported on a Unity project created by the Unity version we're testing against
- No errors or warnings caused by adding the package to the project
- No errors (warning is OK) if the game is played before Sentry is configured
- Verify that updating from Sentry Unity UPM to the built package results in no errors or warnings (to be clear, this doesn't validate jumping from any version to any version will be OK).
Possibly, all the E2E and Smoke Test jobs could be done on the project created for the Unity version under test, with the created package. So that all validations are done on the package+Unity version we are building against. See #449
For checks that would fail on breaking changes (e.g: create console warnings) consider having as a standalone job so we can mark as not-required and merge when failed.
Metadata
Metadata
Assignees
Type
Projects
Status
Backlog
Status
No status