Skip to content

Additional validation of package created in CI #431

@bruno-garcia

Description

@bruno-garcia

We often have CI passing when the resulting package is actually broken. In fact, we've released packages to getsentry/unity that had missing dependencies.
Resolving this issue is likely to require multiple steps done through mulitiple PRs.

Validations to issues we've had in the past include. We can tackle them starting from the high-impact and low-effort.

  • The package can be imported on a Unity project created by the Unity version we're testing against
  • No errors or warnings caused by adding the package to the project
  • No errors (warning is OK) if the game is played before Sentry is configured
  • Verify that updating from Sentry Unity UPM to the built package results in no errors or warnings (to be clear, this doesn't validate jumping from any version to any version will be OK).

Possibly, all the E2E and Smoke Test jobs could be done on the project created for the Unity version under test, with the created package. So that all validations are done on the package+Unity version we are building against. See #449

For checks that would fail on breaking changes (e.g: create console warnings) consider having as a standalone job so we can mark as not-required and merge when failed.

Metadata

Metadata

Projects

  • Status

    Backlog
  • Status

    No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions