Skip to content

👷 run latest firefox and webkit in CI, default local e2e to chromium - #4618

Merged
thomas-lebeau merged 3 commits into
mainfrom
thomas.lebeau/e2e-latest-browsers-in-ci
May 26, 2026
Merged

👷 run latest firefox and webkit in CI, default local e2e to chromium#4618
thomas-lebeau merged 3 commits into
mainfrom
thomas.lebeau/e2e-latest-browsers-in-ci

Conversation

@thomas-lebeau

@thomas-lebeau thomas-lebeau commented May 13, 2026

Copy link
Copy Markdown
Collaborator

Motivation

We only ran the latest Chromium in CI e2e, alongside pinned variants of Chromium 120, Firefox 119 and WebKit 17.4 (added in #4612). This left a gap: regressions on the latest Firefox/WebKit versions weren't caught until they shipped. Locally, running all browsers also made the e2e feedback loop slow.

Changes

  • .gitlab-ci.yml: add firefox and webkit to the e2e job's BROWSER matrix (in addition to the existing chromium/*-pinned projects). Bump CURRENT_CI_IMAGE to 108.
  • Dockerfile: install Playwright's firefox and webkit browsers (with deps) in the CI image so the new matrix entries have what they need.

Test instructions

  • CI: confirm the e2e job runs the new firefox and webkit matrix entries successfully on the freshly built image 108.
  • Local: yarn test:e2e should now run chromium only. yarn test:e2e --project=firefox still works for opting in to other browsers.

Checklist

  • Tested locally
  • Tested on staging
  • Added unit tests for this change.
  • Added e2e/integration tests for this change.
  • Updated documentation and/or relevant AGENTS.md file

@thomas-lebeau
thomas-lebeau requested a review from a team as a code owner May 13, 2026 13:42

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 544f22ee07

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread package.json Outdated
@thomas-lebeau
thomas-lebeau force-pushed the thomas.lebeau/e2e-latest-browsers-in-ci branch from 544f22e to 4ea9e76 Compare May 13, 2026 13:48
@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented May 13, 2026

Copy link
Copy Markdown

Bundles Sizes Evolution

📦 Bundle Name Base Size Local Size 𝚫 𝚫% Status
Rum 173.55 KiB 173.72 KiB +177 B +0.10%
Rum Profiler 8.07 KiB 8.07 KiB 0 B 0.00%
Rum Recorder 21.23 KiB 21.23 KiB 0 B 0.00%
Logs 56.89 KiB 57.05 KiB +164 B +0.28%
Rum Slim 131.26 KiB 131.41 KiB +146 B +0.11%
Worker 22.99 KiB 22.99 KiB 0 B 0.00%

🔗 RealWorld

@datadog-prod-us1-6

datadog-prod-us1-6 Bot commented May 13, 2026

Copy link
Copy Markdown

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🎯 Code Coverage (details)
Patch Coverage: 77.14%
Overall Coverage: 76.82% (+0.05%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: c7a2412 | Docs | Datadog PR Page | Give us feedback!

@thomas-lebeau
thomas-lebeau force-pushed the thomas.lebeau/e2e-latest-browsers-in-ci branch 2 times, most recently from 573ba97 to 0c3132a Compare May 15, 2026 19:21
thomas-lebeau and others added 2 commits May 26, 2026 11:32
Adds firefox and webkit to the CI e2e matrix alongside chromium so we
catch cross-browser regressions on the latest browser versions (in
addition to the existing pinned variants). Installs the matching
Playwright browsers in the CI image and bumps CURRENT_CI_IMAGE to 108.

Defaults local `yarn test:e2e` to chromium only to keep the local
feedback loop fast; other browsers can still be run via `--project=`.
@thomas-lebeau
thomas-lebeau force-pushed the thomas.lebeau/e2e-latest-browsers-in-ci branch from 2671799 to a32f1d3 Compare May 26, 2026 10:35
- reset lifecycle tracker in cleanup to avoid cross-test state leakage
- await a microtask before updating consent so startSessionManager can
  finish awaiting selectSessionStoreStrategyType and call setSessionState
@thomas-lebeau
thomas-lebeau merged commit 0c6284c into main May 26, 2026
22 checks passed
@thomas-lebeau
thomas-lebeau deleted the thomas.lebeau/e2e-latest-browsers-in-ci branch May 26, 2026 11:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants