Skip to content

WIP - Add experimental Firefox integration test support #3827

WIP - Add experimental Firefox integration test support

WIP - Add experimental Firefox integration test support #3827

Triggered via pull request January 21, 2026 20:43
Status Success
Total duration 3m 32s
Artifacts

checks.yml

on: pull_request
Matrix: build
Matrix: playwright-tests-firefox
Matrix: playwright-tests
Fit to window
Zoom out
Zoom in

Annotations

3 errors, 12 warnings, and 12 notices
[chromium] › integration-test/broken-site-report.spec.js:78:9 › Broken site reports › Includes correct metadata when blocklist fetch fails: integration-test/broken-site-report.spec.js#L90
2) [chromium] › integration-test/broken-site-report.spec.js:78:9 › Broken site reports › Includes correct metadata when blocklist fetch fails Error: expect(received).toHaveLength(expected) Expected length: 1 Received length: 2 Received array: ["https://improving.duckduckgo.com/t/epbf_chrome?61944&siteUrl=https%3A%2F%2Fprivacy-test-pages.site%2F&tds=test&remoteConfigEtag=test&remoteConfigVersion=1697802863205&upgradedHttps=false&urlParametersRemoved=false&ctlYouTube=false&ctlFacebookPlaceholderShown=false&ctlFacebookLogin=false&performanceWarning=false&userRefreshCount=0&locale=en-US&protectionsState=true&category=dislike&errorDescriptions=%5B%5D&openerContext=external&extensionVersion=2026.1.12&atb=v518-1&ignoreRequests=&blockedTrackers=&surrogates=&noActionRequests=&adAttributionRequests=&ignoredByUserRequests=&test=1", "https://improving.duckduckgo.com/t/epbf_chrome?7856393&siteUrl=https%3A%2F%2Fprivacy-test-pages.site%2F&tds=&remoteConfigEtag=W%2F%22385328de7ebe3fabd23f4c5c8c92ddaf%22&remoteConfigVersion=1768211267089&upgradedHttps=false&urlParametersRemoved=false&ctlYouTube=false&ctlFacebookPlaceholderShown=false&ctlFacebookLogin=false&performanceWarning=false&userRefreshCount=0&locale=en-US&protectionsState=true&category=dislike&errorDescriptions=%5B%5D&openerContext=external&contentScopeExperiments=fingerprintingCanvasAdditionalEnabledCheck%3Acontrol&extensionVersion=2026.1.12&atb=v518-1&ignoreRequests=&blockedTrackers=&surrogates=&noActionRequests=&adAttributionRequests=&ignoredByUserRequests=&test=1"] 88 | await backgroundPage.evaluate(() => globalThis.components.dashboardMessaging.submitBrokenSiteReport({ category: 'dislike' })); 89 | await gotPixel; > 90 | expect(pixels).toHaveLength(1); | ^ 91 | const pixel = _formatPixelRequestForTesting(pixels[0]); 92 | expect(pixel).toMatchObject({ 93 | name: 'epbf_chrome', at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/broken-site-report.spec.js:90:24
[chromium] › integration-test/atb.spec.js:77:13 › install workflow › atb values › should get its ATB param from the success page when one is present: integration-test/atb.spec.js#L109
1) [chromium] › integration-test/atb.spec.js:77:13 › install workflow › atb values › should get its ATB param from the success page when one is present Error: expect(received).toEqual(expected) // deep equality Expected: 1 Received: 0 107 | expect(setAtb).toEqual(atb); 108 | expect(extiSent).toBeTruthy(); > 109 | expect(numExtiCalled).toEqual(1); | ^ 110 | }); 111 | }); 112 | at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/atb.spec.js:109:35
[chromium] › integration-test/storage-blocking.spec.js:18:9 › Storage blocking Tests › Blocks storage correctly on https://privacy-test-pages.site/privacy-protections/storage-blocking/: integration-test/storage-blocking.spec.js#L37
1) [chromium] › integration-test/storage-blocking.spec.js:18:9 › Storage blocking Tests › Blocks storage correctly on https://privacy-test-pages.site/privacy-protections/storage-blocking/ Error: blocks 3rd party JS cookies from trackers expect(received).toBeUndefined() Received: {"domain": "broken.third-party.site", "expires": 1803588370.53148, "httpOnly": false, "name": "jsdata", "path": "/privacy-protections/storage-blocking", "sameSite": "None", "secure": true, "value": "990"} 35 | 36 | const expectUnmodified = (desc) => (c) => expect(c.expires, desc).toBeGreaterThan(nowSeconds); > 37 | const expectBlocked = (desc) => (c) => expect(c, desc).toBeUndefined(); | ^ 38 | const expectedCookies = { 39 | [testPageDomain]: { 40 | top_firstparty_headerdata: expectUnmodified('does not block 1st party HTTP cookies'), at Object.jsdata (/home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/storage-blocking.spec.js:37:64) at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/storage-blocking.spec.js:64:60
playwright-tests-firefox (2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests-firefox (3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests-firefox (4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests-firefox (1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright-mv2, 1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright-mv2, 2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright, 2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright-mv2, 3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright, 3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright, 1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright-mv2, 4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright, 4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
🎭 Playwright Run Summary
1 passed (17.8s)
🎭 Playwright Run Summary
2 passed (24.1s)
🎭 Playwright Run Summary
1 passed (17.8s)
🎭 Playwright Run Summary
3 passed (34.7s)
🎭 Playwright Run Summary
2 skipped 16 passed (56.5s)
🎭 Playwright Run Summary
4 skipped 14 passed (51.0s)
🎭 Playwright Run Summary
3 skipped 13 passed (52.9s)
🎭 Playwright Run Summary
17 passed (1.1m)
🎭 Playwright Run Summary
16 passed (1.0m)
🎭 Playwright Run Summary
2 flaky [chromium] › integration-test/atb.spec.js:77:13 › install workflow › atb values › should get its ATB param from the success page when one is present [chromium] › integration-test/broken-site-report.spec.js:78:9 › Broken site reports › Includes correct metadata when blocklist fetch fails 2 skipped 13 passed (1.0m)
🎭 Playwright Run Summary
1 flaky [chromium] › integration-test/storage-blocking.spec.js:18:9 › Storage blocking Tests › Blocks storage correctly on https://privacy-test-pages.site/privacy-protections/storage-blocking/ 16 passed (1.2m)
🎭 Playwright Run Summary
16 passed (1.3m)