WIP - Add experimental Firefox integration test support #3827
checks.yml
on: pull_request
lint
1m 42s
unit-tests
1m 52s
Matrix: build
Matrix: playwright-tests-firefox
Matrix: playwright-tests
Annotations
3 errors, 12 warnings, and 12 notices
|
[chromium] › integration-test/broken-site-report.spec.js:78:9 › Broken site reports › Includes correct metadata when blocklist fetch fails:
integration-test/broken-site-report.spec.js#L90
2) [chromium] › integration-test/broken-site-report.spec.js:78:9 › Broken site reports › Includes correct metadata when blocklist fetch fails
Error: expect(received).toHaveLength(expected)
Expected length: 1
Received length: 2
Received array: ["https://improving.duckduckgo.com/t/epbf_chrome?61944&siteUrl=https%3A%2F%2Fprivacy-test-pages.site%2F&tds=test&remoteConfigEtag=test&remoteConfigVersion=1697802863205&upgradedHttps=false&urlParametersRemoved=false&ctlYouTube=false&ctlFacebookPlaceholderShown=false&ctlFacebookLogin=false&performanceWarning=false&userRefreshCount=0&locale=en-US&protectionsState=true&category=dislike&errorDescriptions=%5B%5D&openerContext=external&extensionVersion=2026.1.12&atb=v518-1&ignoreRequests=&blockedTrackers=&surrogates=&noActionRequests=&adAttributionRequests=&ignoredByUserRequests=&test=1", "https://improving.duckduckgo.com/t/epbf_chrome?7856393&siteUrl=https%3A%2F%2Fprivacy-test-pages.site%2F&tds=&remoteConfigEtag=W%2F%22385328de7ebe3fabd23f4c5c8c92ddaf%22&remoteConfigVersion=1768211267089&upgradedHttps=false&urlParametersRemoved=false&ctlYouTube=false&ctlFacebookPlaceholderShown=false&ctlFacebookLogin=false&performanceWarning=false&userRefreshCount=0&locale=en-US&protectionsState=true&category=dislike&errorDescriptions=%5B%5D&openerContext=external&contentScopeExperiments=fingerprintingCanvasAdditionalEnabledCheck%3Acontrol&extensionVersion=2026.1.12&atb=v518-1&ignoreRequests=&blockedTrackers=&surrogates=&noActionRequests=&adAttributionRequests=&ignoredByUserRequests=&test=1"]
88 | await backgroundPage.evaluate(() => globalThis.components.dashboardMessaging.submitBrokenSiteReport({ category: 'dislike' }));
89 | await gotPixel;
> 90 | expect(pixels).toHaveLength(1);
| ^
91 | const pixel = _formatPixelRequestForTesting(pixels[0]);
92 | expect(pixel).toMatchObject({
93 | name: 'epbf_chrome',
at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/broken-site-report.spec.js:90:24
|
|
[chromium] › integration-test/atb.spec.js:77:13 › install workflow › atb values › should get its ATB param from the success page when one is present:
integration-test/atb.spec.js#L109
1) [chromium] › integration-test/atb.spec.js:77:13 › install workflow › atb values › should get its ATB param from the success page when one is present
Error: expect(received).toEqual(expected) // deep equality
Expected: 1
Received: 0
107 | expect(setAtb).toEqual(atb);
108 | expect(extiSent).toBeTruthy();
> 109 | expect(numExtiCalled).toEqual(1);
| ^
110 | });
111 | });
112 |
at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/atb.spec.js:109:35
|
|
[chromium] › integration-test/storage-blocking.spec.js:18:9 › Storage blocking Tests › Blocks storage correctly on https://privacy-test-pages.site/privacy-protections/storage-blocking/:
integration-test/storage-blocking.spec.js#L37
1) [chromium] › integration-test/storage-blocking.spec.js:18:9 › Storage blocking Tests › Blocks storage correctly on https://privacy-test-pages.site/privacy-protections/storage-blocking/
Error: blocks 3rd party JS cookies from trackers
expect(received).toBeUndefined()
Received: {"domain": "broken.third-party.site", "expires": 1803588370.53148, "httpOnly": false, "name": "jsdata", "path": "/privacy-protections/storage-blocking", "sameSite": "None", "secure": true, "value": "990"}
35 |
36 | const expectUnmodified = (desc) => (c) => expect(c.expires, desc).toBeGreaterThan(nowSeconds);
> 37 | const expectBlocked = (desc) => (c) => expect(c, desc).toBeUndefined();
| ^
38 | const expectedCookies = {
39 | [testPageDomain]: {
40 | top_firstparty_headerdata: expectUnmodified('does not block 1st party HTTP cookies'),
at Object.jsdata (/home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/storage-blocking.spec.js:37:64)
at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/storage-blocking.spec.js:64:60
|
|
playwright-tests-firefox (2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests-firefox (3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests-firefox (4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests-firefox (1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright-mv2, 1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright-mv2, 2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright, 2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright-mv2, 3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright, 3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright, 1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright-mv2, 4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
playwright-tests (playwright, 4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
|
|
🎭 Playwright Run Summary
1 passed (17.8s)
|
|
🎭 Playwright Run Summary
2 passed (24.1s)
|
|
🎭 Playwright Run Summary
1 passed (17.8s)
|
|
🎭 Playwright Run Summary
3 passed (34.7s)
|
|
🎭 Playwright Run Summary
2 skipped
16 passed (56.5s)
|
|
🎭 Playwright Run Summary
4 skipped
14 passed (51.0s)
|
|
🎭 Playwright Run Summary
3 skipped
13 passed (52.9s)
|
|
🎭 Playwright Run Summary
17 passed (1.1m)
|
|
🎭 Playwright Run Summary
16 passed (1.0m)
|
|
🎭 Playwright Run Summary
2 flaky
[chromium] › integration-test/atb.spec.js:77:13 › install workflow › atb values › should get its ATB param from the success page when one is present
[chromium] › integration-test/broken-site-report.spec.js:78:9 › Broken site reports › Includes correct metadata when blocklist fetch fails
2 skipped
13 passed (1.0m)
|
|
🎭 Playwright Run Summary
1 flaky
[chromium] › integration-test/storage-blocking.spec.js:18:9 › Storage blocking Tests › Blocks storage correctly on https://privacy-test-pages.site/privacy-protections/storage-blocking/
16 passed (1.2m)
|
|
🎭 Playwright Run Summary
16 passed (1.3m)
|