Add reftests for the image(<color>) CSS function #59941
Community-TC (pull_request)
Collect results for all tests affected by a pull request in firefox.
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2026-05-18T10:53:00.864Z
Resolved: 2026-05-18T10:57:04.668Z
Task Execution Time: 4 minutes, 3 seconds, 804 milliseconds
Task Status: completed
Reason Resolved: completed
TaskId: XAhPqCegS6iUtMyXyTEXhA
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz
WPT Command: python3 ./wpt run --channel=nightly --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox
[taskcluster 2026-05-18 10:53:00.972Z] Task ID: XAhPqCegS6iUtMyXyTEXhA
[taskcluster 2026-05-18 10:53:00.972Z] Worker ID: 2891846065188196749
[taskcluster 2026-05-18 10:53:00.972Z] Worker Group: us-east4-b
[taskcluster 2026-05-18 10:53:00.972Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-05-18 10:53:00.972Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-05-18 10:53:00.972Z] Worker Version: 46.1.0
[taskcluster 2026-05-18 10:53:00.972Z] Public IP: 136.107.13.184
[taskcluster 2026-05-18 10:53:00.972Z] Hostname: proj-wpt-ci-h-ivtvqor0mcrfemg62eiq
66587c81b81a - Started downloading
b1e71f63927a - Started downloading
b1e71f63927a - Downloaded in 0.006 seconds
5b82b858ea7e - Started downloading
08c7e224535e - Started downloading
08c7e224535e - Downloaded in 0.009 seconds
66587c81b81a - Downloaded in 0.201 seconds
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.001 seconds
32bbaaf98e4c - Started downloading
dd5257950bd4 - Started downloading
...(325 lines hidden)...
Failed to read: session.screen0.tab.width
Setting default value
Failed to read: session.screen0.tooltipDelay
Setting default value
Failed to read: session.screen0.allowRemoteActions
Setting default value
Failed to read: session.screen0.clientMenu.usePixmap
Setting default value
Failed to read: session.screen0.tabs.usePixmap
Setting default value
Failed to read: session.screen0.tabs.maxOver
Setting default value
Failed to read: session.screen0.tabs.intitlebar
Setting default value
Failed to read: session.screen0.focusModel
Setting default value
Failed to read: session.screen0.tabFocusModel
Setting default value
Failed to read: session.screen0.focusNewWindows
Setting default value
Failed to read: session.screen0.focusSameHead
Setting default value
Failed to read: session.screen0.rowPlacementDirection
Setting default value
Failed to read: session.screen0.colPlacementDirection
Setting default value
Failed to read: session.screen0.windowPlacement
Setting default value
Failed to read: session.screen0.slit.acceptKdeDockapps
Setting default value
Failed to read: session.screen0.slit.autoHide
Setting default value
Failed to read: session.screen0.slit.maxOver
Setting default value
Failed to read: session.screen0.slit.placement
Setting default value
Failed to read: session.screen0.slit.alpha
Setting default value
Failed to read: session.screen0.slit.onhead
Setting default value
Failed to read: session.screen0.slit.layer
Setting default value
Failed to read: session.screen0.toolbar.autoHide
Setting default value
Failed to read: session.screen0.toolbar.maxOver
Setting default value
Failed to read: session.screen0.toolbar.visible
Setting default value
Failed to read: session.screen0.toolbar.alpha
Setting default value
Failed to read: session.screen0.toolbar.layer
Setting default value
Failed to read: session.screen0.toolbar.onhead
Setting default value
Failed to read: session.screen0.toolbar.placement
Setting default value
Failed to read: session.screen0.toolbar.height
Setting default value
Failed to read: session.screen0.iconbar.mode
Setting default value
Failed to read: session.screen0.iconbar.alignment
Setting default value
Failed to read: session.screen0.iconbar.iconWidth
Setting default value
Failed to read: session.screen0.iconbar.iconTextPadding
Setting default value
Failed to read: session.screen0.iconbar.usePixmap
Setting default value
Warning: could not load product 'firefox_android' for argument registration: No module named 'mozrunner'
Warning: could not load product 'firefox' for argument registration: No module named 'mozleak'
0:00.00 INFO Set tests_root to /home/test/web-platform-tests
0:00.00 INFO Set metadata_root to /home/test/web-platform-tests
0:00.00 INFO Set manifest_update to True
0:00.00 INFO Set manifest_download to True
0:45.15 INFO Identified 3 affected tests
0:45.15 INFO Using certutil /usr/bin/certutil
0:45.15 INFO Downloading geckodriver
0:45.15 INFO Attempting to install webdriver from nightly
mem avail: 14658 of 15806 MiB (92.74%), swap free: 0 of 0 MiB ( 0.00%)
0:45.51 INFO Extracted geckodriver to /home/test/web-platform-tests/_venv3/bin/geckodriver
0:45.52 INFO Installed b'geckodriver 0.36.0 (04f987534771 2026-05-12 16:19 +0000)'
0:51.86 INFO Getting profile data from git ref 8b3456fa29ad35f58da4cc0a1d182e039124ba5d
0:51.95 INFO Test prefs downloaded to /home/test/web-platform-tests/_venv3/profiles/8b3456fa29ad35f58da4cc0a1d182e039124ba5d/152.0a1
0:51.95 INFO Downloading OpenH264 plugin
0:58.26 INFO Downloading openh264.json from git ref 8b3456fa29ad35f58da4cc0a1d182e039124ba5d
0:58.27 INFO Downloading OpenH264 plugin from https://ciscobinary.openh264.org/openh264-linux64-652bdb7719f30b52b08e506645a7322ff1b2cc6f.zip
0:58.38 INFO OpenH264 plugin installed to /home/test/web-platform-tests/_venv3/browsers/nightly/gmp-gmpopenh264/2.6.0
0:58.38 INFO Using OpenH264 plugin in /home/test/web-platform-tests/_venv3/browsers/nightly/gmp-gmpopenh264/2.6.0
[1947] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
0:58.44 mozversion INFO application_buildid: 20260517203605
0:58.44 mozversion INFO application_changeset: 84ada9fc338c58996621b513085ed51bb13074ac
0:58.44 mozversion INFO application_display_name: Firefox Nightly
0:58.44 mozversion INFO application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
0:58.44 mozversion INFO application_name: Firefox
0:58.44 mozversion INFO application_remotingname: firefox-nightly
0:58.44 mozversion INFO application_repository: https://hg.mozilla.org/mozilla-central
0:58.44 mozversion INFO application_vendor: Mozilla
0:58.44 mozversion INFO application_version: 152.0a1
0:58.44 mozversion INFO platform_buildid: 20260517203605
0:58.44 mozversion INFO platform_changeset: 84ada9fc338c58996621b513085ed51bb13074ac
0:58.44 mozversion INFO platform_repository: https://hg.mozilla.org/mozilla-central
0:58.44 mozversion INFO platform_version: 152.0a1
1:09.22 INFO Installed font: Ahem.ttf
1:10.32 wptserve INFO Starting http server on http://127.0.0.1:8002
1:10.39 wptserve INFO Starting http server on http://127.0.0.1:8000
1:10.40 wptserve INFO Starting http server on http://127.0.0.1:8001
1:10.42 wptserve INFO Starting https server on https://127.0.0.1:8444
1:10.44 wptserve INFO Starting http server on http://127.0.0.1:8003
1:10.44 wptserve INFO Starting http2 server on https://127.0.0.1:9000
1:10.45 wptserve INFO Starting https server on https://127.0.0.1:8443
1:10.45 wptserve INFO Starting https server on https://127.0.0.1:8445
1:10.45 wptserve INFO Starting https server on https://127.0.0.1:8446
1:10.47 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
1:10.47 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
1:10.47 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
1:10.47 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
1:10.47 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
1:10.47 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
1:10.58 wptserve INFO Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
1:10.79 SUITE_START: web-platform-test - running 3 tests
1:30.91 INFO Using 1 child processes
1:30.92 INFO Setting up ssl
1:30.95 certutil Full command: /usr/bin/certutil -N -d /tmp/tmpw54jnzon.mozrunner -f /tmp/tmpw54jnzon.mozrunner/.crtdbpw
certutil b''
1:30.97 certutil b''
1:30.98 certutil b'\nCertificate Nickname Trust Attributes\n SSL,S/MIME,JAR/XPI\n\nweb-platform-tests CT,, \n'
1:30.98 INFO Application command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank -profile /tmp/tmp5eb515qf
1:31.00 INFO Starting runner
1:31.00 pid:2055 Full command: /home/test/build/firefox/firefox --marionette --remote-allow-system-access about:blank
pid:2055 [2055] Sandbox: CanCreateUserNamespace() clone() failure: EPERM
1:31.67 pid:2055 1779101814564 Marionette INFO Marionette enabled
1:31.78 pid:2055 1779101814676 Marionette INFO Listening on port 42575
Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
1:34.51 pid:2055 console.error: services.settings:
1:34.51 pid:2055 Message: EmptyDatabaseError: "main/nimbus-desktop-experiments" has not been synced yet
1:34.51 pid:2055 Stack:
1:34.51 pid:2055 EmptyDatabaseError@resource://services-settings/Database.sys.mjs:19:5
1:34.51 pid:2055 list@resource://services-settings/Database.sys.mjs:96:13
1:35.18 TEST_START: /css/css-images/image-color-basic.html
1:35.37 pid:2055 1779101818261 Marionette INFO Testing http://web-platform.test:8000/css/css-images/image-color-basic.html == http://web-platform.test:8000/css/css-images/image-color-basic-ref.html
1:35.61 pid:2055 1779101818504 Marionette INFO No differences allowed
1:35.62 TEST_END: FAIL, expected PASS - Testing http://web-platform.test:8000/css/css-images/image-color-basic.html == http://web-platform.test:8000/css/css-images/image-color-basic-ref.html
Found 200 pixels different, maximum difference per channel 42
1:35.62 TEST_START: /css/css-images/image-color-cross-fade.html
1:35.62 pid:2055 1779101818517 Marionette INFO Testing http://web-platform.test:8000/css/css-images/image-color-cross-fade.html == http://web-platform.test:8000/css/css-images/image-color-cross-fade-ref.html
1:35.75 pid:2055 1779101818647 Marionette INFO No differences allowed
1:35.76 TEST_END: FAIL, expected PASS - Testing http://web-platform.test:8000/css/css-images/image-color-cross-fade.html == http://web-platform.test:8000/css/css-images/image-color-cross-fade-ref.html
Found 20000 pixels different, maximum difference per channel 255
1:35.76 TEST_START: /css/css-images/image-color-layered.html
1:35.76 pid:2055 1779101818658 Marionette INFO Testing http://web-platform.test:8000/css/css-images/image-color-layered.html == http://web-platform.test:8000/css/css-images/image-color-layered-ref.html
1:35.90 pid:2055 1779101818797 Marionette INFO No differences allowed
1:35.91 TEST_END: FAIL, expected PASS - Testing http://web-platform.test:8000/css/css-images/image-color-layered.html == http://web-platform.test:8000/css/css-images/image-color-layered-ref.html
Found 100 pixels different, maximum difference per channel 20
1:35.91 INFO No more tests
1:35.94 pid:2055 1779101818835 Marionette INFO Stopped listening on port 42575
1:36.44 INFO Browser exited with return code 0
1:36.25 INFO Closing logging queue
1:36.25 INFO queue closed
1:36.46 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 3 checks (3 tests)
Expected results: 0
Unexpected results: 3
test: 3 (3 fail)
Error Summary
-------------
FAIL /css/css-images/image-color-basic.html - Testing http://web-platform.test:8000/css/css-images/image-color-basic.html == http://web-platform.test:8000/css/css-images/image-color-basic-ref.html
Found 200 pixels different, maximum difference per channel 42
FAIL /css/css-images/image-color-cross-fade.html - Testing http://web-platform.test:8000/css/css-images/image-color-cross-fade.html == http://web-platform.test:8000/css/css-images/image-color-cross-fade-ref.html
Found 20000 pixels different, maximum difference per channel 255
FAIL /css/css-images/image-color-layered.html - Testing http://web-platform.test:8000/css/css-images/image-color-layered.html == http://web-platform.test:8000/css/css-images/image-color-layered-ref.html
Found 100 pixels different, maximum difference per channel 20
1:36.46 INFO Got 3 unexpected results, with 0 unexpected passes
1:36.46 wptserve INFO Stopped http server on 127.0.0.1:8000
1:36.46 wptserve INFO Stopped http server on 127.0.0.1:8001
1:36.46 wptserve INFO Stopped http server on 127.0.0.1:8003
1:36.46 wptserve INFO Stopped http server on 127.0.0.1:8002
1:36.46 wptserve INFO Stopped http server on 127.0.0.1:8443
1:36.47 wptserve INFO Stopped http server on 127.0.0.1:8446
1:36.47 wptserve INFO Stopped http server on 127.0.0.1:8445
1:36.47 wptserve INFO Stopped http server on 127.0.0.1:8444
1:36.48 wptserve INFO Stopped http server on 127.0.0.1:9000
1:36.48 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
1:36.82 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
1:36.82 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
1:36.86 INFO Removed font: Ahem.ttf
1:36.89 INFO Closing logging queue
1:36.89 INFO queue closed
1:36.89 INFO Tolerating 3 unexpected results
[taskcluster 2026-05-18 10:57:02.823Z] === Task Finished ===
[taskcluster 2026-05-18 10:57:03.902Z] Successful task run with exit code: 0 completed in 242.934 seconds