Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

webnn: add fp16 conformance tests for activation operations #51508

Merged
merged 1 commit into from
Mar 24, 2025

webnn: add fp16 conformance tests for activation operations

90b04e7
Select commit
Loading
Failed to load commit list.
Merged

webnn: add fp16 conformance tests for activation operations #51508

webnn: add fp16 conformance tests for activation operations
90b04e7
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-chrome-dev-results succeeded Mar 24, 2025 in 6m 13s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in chrome.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-03-24T18:49:04.121Z
Resolved: 2025-03-24T18:55:15.829Z
Task Execution Time: 6 minutes, 11 seconds, 708 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wpt_report.json.gz
- public/results/wpt_screenshot.txt.gz

WPT Command: python3 ./wpt run --channel=dev --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome

[taskcluster 2025-03-24 18:49:04.163Z] Task ID: fo2JG46fTXSMJjecrjrYuw
[taskcluster 2025-03-24 18:49:04.163Z] Worker ID: 8866578145928295243
[taskcluster 2025-03-24 18:49:04.163Z] Worker Group: us-central1-c
[taskcluster 2025-03-24 18:49:04.163Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2025-03-24 18:49:04.163Z] Worker Pool: proj-wpt/ci
[taskcluster 2025-03-24 18:49:04.163Z] Worker Version: 46.1.0
[taskcluster 2025-03-24 18:49:04.163Z] Public IP: 34.69.199.13
[taskcluster 2025-03-24 18:49:04.163Z] Hostname: proj-wpt-ci-e3qpppuds4kdqhbat56-ua

[taskcluster 2025-03-24 18:49:04.748Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/libvirt-uri.sh ']'
+ . /etc/profile.d/libvirt-uri.sh

...(6205 lines hidden)...

/webnn/conformance_tests/sign.https.any.html?cpu
  FAIL sign int64 3D tensor - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int64 must be one of [float32,float16,int32]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
  FAIL sign int8 4D tensor - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int8 must be one of [float32,float16,int32]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.worker.html?npu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.serviceworker.html?gpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.html?gpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.serviceworker.html?npu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.html?cpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.worker.html?cpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.sharedworker.html?cpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.html?npu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.worker.html?gpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.serviceworker.html?cpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.sharedworker.html?gpu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/subgraph.https.any.sharedworker.html?npu
  FAIL quantized conv2d - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type int32 must be one of [int8,uint8,int4]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/tile.https.any.html?cpu
  FAIL tile uint32 2D tensor - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type uint32 must be one of [float32,float16,int32,int64,uint8]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/tile.https.any.html?npu
  FAIL tile uint32 2D tensor - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type uint32 must be one of [float32,float16,int32,int64,uint8]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/conformance_tests/tile.https.any.html?gpu
  FAIL tile uint32 2D tensor - promise_test: Unhandled rejection with value: object "TypeError: Unsupported data type, input 'input' data type uint32 must be one of [float32,float16,int32,int64,uint8]."
Error
    at get_stack (https://web-platform.test:8443/resources/testharness.js:4571:21)
    at new AssertionError (https://web-platform.test:8443/resources/testharness.js:4564:22)
    at assert (https://web-platform.test:8443/resources/testharness.js:4548:19)
    at Test.<anonymous> (https://web-platform.test:8443/resources/testharness.js:764:29)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at https://web-platform.test:8443/resources/testharness.js:2689:35
/webnn/idlharness.https.any.serviceworker.html
  FAIL MLGraphBuilder interface: operation softmax(MLOperand, unsigned long, optional MLOperatorOptions) - assert_equals: property has wrong .length expected 2 but got 1
    at IdlInterface.do_member_operation_asserts (https://web-platform.test:8443/resources/idlharness.js:2365:5)
    at IdlInterface.<anonymous> (https://web-platform.test:8443/resources/idlharness.js:2310:14)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at IdlInterface.test_member_operation (https://web-platform.test:8443/resources/idlharness.js:2258:12)
    at IdlInterface.test_members (https://web-platform.test:8443/resources/idlharness.js:2722:26)
/webnn/idlharness.https.any.sharedworker.html
  FAIL MLGraphBuilder interface: operation softmax(MLOperand, unsigned long, optional MLOperatorOptions) - assert_equals: property has wrong .length expected 2 but got 1
    at IdlInterface.do_member_operation_asserts (https://web-platform.test:8443/resources/idlharness.js:2365:5)
    at IdlInterface.<anonymous> (https://web-platform.test:8443/resources/idlharness.js:2310:14)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at IdlInterface.test_member_operation (https://web-platform.test:8443/resources/idlharness.js:2258:12)
    at IdlInterface.test_members (https://web-platform.test:8443/resources/idlharness.js:2722:26)
/webnn/idlharness.https.any.worker.html
  FAIL MLGraphBuilder interface: operation softmax(MLOperand, unsigned long, optional MLOperatorOptions) - assert_equals: property has wrong .length expected 2 but got 1
    at IdlInterface.do_member_operation_asserts (https://web-platform.test:8443/resources/idlharness.js:2365:5)
    at IdlInterface.<anonymous> (https://web-platform.test:8443/resources/idlharness.js:2310:14)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at IdlInterface.test_member_operation (https://web-platform.test:8443/resources/idlharness.js:2258:12)
    at IdlInterface.test_members (https://web-platform.test:8443/resources/idlharness.js:2722:26)
/webnn/idlharness.https.any.html
  FAIL MLGraphBuilder interface: operation softmax(MLOperand, unsigned long, optional MLOperatorOptions) - assert_equals: property has wrong .length expected 2 but got 1
    at IdlInterface.do_member_operation_asserts (https://web-platform.test:8443/resources/idlharness.js:2365:5)
    at IdlInterface.<anonymous> (https://web-platform.test:8443/resources/idlharness.js:2310:14)
    at Test.step (https://web-platform.test:8443/resources/testharness.js:2642:25)
    at IdlInterface.test_member_operation (https://web-platform.test:8443/resources/idlharness.js:2258:12)
    at IdlInterface.test_members (https://web-platform.test:8443/resources/idlharness.js:2722:26)
 2:19.66 INFO Got 94 unexpected results, with 0 unexpected passes
 2:19.66 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 2:19.68 wptserve INFO Stopped http server on 127.0.0.1:8000
 2:19.86 wptserve INFO Stopped http server on 127.0.0.1:8001
 2:19.86 wptserve INFO Stopped http server on 127.0.0.1:8003
 2:19.86 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 2:19.86 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 2:19.86 wptserve INFO Stopped http server on 127.0.0.1:8445
 2:19.86 wptserve INFO Stopped http server on 127.0.0.1:8002
 2:19.86 wptserve INFO Stopped http server on 127.0.0.1:8444
 2:19.87 wptserve INFO Stopped http server on 127.0.0.1:9000
 2:19.88 wptserve INFO Stopped http server on 127.0.0.1:8446
 2:19.95 wptserve INFO Stopped http server on 127.0.0.1:8443
 2:19.99 INFO Removed font: Ahem.ttf
 2:20.02 INFO Closing logging queue
 2:20.02 INFO queue closed
 2:20.02 INFO Tolerating 94 unexpected results
[taskcluster 2025-03-24 18:55:13.919Z] === Task Finished ===
[taskcluster 2025-03-24 18:55:14.597Z] Successful task run with exit code: 0 completed in 370.435 seconds
View more details on Community-TC Integration