Skip to content

Benchmark (LLM)

Benchmark (LLM) #57

Manually triggered June 8, 2026 16:06
Status Success
Total duration 19m 25s
Artifacts 17

benchmark-llm-llamacpp.yml

on: workflow_dispatch
Matrix: desktop
Matrix: matrix-linux
Matrix: matrix-s25 / build-and-test
Waiting for pending jobs
android
0s
android
matrix-combine
9s
matrix-combine
summarize
11s
summarize
Fit to window
Zoom out
Zoom in

Annotations

10 warnings and 3 notices
vlm-macos-arm64-gpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-linux-x64-cpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-linux-x64-cpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-windows-x64-cpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-macos-arm64-gpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-windows-x64-cpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-linux-x64-gpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-matrix-linux-gpu
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-linux-x64-gpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-matrix-linux-cpu
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
vlm-windows-x64-cpu-addon
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026
vlm-windows-x64-cpu-fabric
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026
vlm-windows-x64-cpu-upstream
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026

Artifacts

Produced during runtime
Name Size Digest
vlm-matrix-consolidated-57
1.75 KB
sha256:880202b6c0f15b24f883ca26b4542b519b7d3a0ecfb9abd77bde7fd7567b4d85
vlm-matrix-log-linux-cpu-57
46.2 KB
sha256:c172837d2069533a10a8e125285d4f55d008a0d46ff5199daf635fcbf14fe9c3
vlm-matrix-log-linux-gpu-57
46.3 KB
sha256:388bce60d2bb26e18513ed558ba190a4288735e673fdc2ed0770604de3654b69
vlm-perf-consolidated-57
17.9 KB
sha256:2454f50d0300c9480d7b1b5d511fe40074716e59fb12bad62de4e543382b8da1
vlm-perf-linux-x64-cpu-addon-57
20.5 KB
sha256:ccf2ba2b588f887912e81de43b832c2ade2c6ed93bb6db42af1a0c2e69f6c14b
vlm-perf-linux-x64-cpu-fabric-57
5.72 KB
sha256:54d57d55012abcaa0de1e3e5c497e0f4b84afe5e5038bcb73bb7a7229c6cc82e
vlm-perf-linux-x64-cpu-upstream-57
5.61 KB
sha256:3bc8052feb4d953232a9b83094cd59566a05e8bce8f5af6da78aa92f4679915f
vlm-perf-linux-x64-gpu-addon-57
20 KB
sha256:a866d4b2da238077f4c2a48aa0c08db417f222c6c5d628f7776ce0937741dabe
vlm-perf-linux-x64-gpu-fabric-57
5.85 KB
sha256:5a5a8c0424bc51a990022efac8a4bbc1d000dac25749fa8678dfaba157eca29c
vlm-perf-linux-x64-gpu-upstream-57
5.76 KB
sha256:73b2c113df1003b87e78455156c6af3f7245e9f52e4a02b0187093fb7f0a1952
vlm-perf-macos-arm64-gpu-addon-57
19.9 KB
sha256:1f3fbbb483f5df192dc67955d57fe80351e24dff726b831607d146770e4ccf72
vlm-perf-macos-arm64-gpu-fabric-57
5.65 KB
sha256:5e49ed81f5b7005943057496f442fd941238107f9ef5383cc41d4a4d55e0e62b
vlm-perf-macos-arm64-gpu-upstream-57
4.46 KB
sha256:6ac2e5248291c86fbadcf250aebf01669f7e053b7057fd18f154f675b7fbffd5
vlm-perf-windows-x64-cpu-addon-57
20.6 KB
sha256:3ae05c9d3449d77d304f6b1dad64ad08e71e4bab0274bf07ecdaf855821579a6
vlm-perf-windows-x64-cpu-fabric-57
5.81 KB
sha256:3d4a4ae1daf990cfcae221a797937d26881d77a1ddf1648d224ceabfa9276130
vlm-perf-windows-x64-cpu-upstream-57
5.56 KB
sha256:21b6212a8544ea316150e5b578ea916e91adae574dfa1a6379778f2c32e7d651
vlm-perf-windows-x64-gpu-addon-57
20.3 KB
sha256:4215b1e33834606f053f18226d47ed33bf5c54080bb45292f1b540b7160aa174