Benchmark (LLM) #57
benchmark-llm-llamacpp.yml
on: workflow_dispatch
context
13s
Matrix: desktop
Matrix: matrix-linux
Matrix: matrix-s25 / build-and-test
Waiting for pending jobs
matrix-combine
9s
summarize
11s
Annotations
10 warnings and 3 notices
|
vlm-macos-arm64-gpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-linux-x64-cpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-linux-x64-cpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-windows-x64-cpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-macos-arm64-gpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-windows-x64-cpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-linux-x64-gpu-fabric
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-matrix-linux-gpu
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-linux-x64-gpu-upstream
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-matrix-linux-cpu
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 16th, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
vlm-windows-x64-cpu-addon
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026
|
|
vlm-windows-x64-cpu-fabric
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026
|
|
vlm-windows-x64-cpu-upstream
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
vlm-matrix-consolidated-57
|
1.75 KB |
sha256:880202b6c0f15b24f883ca26b4542b519b7d3a0ecfb9abd77bde7fd7567b4d85
|
|
|
vlm-matrix-log-linux-cpu-57
|
46.2 KB |
sha256:c172837d2069533a10a8e125285d4f55d008a0d46ff5199daf635fcbf14fe9c3
|
|
|
vlm-matrix-log-linux-gpu-57
|
46.3 KB |
sha256:388bce60d2bb26e18513ed558ba190a4288735e673fdc2ed0770604de3654b69
|
|
|
vlm-perf-consolidated-57
|
17.9 KB |
sha256:2454f50d0300c9480d7b1b5d511fe40074716e59fb12bad62de4e543382b8da1
|
|
|
vlm-perf-linux-x64-cpu-addon-57
|
20.5 KB |
sha256:ccf2ba2b588f887912e81de43b832c2ade2c6ed93bb6db42af1a0c2e69f6c14b
|
|
|
vlm-perf-linux-x64-cpu-fabric-57
|
5.72 KB |
sha256:54d57d55012abcaa0de1e3e5c497e0f4b84afe5e5038bcb73bb7a7229c6cc82e
|
|
|
vlm-perf-linux-x64-cpu-upstream-57
|
5.61 KB |
sha256:3bc8052feb4d953232a9b83094cd59566a05e8bce8f5af6da78aa92f4679915f
|
|
|
vlm-perf-linux-x64-gpu-addon-57
|
20 KB |
sha256:a866d4b2da238077f4c2a48aa0c08db417f222c6c5d628f7776ce0937741dabe
|
|
|
vlm-perf-linux-x64-gpu-fabric-57
|
5.85 KB |
sha256:5a5a8c0424bc51a990022efac8a4bbc1d000dac25749fa8678dfaba157eca29c
|
|
|
vlm-perf-linux-x64-gpu-upstream-57
|
5.76 KB |
sha256:73b2c113df1003b87e78455156c6af3f7245e9f52e4a02b0187093fb7f0a1952
|
|
|
vlm-perf-macos-arm64-gpu-addon-57
|
19.9 KB |
sha256:1f3fbbb483f5df192dc67955d57fe80351e24dff726b831607d146770e4ccf72
|
|
|
vlm-perf-macos-arm64-gpu-fabric-57
|
5.65 KB |
sha256:5e49ed81f5b7005943057496f442fd941238107f9ef5383cc41d4a4d55e0e62b
|
|
|
vlm-perf-macos-arm64-gpu-upstream-57
|
4.46 KB |
sha256:6ac2e5248291c86fbadcf250aebf01669f7e053b7057fd18f154f675b7fbffd5
|
|
|
vlm-perf-windows-x64-cpu-addon-57
|
20.6 KB |
sha256:3ae05c9d3449d77d304f6b1dad64ad08e71e4bab0274bf07ecdaf855821579a6
|
|
|
vlm-perf-windows-x64-cpu-fabric-57
|
5.81 KB |
sha256:3d4a4ae1daf990cfcae221a797937d26881d77a1ddf1648d224ceabfa9276130
|
|
|
vlm-perf-windows-x64-cpu-upstream-57
|
5.56 KB |
sha256:21b6212a8544ea316150e5b578ea916e91adae574dfa1a6379778f2c32e7d651
|
|
|
vlm-perf-windows-x64-gpu-addon-57
|
20.3 KB |
sha256:4215b1e33834606f053f18226d47ed33bf5c54080bb45292f1b540b7160aa174
|
|