Skip to content

revert to ubuntu-latest runners, switch dataset source to BAB v0.4.0 #47

revert to ubuntu-latest runners, switch dataset source to BAB v0.4.0

revert to ubuntu-latest runners, switch dataset source to BAB v0.4.0 #47

Triggered via push April 1, 2026 03:29
Status Success
Total duration 1h 17m 1s
Artifacts 2

benchmarks.yml

on: push
Macro Benchmark - Wikipedia 100K
25m 13s
Macro Benchmark - Wikipedia 100K
Macro Benchmark - OAI ArXiv 100K
1h 16m
Macro Benchmark - OAI ArXiv 100K
Fit to window
Zoom out
Zoom in

Annotations

2 warnings
Macro Benchmark - Wikipedia 100K
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Macro Benchmark - OAI ArXiv 100K
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
benchmark-results-openai-100K Expired
2.33 KB
sha256:ea6c4425dd33448ab4d2c0079d630325f4689d678ec50e4c5a226ac7ecf5b3da
benchmark-results-wikipedia-100K Expired
2.35 KB
sha256:eb198cfb1e0c82050326d02888612124ab2846688ac5c4696d1a53f604e52b8f