Skip to content

Use jinja2 Sandbox instead of direct Template and enforce it #2523

Use jinja2 Sandbox instead of direct Template and enforce it

Use jinja2 Sandbox instead of direct Template and enforce it #2523

Triggered via pull request July 1, 2026 14:21
Status Success
Total duration 2m 53s
Artifacts 5

CI.yml

on: pull_request
select-category
19s
select-category
lint-and-test
32s
lint-and-test
get-entries  /  get-entries
22s
get-entries / get-entries
Matrix: mock-evaluation
summarize-results  /  Results
1m 21s
summarize-results / Results
Fit to window
Zoom out
Zoom in

Annotations

6 warnings
lint-and-test
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
lint-and-test
Failed to save: Unable to reserve cache with key setup-uv-2-x86_64-unknown-linux-gnu-ubuntu-24.04-unknown-pruned-d7f08daded06358da19f99984b5c65c2bc32c1add032b465182d29281549b947, another job may be creating this cache.
bcbench.results.base
Result for nl2al__vendor-onboarding-complete-flag-1 missing metrics: turn_count, completion_tokens
bcbench.results.base
Result for nl2al__sales-by-salesperson-report-1 missing metrics: execution_time, llm_duration, turn_count, prompt_tokens, completion_tokens, tool_usage
bcbench.results.base
Creating result for nl2al__vendor-lead-time-note-field-1 with no agent metrics - performance data will be unavailable
bcbench.results.base
Result for nl2al__job-internal-review-note-field-1 missing metrics: prompt_tokens, completion_tokens

Artifacts

Produced during runtime
Name Size Digest
evaluation-summary Expired
467 Bytes
sha256:5003b739e4e18d3a986762df00d56245bc8af5189538adf70036f94cc0e2b428
nl2al__job-internal-review-note-field-1 Expired
523 Bytes
sha256:e4dfbdc9b636aa8c42d5026c26b47a64963a11b6ac314e2237afa2d139b421c9
nl2al__sales-by-salesperson-report-1 Expired
501 Bytes
sha256:a3fa5d830a6c9b6c8319af0f3518f2b3706f86e4d36218ba3a1bb85f99ce06c3
nl2al__vendor-lead-time-note-field-1 Expired
472 Bytes
sha256:88d9d35c07e4efeccbb07fcdcc37a47564059d11e3c0c5caba49bb96d3018fd7
nl2al__vendor-onboarding-complete-flag-1 Expired
538 Bytes
sha256:1575aa10d12d6936e099b510f6e72f2172a2b796531c8c447bfe914241cc53e1