Benchmark Quality Gate

fix: v0.18.1 — fix rule loading path and sync all YAML rule files #22

Sign in to view logs

Triggered via push March 10, 2026 01:12

HeadyZhang

master

Status Success

Total duration 29s

Artifacts 2

benchmark.yml

on: push

precision-recall

Agent-Vuln-Bench

Multi-Tool Comparison (Optional)

Quality Gate Check (v2)

Annotations

4 errors, 4 warnings, and 3 notices

precision-recall

Process completed with exit code 1.

Agent-Vuln-Bench

Process completed with exit code 1.

Agent-Vuln-Bench

Process completed with exit code 1.

Quality Gate Check (v2)

Process completed with exit code 1.

precision-recall

F1 81.84% below 0.87 target

precision-recall

Recall 82.70% below 85% target

precision-recall

Precision 80.99% below 90% target

Agent-Vuln-Bench

No files were found with the provided path: results/baseline.json. No artifacts will be uploaded.

fixture-count

Ground truth coverage good (81 samples)

fixture-count

Fixture count good (84)

atlas-coverage

ATLAS coverage good (32 rules)

Artifacts

Produced during runtime

Name	Size	Digest
avb-results Expired	3.35 KB	`sha256:2c3a6ab8b5d81a0ad236cdb4de8c58f68e811bab8e4b5b3d8c660c2e90d0844b`
layer1-results Expired	2.92 KB	`sha256:297a15ab6010b701b6f7ea0a1e3d4be1b7312f92f18dc1931f13f56c008fdbbb`