Skip to content

trigger benchmark for test#10

Closed
kaitj wants to merge 2 commits into
mainfrom
test/benchmark
Closed

trigger benchmark for test#10
kaitj wants to merge 2 commits into
mainfrom
test/benchmark

Conversation

@kaitj
Copy link
Copy Markdown
Owner

@kaitj kaitj commented May 22, 2026

No description provided.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 29, 2026

Coverage

Coverage Report
FileStmtsMissCoverMissing
__init__.py90100% 
__main__.py69888%101, 110, 135, 137–138, 164, 168, 172
_entities.py112199%129
_indexing.py212597%150, 159–160, 409, 447
_logging.py31487%30, 37, 39–40
_metadata.py48491%39–40, 66, 71
_pathlib.py21576%16–17, 19–20, 22
_version.py110100% 
pybids
   __init__.py40100% 
   _bidsfile.py381365%71–73, 77–79, 83–85, 89–91, 95
   _layout.py1564571%63, 72, 81, 104, 114–115, 118, 140–141, 156–157, 173–174, 177–181, 186, 188–189, 192–193, 228, 233, 241, 322–324, 389–394, 396, 399–404, 406, 462, 482
   _utils.py13561%47–50, 52
TOTAL7249087% 

Tests Skipped Failures Errors Time
100 1 💤 0 ❌ 0 🔥 12.010s ⏱️

@kaitj kaitj force-pushed the test/benchmark branch from 84e00f4 to 8ebe8a8 Compare May 29, 2026 15:10
Repository owner deleted a comment from github-actions Bot May 29, 2026
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 29, 2026

Benchmark Results

Local index (1 workers) Local index (4 workers) Remote index (4 workers) Bold query Metadata query Subject query
test/benchmark 137.102 (156.163 ± 60.096) ms 152.820 (177.732 ± 78.918) ms 75.249 (75.660 ± 2.086) s 228.263 (231.211 ± 14.404) µs 327.553 (339.292 ± 34.072) µs 37.882 (44.741 ± 12.747) µs
main 136.288 (157.114 ± 64.923) ms 156.947 (180.228 ± 72.863) ms 75.227 (75.200 ± 1.557) s 267.207 (269.167 ± 44.658) µs 338.921 (354.508 ± 43.037) µs 37.412 (46.666 ± 22.093) µs
test/benchmark vs main ratio ⚪ 1.006 ⚪ 0.974 ⚪ 1.000 🟢 0.854 ⚪ 0.966 ⚪ 1.013

median (mean ± std)

🔴 Slower   ⚪ No change   🟢 Faster

kaitj added 2 commits May 29, 2026 13:27
- Add --threshold/-t flag to benchmark script (default 0.05) to define
  the minimum ratio difference before marking a change as slower/faster
- Rewrite _ratio to compare % change  against threshold
- Display 3 decimal places in ratio output to surface small differences
@kaitj kaitj force-pushed the test/benchmark branch from 8ebe8a8 to 4a0058d Compare May 29, 2026 17:35
@kaitj kaitj closed this May 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant