Skip to content

Ci/benchmark#13

Merged
kaitj merged 8 commits into
mainfrom
ci/benchmark
May 29, 2026
Merged

Ci/benchmark#13
kaitj merged 8 commits into
mainfrom
ci/benchmark

Conversation

@kaitj
Copy link
Copy Markdown
Owner

@kaitj kaitj commented May 22, 2026

No description provided.

kaitj added 7 commits May 21, 2026 16:08
- Mark tests with "cloud" and / or "benchmark" as needed
- Combine both "dev" and "benchmark" dependencies, was causing issues with the pytest due to imports (alternatively, use `try-except` block for optional dependency import)
- Replace pandas with polars in dev dependency (for benchmarking)
- Switch to shortened SHA for PR
- Add PR for unique output file artifact
- Disable comparison against tag due to lack of dependency group
- Add step to comment on PR
- Sort labels for comment
- Fold CI scripts into local benchmark script
- Remove CI workflow
- Use importlib for pytest for identical file names across different test modules
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 22, 2026

Coverage

Coverage Report
FileStmtsMissCoverMissing
__init__.py90100% 
__main__.py69888%101, 110, 135, 137–138, 164, 168, 172
_entities.py112199%129
_indexing.py212597%150, 159–160, 409, 447
_logging.py31487%30, 37, 39–40
_metadata.py48491%39–40, 66, 71
_pathlib.py21576%16–17, 19–20, 22
_version.py110100% 
pybids
   __init__.py40100% 
   _bidsfile.py381365%71–73, 77–79, 83–85, 89–91, 95
   _layout.py1564571%63, 72, 81, 104, 114–115, 118, 140–141, 156–157, 173–174, 177–181, 186, 188–189, 192–193, 228, 233, 241, 322–324, 389–394, 396, 399–404, 406, 462, 482
   _utils.py13561%47–50, 52
TOTAL7249087% 

Tests Skipped Failures Errors Time
100 1 💤 0 ❌ 0 🔥 10.475s ⏱️

@kaitj
Copy link
Copy Markdown
Owner Author

kaitj commented May 22, 2026

na: to merge + test generation of md file

- Rename coverage.yaml -> report.yaml and expand to handle both CI (coverage)
  and Benchmark results in a single workflow
- Benchmark workflow: fix undefined matrix reference in artifact name, add
  PR number recording, record PR number and report file as artifacts
- scripts/benchmark.py: add -f/--output-file flag to allow specifying a
  fixed output filename for CI artifact consumption
- Report workflow conditionally downloads the correct artifact based on
  which upstream workflow triggered it, posts coverage comment for CI
  and creates/updates comment for benchmarks
@kaitj kaitj merged commit 6084899 into main May 29, 2026
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant