Skip to content

[GHA][Coverage] Expand coverage workflow test set#34202

Open
mkruszyx wants to merge 56 commits intoopenvinotoolkit:masterfrom
mkruszyx:master
Open

[GHA][Coverage] Expand coverage workflow test set#34202
mkruszyx wants to merge 56 commits intoopenvinotoolkit:masterfrom
mkruszyx:master

Conversation

@mkruszyx
Copy link
Contributor

@mkruszyx mkruszyx commented Feb 19, 2026

WIP

Summary

This PR expands the coverage workflow from a minimal C++-only flow into a reusable multi-suite pipeline for C++, Python, and JS, and adds Python-based tooling under tools/coverage so the same flow can run both in CI and locally.

Details

  • Reworked the workflow into a staged architecture:
    • build once per lane
    • run C++/Python/JS coverage in separate jobs using the same artifact
    • generate one final aggregated summary at the end
  • Expanded coverage scope by adding dedicated Python and JS suites and broadening the C++ suite set.
  • Added matrix-based sharding for coverage jobs to improve parallelization.
  • Added per-test duration collection for all suites and merged duration reporting in the final job.
  • Refactored coverage orchestration into config-driven Python tooling under tools/coverage, shared by CI and local runs.

Tickets:

@mkruszyx mkruszyx requested a review from a team as a code owner February 19, 2026 16:38
@mkruszyx mkruszyx added WIP work in progress do_not_merge labels Feb 19, 2026
@github-actions github-actions bot added category: CI OpenVINO public CI github_actions Pull requests that update GitHub Actions code labels Feb 19, 2026
@codecov
Copy link

codecov bot commented Feb 21, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (master@cf6e20f). Learn more about missing BASE report.

Additional details and impacted files
@@            Coverage Diff            @@
##             master   #34202   +/-   ##
=========================================
  Coverage          ?   79.42%           
=========================================
  Files             ?     4359           
  Lines             ?   205983           
  Branches          ?        0           
=========================================
  Hits              ?   163611           
  Misses            ?    42372           
  Partials          ?        0           
Flag Coverage Δ
cpp-runtime-cpp-cpu-shard-01-of-08 22.45% <ø> (?)
cpp-runtime-cpp-cpu-shard-02-of-08 27.96% <ø> (?)
cpp-runtime-cpp-cpu-shard-03-of-08 66.90% <ø> (?)
cpp-runtime-cpp-cpu-shard-04-of-08 20.21% <ø> (?)
cpp-runtime-cpp-cpu-shard-05-of-08 43.18% <ø> (?)
cpp-runtime-cpp-cpu-shard-06-of-08 34.63% <ø> (?)
cpp-runtime-cpp-cpu-shard-07-of-08 31.84% <ø> (?)
cpp-runtime-cpp-cpu-shard-08-of-08 26.77% <ø> (?)
cpp-runtime-js-cpu-shard-01-of-01 20.80% <ø> (?)
cpp-runtime-python-cpu-shard-01-of-05 40.26% <ø> (?)
cpp-runtime-python-cpu-shard-02-of-05 42.92% <ø> (?)
cpp-runtime-python-cpu-shard-03-of-05 27.41% <ø> (?)
cpp-runtime-python-cpu-shard-04-of-05 36.49% <ø> (?)
cpp-runtime-python-cpu-shard-05-of-05 16.55% <ø> (?)
nodejs-bindings-unit-e2e-cpu-shard-01-of-01 90.31% <ø> (?)
python-api-frontend-layer-ovc-cpu-shard-01-of-05 65.62% <ø> (?)
python-api-frontend-layer-ovc-cpu-shard-02-of-05 59.11% <ø> (?)
python-api-frontend-layer-ovc-cpu-shard-03-of-05 63.59% <ø> (?)
python-api-frontend-layer-ovc-cpu-shard-04-of-05 55.21% <ø> (?)
python-api-frontend-layer-ovc-cpu-shard-05-of-05 54.22% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@mkruszyx mkruszyx requested a review from a team as a code owner February 22, 2026 13:58
@mkruszyx mkruszyx requested review from ValentinaKats and removed request for a team February 22, 2026 13:58
@github-actions github-actions bot added the category: docs OpenVINO documentation label Feb 22, 2026
@github-actions github-actions bot removed the category: docs OpenVINO documentation label Feb 22, 2026
@mkruszyx mkruszyx requested a review from mlukasze March 4, 2026 09:49
@github-actions github-actions bot added category: docs OpenVINO documentation category: dependency_changes Pull requests that update a dependency file no-match-files labels Mar 4, 2026
@mkruszyx mkruszyx requested a review from a team as a code owner March 16, 2026 14:53
@github-actions github-actions bot added category: tools OpenVINO C++ / Python tools and removed category: dependency_changes Pull requests that update a dependency file labels Mar 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

category: CI OpenVINO public CI category: docs OpenVINO documentation category: tools OpenVINO C++ / Python tools do_not_merge github_actions Pull requests that update GitHub Actions code no-match-files WIP work in progress

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants