Skip to content

test(integration): add ci coverage scripts and wire integration coverage - #7253

Closed
watson wants to merge 1 commit into
masterfrom
watson/code-coverage-in-integration-tests
Closed

test(integration): add ci coverage scripts and wire integration coverage#7253
watson wants to merge 1 commit into
masterfrom
watson/code-coverage-in-integration-tests

Conversation

@watson

@watson watson commented Jan 15, 2026

Copy link
Copy Markdown
Collaborator

What does this PR do?

Adds integration test coverage collection via new test:integration*:ci scripts, a dedicated nyc config, and CI updates to run coverage-enabled suites.

Motivation

Integration tests cover code that’s hard to unit test; this adds opt-in coverage for those suites without slowing local runs.

Additional Notes

Coverage reports land in coverage/integration-<suite> with raw output in .nyc_output/integration-<suite>.

@watson watson self-assigned this Jan 15, 2026
@codecov

codecov Bot commented Jan 15, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 76.87%. Comparing base (fa08e42) to head (c8b1cb9).
⚠️ Report is 568 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #7253      +/-   ##
==========================================
- Coverage   86.12%   76.87%   -9.26%     
==========================================
  Files         513      584      +71     
  Lines       22106    47265   +25159     
  Branches        0        1       +1     
==========================================
+ Hits        19039    36334   +17295     
- Misses       3067    10931    +7864     
Flag Coverage Δ
aiguard-macos 99.09% <ø> (ø)
aiguard-ubuntu 99.09% <ø> (ø)
aiguard-windows 99.09% <ø> (ø)
apm-capabilities-tracing-macos 58.01% <ø> (ø)
apm-capabilities-tracing-ubuntu 58.01% <ø> (ø)
apm-capabilities-tracing-windows 57.62% <ø> (-0.02%) ⬇️
apm-integrations-child-process 99.19% <ø> (ø)
apm-integrations-couchbase-18 100.00% <ø> (ø)
apm-integrations-couchbase-eol 100.00% <ø> (ø)
appsec-express 62.46% <ø> (ø)
appsec-fastify 58.48% <ø> (ø)
appsec-graphql 53.41% <ø> (ø)
appsec-kafka 43.98% <ø> (ø)
appsec-ldapjs 46.04% <ø> (ø)
appsec-lodash 47.29% <ø> (ø)
appsec-macos 93.74% <ø> (ø)
appsec-mongodb-core 51.82% <ø> (ø)
appsec-mongoose 50.73% <ø> (ø)
appsec-mysql 54.20% <ø> (ø)
appsec-node-serialize 43.92% <ø> (ø)
appsec-passport 48.10% <ø> (ø)
appsec-postgres 54.55% <ø> (ø)
appsec-sourcing 33.80% <ø> (ø)
appsec-template 43.92% <ø> (ø)
appsec-ubuntu 93.74% <ø> (ø)
appsec-windows 93.74% <ø> (ø)
integration 58.34% <ø> (?)
integration-appsec 64.01% <ø> (?)
integration-debugger 54.02% <ø> (?)
llmobs-ai 55.32% <ø> (ø)
llmobs-anthropic 45.46% <ø> (ø)
llmobs-bedrock 42.83% <ø> (ø)
llmobs-google-genai 48.73% <ø> (ø)
llmobs-langchain 52.31% <ø> (ø)
llmobs-openai 55.50% <ø> (ø)
llmobs-vertex-ai 47.46% <ø> (ø)
platform-core 87.23% <ø> (ø)
platform-instrumentations-misc 73.68% <ø> (ø)
platform-shimmer 98.82% <ø> (ø)
platform-unit-guardrails 89.47% <ø> (ø)
profiling-macos 70.74% <ø> (ø)
profiling-ubuntu 70.74% <ø> (ø)
profiling-windows 75.17% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

watson commented Jan 15, 2026

Copy link
Copy Markdown
Collaborator Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@github-actions

github-actions Bot commented Jan 15, 2026

Copy link
Copy Markdown
Contributor

Overall package size

Self size: 4.43 MB
Deduped: 5.25 MB
No deduping: 5.25 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 2.0.0 | 68.46 kB | 797.03 kB | | dc-polyfill | 0.1.10 | 26.73 kB | 26.73 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@datadog-datadog-prod-us1

This comment has been minimized.

@pr-commenter

pr-commenter Bot commented Jan 15, 2026

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2026-01-21 15:40:11

Comparing candidate commit c8b1cb9 in PR branch watson/code-coverage-in-integration-tests with baseline commit fa08e42 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 228 metrics, 32 unstable metrics.

@watson
watson force-pushed the watson/code-coverage-in-integration-tests branch 13 times, most recently from 70aadab to 56bdf1f Compare January 21, 2026 07:57
@watson
watson force-pushed the watson/code-coverage-in-integration-tests branch from 56bdf1f to c8b1cb9 Compare January 21, 2026 15:31
@BridgeAR

BridgeAR commented May 1, 2026

Copy link
Copy Markdown
Member

This got superseded and the coverage is now tracked

@BridgeAR BridgeAR closed this May 1, 2026
@watson
watson deleted the watson/code-coverage-in-integration-tests branch May 1, 2026 08:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants