[NGT] add validation (w.r.t. SIM) step for Phase-2 HLT timing and NGT workflows

[mmusich]

PR description:

Title says it all, add validation (w.r..t SIM) and harvesting steps for Phase-2 HLT timing and NGT workflows.
This would allow to have quickly access to workflows in which we can test changes in the reconstruction (at HLT) and see effects at the validation level, without the need to run (the time expensive) offfline reconstruction step3.
The HLT validation procedure is incomplete (see issue #39362) but these workflows will also be useful when testing new additions to that.

PR validation:

runTheMatrix.py -l 29634.75,29634.751, 29634.752, 29634.753, 29634.754, 29634.755, 29634.77

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

N/A

[cmsbuild]

cms-bot internal usage

[mmusich]

test parameters:

• relval_opts = -w upgrade
• workflows = 29634.75, 29634.751, 29634.752, 29634.753, 29634.754, 29634.755, 29634.77

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-47522/43980

• There are other open Pull requests which might conflict with changes you have proposed:
  • File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): CA Extension to strips #47090, add vertex trimming to the phase2 hlt tracking iterations #47113, Custom Phase-2 L1 Trigger NanoAOD #47178, MTD Geometry - BTL numbering scheme update with correction for backward compatibility #47353, Updates for runTheMatrix.py: input checks, GPUs repartition, input recycling #47377, [NGT] Adding SimDoublets class for Pixel Tracking Validation including corresponding EDProducers and EDAnalyzers #47441

[cmsbuild]

A new Pull Request was created by @mmusich for master.

It involves the following packages:

• Configuration/PyReleaseValidation (upgrade, pdmv)

@AdrianoDee, @Moanwar, @cmsbuild, @DickyChant, @miquork, @srimanob, @subirsarkar can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @makortel, @missirol, @slomeo this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

[mmusich]

@cmsbuild, please test

[mmusich]

type ngt

[cmsbuild]

+1

Size: This PR adds an extra 36KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-61f4db/44834/summary.html
COMMIT: 5c0ff86
CMSSW: CMSSW_15_1_X_2025-03-05-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/47522/44834/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @bsunanda Run3-gex187K Add overlap check test for the files produced by Sergio in PR #47511 #47512
• @Dr15Jones Removed Principal::adjustToNewProductRegistry #47486
• @makortel Move CPUServiceBase, RootHandlers, and TimingServiceBase to FWCore/AbstractServices #47466
• @vlimant McM/production bound options to cmsDriver #47501
• @slomeo Overlaps fixed for Muon System - 2025 Scenario with 2025/v3/rpcf.xml #47511
• @cms-ngt-hlt [NGT] Add a novel NGTScouting Phase-2 HLT menu that runs a single "scouting"-like path on the whole L1Accept #47434

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-61f4db/44834/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-61f4db/44834/git-merge-result

Comparison Summary

Summary:

• You potentially added 9 lines to the logs
• Reco comparison results: 10 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3920300
• DQMHistoTests: Total failures: 14
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3920266
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 214 log files, 184 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[Moanwar]

+Upgrade

[mmusich]

@cms-sw/pdmv-l2 kind ping if you agree with the changes proposed here.

[AdrianoDee]

+pdmv

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @rappoccio, @antoniovilela, @sextonkennedy, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

[civanch]

+1

[mandrenguyen]

+1