Skip to content

Jet updates for Mini and (JME)Nano, add recipe for puppi JetMET reclustering #46368

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

nurfikri89
Copy link
Contributor

PR description:

This PR makes several changes in MiniAOD, NanoAOD and JMENano:

  1. MiniAOD
  • In applySubstructure_cff.py, sync the AK8 jet pt cuts, when collecting PF constituents, for Run-2 MiniAOD with Run-3 RECO-level cuts.
  • Use updateJetCollection to setup DeepJet and UParT taggers for AK8 subjets.
  • Minor: Cleanup of postfix usage in applySubstructure_cff.py.
  1. NanoAOD
  • Add subGenJetAK8Idx to match reco-level (SubJet) to gen-level(SubGenJetAK8) AK8 subjets.
  • Add rawMass for CorrT1METJet collection.
  1. JMENano
  • Add energy fraction and puppi weight of leading PF constituent of each PF type in AK4 Puppi jets.
  • Remove pt requirement for UParT regression nodes.
  • Update JMENano+Repuppi autoNano (@JMErePuppi ) configuration to include rebuilding of slimmedJetsAK8 collection.

The functions in puppiJetMETReclusteringTools.py and puppiJetMETReclusteringFromMiniAOD_cff.py scripts are designed to schedule the rebuilding of AK4 Puppi jets (slimmedJetsPuppi), AK8 Puppi jets (slimmedJetsAK8) and PuppiMET (slimmedMETsPuppi) with MiniAODs as input. The functions try to follow, as best as possible, how they are setup in the PAT step for MiniAOD production.

These recipes were previously used to propagate Puppi tune studies through private NanoAOD production. We find it helpful to have these functions in CMSSW if, (a) we need to produce NanoAOD (privately or special validation campaigns), and (b) also for analyzers if they need to tune and update puppi in their analyses.

PR validation:

  • passes the usual runTheMatrix test: runTheMatrix.py -l limited -i all --ibeos
  • passes reMiniAOD+reNano Run-2 UL workflows: runTheMatrix.py -i all --ibeos -l 2500.021,2500.022,2500.023,2500.024,2500.031,2500.032,2500.033,2500.034
  • passes JMErePuppi workflows: runTheMatrix.py -i all --ibeos -l 2500.225,2500.235

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 14, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46368/42207

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46368/42214

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @nurfikri89 for master.

It involves the following packages:

  • PhysicsTools/NanoAOD (xpog)
  • PhysicsTools/PatAlgos (xpog, reconstruction)

@cmsbuild, @ftorrresd, @hqucms, @jfernan2, @mandrenguyen can you please review it and eventually sign? Thanks.
@AlexDeMoor, @AnnikaStein, @Ming-Yan, @Senphy, @ahinzmann, @andrzejnovak, @azotz, @castaned, @gkasieczka, @gouskos, @gpetruc, @hatakeyamak, @jdamgov, @jdolen, @mariadalfonso, @mbluj, @mmarionncern, @nhanvtran, @rappoccio, @schoef, @seemasharmafnal this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@hqucms
Copy link
Contributor

hqucms commented Oct 14, 2024

test parameters:

  • enable = nano
  • workflow = 10224.15,11024.15,11634.15,25202.15

@hqucms
Copy link
Contributor

hqucms commented Oct 14, 2024

please test

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests
Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a43a09/42164/summary.html
COMMIT: 22245c1
CMSSW: CMSSW_14_2_X_2024-10-14-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46368/42164/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 1 errors in the following unit tests:

---> test TestDQMOfflineConfigurationGotAll had ERRORS

Comparison Summary

Summary:

  • You potentially added 14 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 140 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3737194
  • DQMHistoTests: Total failures: 4195
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3732977
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 2.108000000000001 KiB( 47 files compared)
  • DQMHistoSizes: changed ( 11634.0,... ): 0.124 KiB Physics/NanoAODDQM
  • Checked 213 log files, 183 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

NANO Comparison Summary

Summary:

  • You potentially removed 1176 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 220 differences found in the comparisons
  • DQMHistoTests: Total files compared: 21
  • DQMHistoTests: Total histograms compared: 55028
  • DQMHistoTests: Total failures: 135
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 54893
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 1.4880000000000004 KiB( 20 files compared)
  • DQMHistoSizes: changed ( 2500.001,... ): 0.124 KiB Physics/NanoAODDQM
  • Checked 102 log files, 58 edm output root files, 21 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

Sample kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
2500.001 2.956 2.947 0.009 ( +0.3% ) 3.03 3.10 -2.1% 6.060 6.055
2500.002 3.067 3.056 0.011 ( +0.3% ) 2.71 2.76 -1.5% 6.407 6.411
2500.003 3.009 2.998 0.010 ( +0.3% ) 2.83 2.89 -2.2% 6.381 6.487
2500.011 1.543 1.533 0.010 ( +0.6% ) 4.65 4.80 -3.1% 2.149 2.421
2500.012 2.045 2.030 0.014 ( +0.7% ) 2.85 2.90 -1.8% 2.185 2.605
2500.013 1.881 1.872 0.009 ( +0.5% ) 4.02 4.10 -1.9% 2.204 2.514
2500.021 0.022 0.022 0.000 ( +0.0% ) 0.87 0.98 -11.4% 2.335 2.381
2500.022 0.022 0.022 0.000 ( +0.0% ) 0.86 0.93 -8.3% 2.319 2.376
2500.023 0.022 0.022 0.000 ( +0.0% ) 0.83 0.93 -10.8% 2.233 2.244
2500.024 0.022 0.022 0.000 ( +0.0% ) 0.62 0.71 -12.1% 2.025 2.458
2500.031 0.035 0.035 0.000 ( +0.1% ) 0.79 0.86 -8.5% 2.419 2.451
2500.032 0.036 0.036 0.000 ( +0.0% ) 0.80 0.88 -8.7% 2.407 2.412
2500.033 0.037 0.037 0.000 ( +0.0% ) 0.73 0.80 -8.8% 2.434 2.492
2500.034 0.036 0.036 0.000 ( +0.0% ) 0.73 0.80 -9.6% 2.407 2.468
2500.101 2.733 2.728 0.005 ( +0.2% ) 8.40 9.00 -6.6% 6.337 6.339
2500.111 1.387 1.386 0.001 ( +0.1% ) 18.15 20.28 -10.5% 2.224 2.232
2500.112 1.805 1.803 0.002 ( +0.1% ) 13.97 15.29 -8.6% 2.310 2.313
2500.131 0.747 0.747 0.000 ( +0.0% ) 17.14 18.38 -6.8% 1.497 1.474
2500.201 2.557 2.552 0.006 ( +0.2% ) 7.17 7.58 -5.4% 5.612 5.610
2500.211 1.705 1.699 0.006 ( +0.3% ) 16.97 18.01 -5.7% 2.281 2.281
2500.212 2.100 2.095 0.005 ( +0.3% ) 13.56 14.29 -5.1% 2.363 2.361
2500.221 2.003 1.998 0.005 ( +0.3% ) 7.40 7.76 -4.7% 2.447 2.444
2500.222 3.282 3.276 0.006 ( +0.2% ) 7.31 7.62 -4.1% 2.535 2.527
2500.223 8.969 8.963 0.007 ( +0.1% ) 2.55 2.66 -3.9% 2.560 2.409
2500.224 5.948 5.810 0.139 ( +2.4% ) 0.58 0.60 -3.4% 2.221 2.130
2500.225 5.980 5.827 0.153 ( +2.6% ) 0.55 0.59 -6.0% 2.273 2.146
2500.226 3.044 3.038 0.006 ( +0.2% ) 7.17 7.60 -5.6% 2.537 2.411
2500.227 1.437 1.437 0.000 ( +0.0% ) 11.10 11.88 -6.6% 1.427 1.434
2500.231 1.408 1.403 0.005 ( +0.4% ) 13.40 13.54 -1.1% 2.172 2.180
2500.232 2.305 2.300 0.005 ( +0.2% ) 13.06 14.03 -6.9% 2.264 2.275
2500.233 4.752 4.747 0.005 ( +0.1% ) 4.06 4.26 -4.7% 2.280 2.279
2500.234 3.603 3.518 0.085 ( +2.4% ) 0.75 0.77 -3.0% 2.062 2.070
2500.235 3.622 3.530 0.092 ( +2.6% ) 0.71 0.75 -5.0% 2.106 2.088
2500.236 2.150 2.145 0.005 ( +0.2% ) 13.04 13.72 -5.0% 1.992 2.268
2500.237 1.016 1.016 0.000 ( +0.0% ) 16.12 17.05 -5.4% 1.192 1.459
2500.241 9.404 9.404 0.000 ( +0.0% ) 3.33 3.74 -11.0% 1.944 1.951
2500.242 10.331 10.331 0.000 ( +0.0% ) 0.84 0.91 -7.3% 1.735 1.735
2500.243 2.712 2.712 0.000 ( +0.0% ) 8.20 8.39 -2.2% 1.074 1.077
2500.244 485.976 485.976 0.000 ( +0.0% ) 0.53 0.56 -5.5% 1.670 1.692
2500.245 823.202 823.202 0.000 ( +0.0% ) 0.69 0.75 -7.2% 1.679 1.664
2500.901 1.777 1.777 0.000 ( +0.0% ) 19.46 21.53 -9.6% 1.842 1.846
2500.902 1.626 1.626 0.000 ( +0.0% ) 20.54 21.05 -2.4% 1.770 1.773
2500.911 13.995 13.995 0.000 ( +0.0% ) 3.08 2.92 +5.6% 1.097 1.095
2500.912 0.150 0.199 -0.049 ( -24.7% ) 0.99 1.77 -44.3% 0.977 0.974
2500.913 0.110 0.110 0.000 ( +0.0% ) 1.11 1.17 -4.6% 0.978 0.972

@hqucms
Copy link
Contributor

hqucms commented Oct 14, 2024

+1

@hqucms
Copy link
Contributor

hqucms commented Oct 14, 2024

ignore tests-rejected with ib-failure

@jfernan2
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (test failures were overridden). This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit d1c545b into cms-sw:master Oct 15, 2024
13 of 14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants