Skip to content

[do not merge]: Testing force re-build of all packages#210

Open
smuzaffar wants to merge 1 commit into
V00-34-XXfrom
test-rebuild
Open

[do not merge]: Testing force re-build of all packages#210
smuzaffar wants to merge 1 commit into
V00-34-XXfrom
test-rebuild

Conversation

@smuzaffar
Copy link
Copy Markdown
Contributor

Do not merge

@cmsbuild
Copy link
Copy Markdown
Contributor

A new Pull Request was created by @smuzaffar for branch V00-34-XX.

@cmsbuild, @smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@antoniovilela, @sextonkennedy, @rappoccio you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jun 13, 2024

cms-bot internal usage

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/39889/summary.html
COMMIT: aaddec3
CMSSW: CMSSW_14_1_X_2024-06-13-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/pkgtools/210/39889/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 16 lines from the logs
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3345018
  • DQMHistoTests: Total failures: 3
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3344995
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
  • Checked 202 log files, 165 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test

@cmsbuild
Copy link
Copy Markdown
Contributor

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/40418/summary.html
COMMIT: aaddec3
CMSSW: CMSSW_14_1_X_2024-07-15-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/40418/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 1 errors in the following unit tests:

---> test test-particleLevel_fromMiniAod had ERRORS

Comparison Summary

Summary:

@smuzaffar smuzaffar closed this Sep 22, 2024
@smuzaffar smuzaffar deleted the test-rebuild branch September 22, 2024 16:17
@smuzaffar smuzaffar restored the test-rebuild branch January 29, 2025 09:43
@smuzaffar smuzaffar reopened this Jan 29, 2025
@smuzaffar
Copy link
Copy Markdown
Contributor Author

smuzaffar commented Jan 29, 2025

test parameters:

  • set_env = NO_PACKAGE_STORE

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/44019/summary.html
COMMIT: aaddec3
CMSSW: CMSSW_15_0_X_2025-01-28-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/44019/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/44019/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/44019/git-merge-result

Comparison Summary

Summary:

  • You potentially added 1 lines to the logs
  • Reco comparison results: 3 differences found in the comparisons
  • DQMHistoTests: Total files compared: 50
  • DQMHistoTests: Total histograms compared: 4016770
  • DQMHistoTests: Total failures: 44
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4016706
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
  • Checked 218 log files, 189 edm output root files, 50 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #210 was updated.

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/50926/summary.html
COMMIT: 3ec43a7
CMSSW: CMSSW_16_1_X_2026-01-26-2300/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/50926/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/50926/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/50926/git-merge-result

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 52
  • DQMHistoTests: Total histograms compared: 4025536
  • DQMHistoTests: Total failures: 46
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4025470
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 51 files compared)
  • Checked 222 log files, 193 edm output root files, 52 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #210 was updated.

1 similar comment
@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #210 was updated.

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test with cms-sw/cms-bot#2623

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test with cms-sw/cms-bot#2754

@smuzaffar
Copy link
Copy Markdown
Contributor Author

abort

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test with cms-sw/cms-bot#2754 for CMSSW_17_0_DEVEL_X

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test for CMSSW_17_0_MULTIARCHS_X

@cmsbuild
Copy link
Copy Markdown
Contributor

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53315/summary.html
COMMIT: f55f95e
CMSSW: CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53315/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53315/git-merge-result

Failed Unit Tests

I found 2 errors in the following unit tests:

---> test testProduceNanoHLT had ERRORS
---> test testPhase2PixelNtuple had ERRORS

Failed RelVals

----- Begin Fatal Exception 19-May-2026 12:13:40 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=TrackstersProducer label='hltTiclTrackstersCLUE3DHigh'
Exception Message:
edm::FileInPath unable to find file RecoHGCal/TICL/data/ticlv5/onnx_models/CNN/patternrecognition/id_v0.onnx anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/external/el8_amd64_gcc13/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02942/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02942/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/34434.911_TTbar_14TeV+Run4D121_DD4hep
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 19-May-2026 12:08:40 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=TrackstersProducer label='hltTiclTrackstersCLUE3DHigh'
Exception Message:
edm::FileInPath unable to find file RecoHGCal/TICL/data/ticlv5/onnx_models/CNN/patternrecognition/id_v0.onnx anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/external/el8_amd64_gcc13/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02942/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02942/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/34434.0_TTbar_14TeV+Run4D121
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 19-May-2026 12:08:54 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=TrackstersProducer label='hltTiclTrackstersCLUE3DHigh'
Exception Message:
edm::FileInPath unable to find file RecoHGCal/TICL/data/ticlv5/onnx_models/CNN/patternrecognition/id_v0.onnx anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53315/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/external/el8_amd64_gcc13/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02942/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02942/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_MULTIARCHS_X_2026-05-18-1100/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/34434.75_TTbar_14TeV+Run4D121_HLT75e33Timing
----- End Fatal Exception -------------------------------------------------
Expand to see more relval errors ...

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #210 was updated.

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test with cms-sw/cms-bot#2754 for CMSSW_17_0_DEVEL_X

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test with cms-sw/cms-bot#2754, #237 for CMSSW_17_0_DEVEL_X

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test for CMSSW_17_0_MULTIARCHS_X

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test with cms-sw/cms-bot#2754, #237 for CMSSW_17_0_DEVEL_X

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #210 was updated.

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test for CMSSW_17_0_DEVEL_X

@cmsbuild
Copy link
Copy Markdown
Contributor

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53400/summary.html
COMMIT: 85c1881
CMSSW: CMSSW_17_0_MULTIARCHS_X_2026-05-20-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53400/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53400/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53400/git-merge-result

Failed Unit Tests

I found 3 errors in the following unit tests:

---> test materialBudgetHGCalPlots had ERRORS
---> test materialBudgetTrackerPlots had ERRORS
---> test TestIOPoolCommonTP had ERRORS

Comparison Summary

Summary:

  • You potentially added 184 lines to the logs
  • Reco comparison results: 6 differences found in the comparisons
  • DQMHistoTests: Total files compared: 53
  • DQMHistoTests: Total histograms compared: 4198477
  • DQMHistoTests: Total failures: 65
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4198392
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 52 files compared)
  • Checked 227 log files, 197 edm output root files, 53 DQM output files
  • TriggerResults: no differences found

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test for el9_amd64_gcc16

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please build for el9_amd64_gcc15

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please build for el10_amd64_gcc15

@cmsbuild
Copy link
Copy Markdown
Contributor

REMINDER @mandrenguyen, @ftenchini, @sextonkennedy: This PR was tested with #238, please check if they should be merged together

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53412/summary.html
COMMIT: 85c1881
CMSSW: CMSSW_17_0_X_2026-05-19-2300/el10_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53412/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53412/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53412/git-merge-result

@cmsbuild
Copy link
Copy Markdown
Contributor

-1

Failed Tests: Build
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53410/summary.html
COMMIT: 85c1881
CMSSW: CMSSW_17_0_X_2026-05-20-2300/el9_amd64_gcc16
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53410/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Build

I found compilation error when building:

****WARNING: Invalid tool cuda. Please fix src/Validation/HGCalValidation/plugins/BuildFile.xml file.
****WARNING: Invalid tool cuda. Please fix src/HeterogeneousCore/AlpakaServices/test/BuildFile.xml file.
****WARNING: Invalid tool cuda. Please fix src/HeterogeneousCore/AlpakaTest/test/BuildFile.xml file.
****WARNING: Invalid tool HeterogeneousCore/CUDAUtilities. Please fix src/PhysicsTools/ONNXRuntime/test/BuildFile.xml file.
****WARNING: Invalid tool cuda. Please fix src/PhysicsTools/PyTorchAlpakaTest/test/BuildFile.xml file.
gmake: Circular tmp/el9_amd64_gcc16/cache/rocm_dlink/RecoTrackerLSTCoreROCmAsync <- tmp/el9_amd64_gcc16/cache/rocm_dlink/RecoTrackerLSTCoreROCmAsync dependency dropped.
>> Building CMSSW version CMSSW_17_0_X_2026-05-20-2300 ----
>> Creating project symlinks
>> Entering Package Alignment/APEEstimation
>> Entering Package CommonTools/UtilAlgos
>> Entering Package CommonTools/Utils


@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53411/summary.html
COMMIT: 85c1881
CMSSW: CMSSW_17_0_X_2026-05-19-2300/el9_amd64_gcc15
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53411/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53411/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53411/git-merge-result

@cmsbuild
Copy link
Copy Markdown
Contributor

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53406/summary.html
COMMIT: 85c1881
CMSSW: CMSSW_17_0_DEVEL_X_2026-05-20-2300/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53406/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53406/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53406/git-merge-result

Failed Unit Tests

I found 3 errors in the following unit tests:

---> test materialBudgetHGCalPlots had ERRORS
---> test materialBudgetTrackerPlots had ERRORS
---> test TestIOPoolCommonTP had ERRORS

Comparison Summary

Summary:

  • You potentially added 190 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 53
  • DQMHistoTests: Total histograms compared: 4198477
  • DQMHistoTests: Total failures: 23
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4198434
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 52 files compared)
  • Checked 227 log files, 197 edm output root files, 53 DQM output files
  • TriggerResults: no differences found

@smuzaffar
Copy link
Copy Markdown
Contributor Author

please test for CMSSW_17_0_MULTIARCHSV4_X

@cmsbuild
Copy link
Copy Markdown
Contributor

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-e0b45c/53429/summary.html
COMMIT: 85c1881
CMSSW: CMSSW_17_0_MULTIARCHSV4_X_2026-05-21-2300/el9_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/210/53429/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation warning when building: See details on the summary page.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants