Fix add-milestone GHA job #24564

Job	Run time
web-checks / web-checks	20m 54s
static-checks-maven / static-checks-maven	31m 25s
openrewrite / openrewrite	15m 9s
strict-compilation / strict-compilation	21m 39s
packaging-check (17) / packaging-check-jdk17	11m 58s
packaging-check (21) / packaging-check-jdk21	11m 7s
	1h 52m 12s

Provide feedback