test: Refactor distributed job creation in testing #5705

Job	Run time
Check if build and test are required	5s
Validate & Test	14m 36s
Build	9m 59s
Skip Build and Test Message	0s
Run E2E Tests	26m 16s
FOSSA license check	1m 13s
Run E2E Upgrade Tests	6m 58s
Code Coverage Report	12s
	59m 19s

Provide feedback