[FEATURE]: Provide option to override cluster configuration for each job type

[mwojtyczka]

Is there an existing issue for this?

• I have searched the existing issues

Problem statement

Currently overriding cluster config can only be done for all job types belonging to one RunConfig. At the moment there is only profiler job but once we add more, there will be a need to configure this per job type

Proposed Solution

allow configuring override_clusters for each job type (e.g. profiling, curation etc).

Additional Context

No response