Remote-chunking implementation does not support parallel executions of the same job [BATCH-2228]

[spring-projects-issues]

Tomas Klubal opened BATCH-2228 and commented

Current implementation of the remote-chunking does not support same job instance executing in parallel (2 different job executions). For example running same job with different parameters at the same time. These two job executions are stealing each others reply messages.

---

Affects: 3.0.0

Issue Links:

• BATCH-2507 ChunkMessageChannelItemWriter Reply Channel Issues
  ("is duplicated by")
• BATCH-2508 ChunkMessageChannelItemWriter Reply Channel Issues
  ("is duplicated by")

[spring-projects-issues]

Tomas Klubal commented

Forgot to add that Spring Batch supports it and therefore I believe that the remote-chunking implementation is breaking the contract

[spring-projects-issues]

Tomas Klubal commented

At the time of raising this bug I was not clear on the terminology. So the correct wording is:"Remote-chunking implementation does not support executing different job instances in parallel"

[spring-projects-issues]

Michael Minella commented

Without seeing your configuration, I'd assume this is due to the way the transport layer is configured. There is nothing within Spring Batch that will filter out messages for one job execution or another. That would be up to the developer to configure in the Spring Integration related components.

[akashsharma3030]

Is there any solution for this problem of running parallel execution of spring remote chunking job

[fmbenhassine]

@akashsharma3030

Is there any solution for this problem of running parallel execution of spring remote chunking job

Similar to the MessageChannelPartitionHandler that should be step-scoped or job-scoped to support parallel executions (see the note in its Javadoc), Have you tried to make the ChunkMessageChannelItemWriter step-scoped?

I think the lack of a minimal example is what is missing to address this issue and fix it correctly. So if you have a reproducer, it would be of a great help to share it with us.

[Vanguard-Fx]

@fmbenhassine i think this issue is related to this thread:
https://stackoverflow.com/a/37334833/16742414

I'm running in the same issue. My business logic needs to run more than one job in parallel, but using the same channel they collide

I've created an example project with this problem here: https://github.com/Vanguard-Fx/SpringBatchRemoteChunking