Support for keepLastN in DO_WHILE Task

[sriharimalagi]

Hello Team,

Problem statement:

• We are running DO_WHILE tasks for large number of iterations (>1000). When each DO_WHILE task iteration is completed, the output is stored into the Task.outputData.
• Since the results after each iteration is appended, the Task Output Max Threshold limit is breached, causing the workflow to get terminated.
• We would like to apply a solution such that previously executed iterations' output can be discarded.

Analysis:

• Upon reviewing the DO_WHILE task documentation, I have identified a property named keepLastN which is currently not supported in the open source code.
• Leveraging this logic for our DO_WHILE task would be beneficial. I am prepared to initiate a pull request for its implementation.

I kindly request your feedback on this matter.

Thank you and best regards,
Srihari

[hchatillon]

Hello, did you find a solution for your issue ? I am interested in your approach

[hchatillon]

I was able to make it work, keepLastN has to be inserted in the inputParameters of the DO_WHILE task, and to keep nothing, you set it to -2 (don't ask why, the documentation is not that clear and the default value to 2)