Impact of flow controller algorithm on saturation based scaling

[asm582]

When EPP flow controller is enabled in simulated mode experiments, we see that WVA scale up is delayed as it does not see traffic queued up in EPP. The dropped request count from the GuideLLM client perspective is increased. If this is current limitation then it should be documented by running experiments on real GPU cluster.

[asm582]

It is agreed that in a production system, the flow controller will always be enabled; all the benchmarks are now run with flow controller enablement, since it always needs to be turned on, closing this issue, since the primary goal of the issue was a comparison of the system with and without flow controller.