[Feature Request] Is it possible to limit the run/eval batch size?

[0mza987]

Discussed in #3579

^{Originally posted by ebotiab July 25, 2024}
When making a run is it possible to limit the quantity of the data that is passed to be executed at once?

[jomalsan]

This can be done by setting the environment variable PF_WORKER_COUNT like follows in your flow yaml file:

environment_variables:
  PF_WORKER_COUNT: "1"

I do this to avoid throttling limits or when running inference against local models