feat: Improve client perf and error handling#247

LukeAVanDrie wants to merge 1 commit intokubernetes-sigs:mainkubernetes-sigs/inference-perf:mainfrom

LukeAVanDrie:refactor/client-performanceLukeAVanDrie/inference-perf:refactor/client-performanceCopy head branch name to clipboard