refactor: Make base client concrete and usable#246

LukeAVanDrie wants to merge 1 commit intokubernetes-sigs:mainkubernetes-sigs/inference-perf:mainfrom

LukeAVanDrie:refactor/client-architectureLukeAVanDrie/inference-perf:refactor/client-architectureCopy head branch name to clipboard