Add support for vllm sampler kwargs. #4186

Job	Run time
Build tunix package / Build Tunix wheel	12s
tunix_cpu_unit_tests / run	1m 16s
tunix_tpu_unit_tests / run_prod	12m 19s
tunix_tpu_unit_tests / run_dev	8m 9s
Notify failed build	2s
	21m 58s

Provide feedback