Add support for vllm sampler kwargs. #4185

Job	Run time
Build tunix package / Build Tunix wheel	14s
tunix_cpu_unit_tests / run	1m 14s
tunix_tpu_unit_tests / run_prod	1s
tunix_tpu_unit_tests / run_dev	1s
Notify failed build	4s
	1m 34s

Provide feedback