Add support for vllm sampler kwargs. #4264

Job	Run time
Build tunix package / Build Tunix wheel	33s
tunix_cpu_unit_tests / run	1m 11s
tunix_tpu_unit_tests / run_dev	24m 15s
tunix_tpu_unit_tests / run_prod	12m 12s
Notify failed build	4s
	38m 15s

Provide feedback