feat: Support prompt caching #11971

Job	Run time
pytest_package_llm_test	1m 5s
pytest_package_very_slow_test	1m 3s
pytest_package_fast_test	1m 4s
	3m 12s

Provide feedback