feat: Support prompt caching #11978

Job	Run time
pytest_package_very_slow_test	1m 10s
pytest_package_fast_test	1m 5s
pytest_package_llm_test	1m 11s
	3m 26s

Provide feedback