Add LRU cache eviction to CachingStateProvider #26975

Job	Run time
${{ matrix.job_name }} (${{ matrix.job_phrase }})	-1s
	-1s

Provide feedback