build

Improve Safetensors loading performance with file pooling and paralle… #42822

Job	Run time
build-checkpoint (Python 3.10, jax=0.6.0)	2m 33s
multiprocess-unit-tests (Python 3.11, jax=newest)	8m 32s
build-checkpoint (Python 3.10, jax=newest)	2m 21s
multiprocess-checkpoint-benchmarks (Python 3.10, jax=0.6.0)	15m 31s
build-orbax-model (Python 3.10, jax=0.5.0)	55s
build-export (Python 3.11, jax=newest)	2m 15s
build-export (Python 3.10, jax=0.4.34)	2m 15s
build-checkpoint (Python 3.11, jax=newest)	2m 31s
build-orbax-model (Python 3.10, jax=newest)	53s
build-orbax-model (Python 3.11, jax=newest)	53s
build-checkpoint (Python 3.12, jax=newest)	2m 17s
build-orbax-model (Python 3.12, jax=newest)	55s
build-export (Python 3.10, jax=newest)	6m 10s
build-export (Python 3.12, jax=newest)	2m 22s
	50m 23s

Provide feedback