fix: use fsspec for DeepSpeed checkpoint path validation to support remote URIs #30524

Job	Run time
build-packages / build-packages (fabric)	35s
build-packages / build-packages (pytorch)	24s
build-packages / build-packages (lightning)	30s
build-packages / merge-artifacts	15s
install-pkg (ubuntu-22.04, pytorch, 3.10)	1m 40s
install-pkg (ubuntu-22.04, pytorch, 3.11)	1m 36s
install-pkg (ubuntu-22.04, fabric, 3.11)	1m 38s
install-pkg (ubuntu-22.04, fabric, 3.10)	1m 42s
install-pkg (ubuntu-22.04, notset, 3.11)	1m 46s
install-pkg (ubuntu-22.04, lightning, 3.11)	1m 32s
install-pkg (macOS-14, fabric, 3.11)	39s
install-pkg (ubuntu-22.04, notset, 3.10)	1m 37s
install-pkg (ubuntu-22.04, lightning, 3.10)	1m 36s
install-pkg (macOS-14, fabric, 3.10)	1m 2s
install-pkg (macOS-14, notset, 3.11)	38s
install-pkg (windows-2022, lightning, 3.10)	1m 39s
install-pkg (windows-2022, pytorch, 3.10)	1m 54s
install-pkg (windows-2022, lightning, 3.11)	2m 5s
install-pkg (macOS-14, lightning, 3.11)	43s
install-pkg (windows-2022, fabric, 3.10)	1m 34s
install-pkg (macOS-14, notset, 3.10)	1m 8s
install-pkg (macOS-14, pytorch, 3.11)	52s
install-pkg (windows-2022, pytorch, 3.11)	1m 40s
install-pkg (windows-2022, notset, 3.10)	2m 11s
install-pkg (windows-2022, fabric, 3.11)	1m 37s
install-pkg (macOS-14, pytorch, 3.10)	55s
install-pkg (windows-2022, notset, 3.11)	2m 6s
install-pkg (macOS-14, lightning, 3.10)	1m 11s
install-pkg-guardian	2s
	36m 47s

Provide feedback