enhance new codes to XPU, and make them be device agnostic#3890

SunMarc merged 4 commits intohuggingface:mainhuggingface/accelerate:mainfrom

yao-matrix:device-agnosticyao-matrix/accelerate:device-agnosticCopy head branch name to clipboard