While trying to install the self-hosted runner I was hitting:
Which I was able to fix by replacing Administrators with Administratoren (German) in the install script.
Ideally the script itself should be aware that different languages exist, maybe there is a different PS API available that's not language-dependent.