Open
Description
Currently the data discovery tools return concrete replicas when one queries for files from a dataset, with options for taking the first of available replicas or round-robin to try to distribute the load against endpoints.
However, since then updates have been made in fsspec-xrootd (and more may be developed) which rely on using a redirector, choosing a concrete endpoint based on the XRootD server connection, and implementing fallbacks. As such, we should enable a new path in data discovery tools which returns the files with a chosen redirector. We may wish to make it the default at some point, as well.
See:
scikit-hep/fsspec-xrootd#48
https://iris-hep.slack.com/archives/CFZ4Z2Q2H/p1742358649710479
Metadata
Metadata
Assignees
Labels
No labels