Implement RFC9530: WCLG TPC Data Integrity enhancements

[labkode]

Hello colleagues,

I create this request for implementation to follow-up on the agreement to support enhanced data integrity in WLCG TPC transfers, by implementing RFC9530.

The specification of the changes needed is described here:
https://github.com/labkode/wlcg-tpc

Slides: https://indico.cern.ch/event/1538346/contributions/6474197/attachments/3053366/5397622/DOMA%20BDT%20TPC%20DATA%20INTEGRITY%20(1).pdf

The implementation for XrootD has already been done and is waiting a release in upcoming XROOTD 6 major version:
xrootd/xrootd#2595

Let me know if you have some questions regarding the spec, while Cedric was implementing we had to clarify a few sentences.

Thanks in advance,
Hugo

[paulmillar]

Hi @labkode

Thanks for all your work in this area.

As I'm sure you already know, dCache already implements integrity checking when undertaking HTTP-TPC transfers.

There are a few points where the spec might benefit from some further work. I've created a few issued against your repo that try to capture the points and allow for discussion.

Cheers,
Paul.

[labkode]

Thanks Paul for jumping into it. I know dCache has already data integrity validation with the old spec so I expect most changes would be syntatic sugar for you.

Let's follow-up on your remarks, I am sure we'll manage to define some behaviours that work for everyone.