Interaction between S3 sink and S3 source connectors

[subia]

Hello!

I've been exploring this repository and have a question about the interaction between the S3 sink connector and the S3 source connector.
From my understanding, they don’t seem to be designed as complementary components within a single environment but rather serve distinct use cases. Is that correct?

For example, the S3 sink connector supports the csv format and allows specifying a compression type. However, the S3 source connector currently lacks the ability to read files in csv format or handle compressed files.
Is support for this kind of interaction planned for the future, or is it not within the intended scope?

Such a feature would be useful, for instance, to have a continuous backup on S3 using the S3 sink connector and then, whenever the backup is needed, deploy the S3 source connector to restore it.

Thanks!

[Claudenw]

You are correct in that they are separate. I am currently trying to get them more inline. And to ensure that all source/sink pairs are inline.