Skip to content

Schema Compatibility "FULL" should consider all versions as compatible. #338

Open
@ueisele

Description

Hello,

I use the S3 Sink Connector on a topic with Avro records which are fully transitive compatible. I want to achieve that records are always written in larger batches to S3 in Parquet format. This works perfectly if the schema is identical. However, I was only able to keep the connector adding records to the same batch, if either the schema version of the new record is larger or equal (FORWARD), or if the schema version of the new record is less or equal (BACKWARD). I would expect if I set schema.compatibility to "FULL", that it keeps adding to the batch independent of the schema version. However, this is not the case. It treats "FULL" exactly the same as "BACKWARD":

I would expect that "FULL" overrides "checkVersions" and always returns true.
Do you agree with this, or did I understood something wrong?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions