Dependency clashes on newer version Flink if "flink-avro:1.19.2" is in classpath

[bing-hsu]

software.amazon.glue:schema-registry-flink-serde:1.1.23 is compiled against org.apache.flink:flink-avro:1.12.2.

When using a Flink runtime of a newer version - 1.19.2 with org.apache.flink:flink-avro:1.19.2 in the classpath, job fails reporting java.lang.NoSuchMethodError:

Caused by: java.lang.NoSuchMethodError: 'org.apache.avro.io.BinaryEncoder com.amazonaws.services.schemaregistry.flink.avro.GlueSchemaRegistryAvroSerializationSchema.getEncoder()'
	at com.amazonaws.services.schemaregistry.flink.avro.GlueSchemaRegistryAvroSerializationSchema.serialize(GlueSchemaRegistryAvroSerializationSchema.java:106)
	at org.apache.flink.connector.kafka.sink.KafkaRecordSerializationSchemaBuilder$KafkaRecordSerializationSchemaWrapper.serialize(KafkaRecordSerializationSchemaBuilder.java:348)
	at org.apache.flink.connector.kafka.sink.KafkaWriter.write(KafkaWriter.java:193)

If org.apache.flink:flink-avro:1.19.2 is removed then job works as expected.

[darenwkt]

Hi, I took a look at this issue, and as you have rightly pointed out, since flink 1.19 onwards, there is a change to getEncorder method return type in flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/AvroSerializationSchema.java in apache/flink@f8da758#diff-6da958ea13dc42cb06d10e96c86455ab15a02721d6f5f187cb0ab6f8cf0115dfL110

The return type has changed from BinaryEncoder to Encoder which is a breaking change.

I have attempted to fix this by bumping the flink version in #374