Open
Description
What would you like to happen?
Kafka IO keeps keyed data when reading from Kafka, but the KafkaReadSchemaTransformProvider doesn't, causing a discrepancy in behavior from the Java SDK to the YAML SDK.
We should keep the existing default behavior, but add a flag which will include the key data in metadata if enabled.
Issue Priority
Priority: 2 (default / most feature requests should be filed as P2)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam YAML
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Infrastructure
- Component: Spark Runner
- Component: Flink Runner
- Component: Samza Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner