Add Part-2: Protocol Streams (intelligent decoding - on-the-fly tree manipulation) #32
Description
This is more advanced, it might not make it into the presentation, but given that the Protobuf definitions include validations, and we can use the validations at the edge - prior to publishing the records onto Kafka in the first place — we present a world that acts-more-like-a-normal-api-service, and less like a dumping ground for things to be fixed later!
- protobuf-AST -> transform -> specific Delta table
- show how to steal-the-schema, and ensure a table is generated with the correct "schema" prior to the initial table write.