TODO.md

• use gradle to build for this project
• modules in this projects
  • protobuf
    • protobuf objects generation
      • create a protobuf NewOrderSingle.proto file
      • compile NewOrderSingle.proto into java
  • kafka
    • config and scripts to start up kafka in podman
      • setup kafka in podman
      • start up kafka in podman
    • kafka producer java code to send protobuf object
    • kafka consumer java code to consumer protobuf object
    • flink-connector-kafka
  • apache flink
    • config and scripts to start up apache flink with iceberg support
      • setup apache flink in podman, with iceberg persistence that can be uploaded to AWS S3 to be used by Snowflake
      • start up apache flink in podman
    • receive protobuf objects from kafka , do some processing , save to iceberg