Integration with CDC (Change Data Capture) Tools

[avelino]

For better integration with existing data ecosystems, it is necessary to implement Change Data Capture support to transmit changes to external systems.

Implementation details:

1. Create namespace chrondb.cdc to manage capture and transmission of changes
2. Implement event formatting in standard formats (Avro, Protobuf, JSON Schema)
3. Develop connectors for popular platforms (Debezium, Kafka Connect)
4. Create replication progress tracking system
5. Implement resilience and retry mechanisms to ensure delivery
6. Develop tools for replication initialization (initial snapshot)
7. Create APIs for CDC connector management
8. Implement configurable transformations for events
9. Develop event filtering mechanisms by pattern or tenant
10. Create monitoring tools for CDC replication

Technical details

• Integrate with event system to capture changes
• Implement consumers to send data to external systems
• Create tracking mechanisms to ensure exact delivery of events

Reference code

It will be necessary to modify src/chrondb/storage/git/core.clj to emit detailed events about changes.