ClickHouse integration

[MichalisDBA]

Hello.

Is there a chance ReplicaDB to support ClickHouse or anything related to OLAP as sink databases?

[osalvador]

Hi @MichalisDBA,

You may be able to use Clickhouse JDBC Driver in ReplicaDB as if you were connecting to any JDBC compliant database. This example shows how to connect to DB2 https://github.com/osalvador/ReplicaDB?tab=readme-ov-file#jdbc-drivers

[vpokornic]

Hi @osalvador,

I have downloaded Clickhouse JDBC driver (from the official GitHub Release page: https://github.com/ClickHouse/clickhouse-java/releases/download/v0.6.4/clickhouse-jdbc-0.6.4.jar) and copied it in /home/replicadb/lib directory.

My sink options in configuration file are:
sink.connect=jdbc:clickhouse://:8123/default
sink.user=default
sink.password=
sink.table=<dest_table>
sink.connect.parameter.driver=com.clickhouse.jdbc.ClickHouseDriver

I'm getting error:
WARN ManagerFactory:79 The database with scheme jdbc:clickhouse: was not found. Trying with standard JDBC manager

ERROR ReplicaDB:134 Got exception running ReplicaDB:
java.lang.UnsupportedOperationException: Only the 'complete' mode is supported by Standard JDBC Manager.
at org.replicadb.manager.StandardJDBCManager.getDriverClass(StandardJDBCManager.java:27) ~[ReplicaDB-0.15.1.jar:0.15.1]
at org.replicadb.manager.SqlManager.makeSinkConnection(SqlManager.java:227) ~[ReplicaDB-0.15.1.jar:0.15.1]
at org.replicadb.manager.SqlManager.getConnection(SqlManager.java:105) ~[ReplicaDB-0.15.1.jar:0.15.1]
at org.replicadb.manager.SqlManager.truncateTable(SqlManager.java:374) ~[ReplicaDB-0.15.1.jar:0.15.1]
at org.replicadb.manager.StandardJDBCManager.truncateTable(StandardJDBCManager.java:244) ~[ReplicaDB-0.15.1.jar:0.15.1]
at org.replicadb.manager.SqlManager.preSinkTasks(SqlManager.java:495) ~[ReplicaDB-0.15.1.jar:0.15.1]
at org.replicadb.ReplicaDB.processReplica(ReplicaDB.java:94) [ReplicaDB-0.15.1.jar:0.15.1]
at org.replicadb.ReplicaDB.main(ReplicaDB.java:47) [ReplicaDB-0.15.1.jar:0.15.1]
2024-09-05 15:55:41,099 ERROR ReplicaDB:156 java.lang.UnsupportedOperationException: Only the 'complete' mode is supported by Standard JDBC Manager.

Is something wrong in the configuration file or with JDBC JAR?