Currently each Vector pod in k8s will send events directly to Clickhouse, potentially causing issues with many parallel inserts across different tables as MVs get triggered. We should implement and test using a single Vector aggregator that accepts events from all of the pods and combines them into a single (or fixed number of) stream of inserts.
Currently each Vector pod in k8s will send events directly to Clickhouse, potentially causing issues with many parallel inserts across different tables as MVs get triggered. We should implement and test using a single Vector aggregator that accepts events from all of the pods and combines them into a single (or fixed number of) stream of inserts.