Testnet: XMTPD block lag for identity updates is at 2M and keeps rising

[mkysel]

Most likely related to #1502

[mkysel]

We are currently at around block 17570414. We node is at around 15M.

Our processing is spiky (see screenshot). I wonder if the graph is wrong, or whether it takes 30 minutes to process the batch.

[mkysel]

The indexer needs about 250ms on average to process a log. We can not currently filter by what type of log this is, but the average is still understandable.

We process about 4 IUs per second. Hence we can not keep up with production/migrator.

[mkysel]

Ok. I think that I understand. We are currently 2M blocks behind (give or take). The current block 17M contains IU 24M or so. Since we need around ~250ms to process a IU and a block can contain ~100 of them, we might need around 25s to process a block.

[mkysel]

Our database is currently at 22M IU sequenceID. So around 2-3M behind. There is not exactly a 1:1 match between blocks and IUs but in this case its the same ballpark.