Slow peering/recent chain head delivery in NA & APAC

[inoue-uh]

Hey yall!

Currently I operate a bunch of mainnet nodes in different regions.

Through a long period of time I've noticed, that some nodes in non-EU regions catch peers lagging behind a bit (4~16 blocks), making my nodes experience that lag too:

1. Frankfurt - only node is lagging behind (caused by RPC load, not bad peering)

2. Singapore - 2/5 nodes lagging behind on average (not caused by RPC load)

3. New York - 3/7 nodes lagging behind on average (not caused by RPC load)

Looks like standard peering mechanism uses "least latency" discovery, not "fastest block delivery" (haven't checked actually).

This behaviour is pretty random, so I would like to know if there any way to mitigate it, other than setting static & trusted peers for my nodes? Is there maybe any production-ready P2P crawler that looks for fastest peers (block builders/validators) and automatically manages (adds/removes) them for BSC nodes via admin API?

Thank you in advance