I have multiple remote desktops (around 100), mostly running Ubuntu 20.04 and using X11 VNC. When I receive an external signal, I need to immediately connect to the corresponding remote desktop to handle it. However, the problem is that when I connect using VNC 1.3.0, the first frame appears very quickly, which is great, but it seems to freeze; it only displays the first frame indefinitely. During this time, my key presses don't work. After about 10 seconds, the screen starts to change normally, and everything works fine. I apologize that I don't know much about RFB and don't know how to optimize it. I hope to reduce the time to around 3 seconds; 10 seconds is too long and significantly impacts processing efficiency.
Thank you very much for your help.