Hi,
When I using emacsclient -a "" -nw to start Emacs as daemon, the window numbers are incorrect while switching window. It happens on GNU Emacs 26.1/27.0.50 with Ubuntu/Mint Linux/macOS.
Only two windows, but the numbers are 2 and 3 in the screenshot below.

BTW, the numbers are correct in ace-window and winum.