all rosenpass peer failed

[lfarkas]

Describe the problem

2024-10-24T21:22:03+02:00 ERRO client/internal/rosenpass/manager.go:190: failed to add rosenpass peer: failed to resolve peer endpoint address: lookup 100.76.24.179/32: no such host
time=2024-10-24T21:22:03.375+02:00 level=DEBUG msg="Skipping handshake due to missing endpoint" pid="ajRhlien6HUyn1mrq6BzjAn8jg8oAP3ibK2vnqpxfsg="
time=2024-10-24T21:22:03.379+02:00 level=DEBUG msg="Added peer" pid="ajRhlien6HUyn1mrq6BzjAn8jg8oAP3ibK2vnqpxfsg="
To Reproduce

Steps to reproduce the behavior:
start the service

Expected behavior

run without error

Are you using NetBird Cloud?

NetBird Cloud control plane.

NetBird version

NetBird client version 0.30.3 on linux/amd64

[mgarces]

Hello @lfarkas ; can you elaborate on start the service part?
What were the steps you did to start nebird service.

What kernel version / OS version are you using?

[lfarkas]

it's an x86_64 homeassistant addon

 Add-on version: v0.30.3
 You are running the latest version of this add-on.
 System: Home Assistant OS 13.2  (amd64 / generic-x86-64)
 Home Assistant Core: 2024.10.3
 Home Assistant Supervisor: 2024.10.3

kernel:

# uname -a
Linux homeassistant 6.6.54-haos #1 SMP PREEMPT_DYNAMIC Tue Oct 15 12:39:31 UTC 2024 x86_64 HAOS

with:

netbird up  --foreground-mode --config /config/config.json --log-file console --setup-key XYZ --hostname abc.exmaple.com --enable-rosenpass --rosenpass-permissive --log-level info

[mlsmaycon]

@lfarkas can you please test using the latest client version if the problem persists, please run the following command:

netbird debug for 1m --system-info --anonymize

Then share the output with us.

[lfarkas]

[19:39:48] INFO: Rosenpass enabled
[19:39:48] INFO: Rosenpass permissive mode enabled
[19:39:48] INFO: Using info as logging level
[19:39:48] INFO: Starting NetBird Client...
[19:39:48] INFO: netbird up  --foreground-mode --config /config/config.json --log-file console --setup-key XXXXXXXXXXXXXXXXXXXXXXXXXXXXX --hostname homeassistant.lfarkas.org --enable-rosenpass --rosenpass-permissive --log-level info
2024-11-08T19:39:49+01:00 INFO client/internal/connect.go:111: starting NetBird client version 0.31.0 on linux/amd64
2024-11-08T19:39:49+01:00 INFO client/internal/connect.go:240: connecting to the Relay service(s): rels://relay.netbird.io:443
2024-11-08T19:39:49+01:00 INFO relay/client/picker.go:66: try to connecting to relay server: rels://relay.netbird.io:443
2024-11-08T19:39:49+01:00 INFO [relay: rels://relay.netbird.io:443] relay/client/client.go:166: create new relay connection: local peerID: +i/q6dNa3AeF/iNJMH9+CbnsTLmFPfN+/K0KUPJI5wI=, local peer hashedID: sha-Dn9xgXi3A/4FEe90jhVUP/dkvMcxA59y/e7x0g3oZO4=
2024-11-08T19:39:49+01:00 INFO [relay: rels://relay.netbird.io:443] relay/client/client.go:172: connecting to relay server
2024-11-08T19:39:50+01:00 INFO [relay: rels://streamline-de-fra1-2.relay.netbird.io:443] relay/client/client.go:189: relay connection established
2024-11-08T19:39:50+01:00 INFO relay/client/picker.go:84: connected to Relay server: rels://relay.netbird.io:443
2024-11-08T19:39:50+01:00 INFO relay/client/picker.go:58: chosen home Relay server: rels://relay.netbird.io:443
2024-11-08T19:39:50+01:00 INFO client/iface/wgproxy/ebpf/proxy.go:91: local wg proxy listening on: 3128
2024-11-08T19:39:50+01:00 INFO client/iface/wgproxy/factory_kernel.go:29: WireGuard Proxy Factory will produce eBPF proxy
2024-11-08T19:39:50+01:00 INFO client/internal/engine.go:327: rosenpass is enabled
2024-11-08T19:39:50+01:00 INFO client/internal/engine.go:329: running rosenpass in permissive mode
2024-11-08T19:39:52+01:00 INFO client/internal/rosenpass/manager.go:158: starting rosenpass server on port 57047

and later:

2024-11-08T19:39:53+01:00 ERRO client/internal/rosenpass/manager.go:190: failed to add rosenpass peer: failed to resolve peer endpoint address: lookup 100.76.171.201/32: no such host
2024-11-08T19:39:53+01:00 INFO [peer: 1u25Mrocd2aMv88fUgRnKmM1caynzX+bGTzThCZ3CnE=] client/internal/peer/conn.go:470: start to communicate with peer via relay
2024-11-08T19:39:53+01:00 ERRO client/internal/rosenpass/manager.go:190: failed to add rosenpass peer: failed to resolve peer endpoint address: lookup 100.76.149.154/32: no such host
2024-11-08T19:39:53+01:00 INFO [peer: hCDjKQBW9TBwsZigTRXxvVzpAYE+ZqDHBol4sOSUMl0=] client/internal/peer/conn.go:470: start to communicate with peer via relay
time=2024-11-08T19:39:53.759+01:00 level=DEBUG msg="Skipping handshake due to missing endpoint" pid="Z2/w3OITT9uSosAs718AkjyyvHiHNW64U613Fl607M0="
time=2024-11-08T19:39:53.761+01:00 level=DEBUG msg="Added peer" pid="Z2/w3OITT9uSosAs718AkjyyvHiHNW64U613Fl607M0="
2024-11-08T19:39:54+01:00 INFO [peer: FfiyZKMquYILabBxOquw/jXEuTjhBq6tUvBEPdV3ckY=] client/internal/peer/conn.go:325: set ICE to active connection
2024-11-08T19:39:54+01:00 ERRO client/internal/rosenpass/manager.go:190: failed to add rosenpass peer: failed to resolve peer endpoint address: lookup 100.76.171.201/32: no such host
2024-11-08T19:39:54+01:00 INFO [peer: RtObgAe/KslyFa/t0a/iGwy7HohRzO8xhNNUPIR1ri8=] client/internal/peer/conn.go:325: set ICE to active connection

[mlsmaycon]

Thanks for sharing the logs. Can you confirm if the issue happens on 0.31.0? We've fixed an issue with slow relay connections in this version.

[lfarkas]

it's still exist with 0.31.0:

2024-11-11T12:39:40+01:00 ERRO client/internal/rosenpass/manager.go:190: failed to add rosenpass peer: failed to resolve peer endpoint address: lookup 100.76.149.154/32: no such host
time=2024-11-11T12:39:40.344+01:00 level=DEBUG msg="Skipping handshake due to missing endpoint" pid="6/w87+vJcdE8gOtaP41JuSU150ImM6k/x6MT4nV4i8c="
2024-11-11T12:39:40+01:00 INFO [peer: hCDjKQBW9TBwsZigTRXxvVzpAYE+ZqDHBol4sOSUMl0=] client/internal/peer/guard/guard.go:138: start listen for reconnect events...
time=2024-11-11T12:39:40.354+01:00 level=DEBUG msg="Added peer" pid="6/w87+vJcdE8gOtaP41JuSU150ImM6k/x6MT4nV4i8c="

while that host 100.76.149.154 up running which more if i check this remote's status state Connected on 100.76.149.154:

 homeassistant.netbird.cloud:
  NetBird IP: 100.76.154.31
  Public key: +i/q6dNa3AeF/iNJMH9+CbnsTLmFPfN+/K0KUPJI5wI=
  Status: Connected
  -- detail --
  Connection type: P2P
  ICE candidate (Local/Remote): host/prflx
  ICE candidate endpoints (Local/Remote): 10.10.0.2:51820/81.183.194.112:53176
  Relay server address: rels://streamline-de-fra1-2.relay.netbird.io:443
  Last connection update: 6 minutes, 19 seconds ago
  Last WireGuard handshake: 29 seconds ago
  Transfer status (received/sent) 1009.7 KiB/1017.0 KiB
  Quantum resistance: true
  Routes: -
  Latency: 13.710949ms

[mgarces]

hello @lfarkas ; we couldn't reproduce your issue on our side, but we will investigate this issue and return to you with more info.
In the meantime, can you please validate if 0.31.1 affects this?

[lfarkas]

same error.

[nazarewk]

Hello @lfarkas,

We're currently reviewing our open issues and would like to verify if this problem still exists in the latest NetBird version.

Could you please confirm if the issue is still there?

We may close this issue temporarily if we don't hear back from you within 2 weeks, but feel free to reopen it with updated information.

Thanks for your contribution to improving the project!

[lfarkas]

this is probably was a rosenpass error, but when it's turn out that rossenpass is still broken i turn it off everywhere and i dare not to turn on since my remote sites become unavailable....