Node unable to properly connect to peers

[dsbrgg]

Using lotus v1.16.0, when I restart the node, it keeps trying to connect to peers and even thought it has a huge list of peers when I run lotus net peers but it's still having a hard time receiving data. It seems to be syncing but with a very poor performance:

{"level":"info","ts":"2022-07-12T19:02:00.299Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":388,"want-count":64}
{"level":"info","ts":"2022-07-12T19:02:00.325Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":389,"want-count":64}
{"level":"info","ts":"2022-07-12T19:02:00.327Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":390,"want-count":64}
{"level":"info","ts":"2022-07-12T19:02:00.507Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":391,"want-count":14}
{"level":"info","ts":"2022-07-12T19:02:01.139Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":392,"want-count":64}
{"level":"info","ts":"2022-07-12T19:02:30.206Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":393,"want-count":64}
{"level":"info","ts":"2022-07-12T19:02:30.481Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":394,"want-count":33}
{"level":"info","ts":"2022-07-12T19:02:30.615Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":395,"want-count":34}
{"level":"info","ts":"2022-07-12T19:02:47.314Z","logger":"chain","caller":"chain/sync.go:624","msg":"block validation","took":52.14474909,"height":"1975204","age":90047.314569297}
{"level":"info","ts":"2022-07-12T19:02:48.048Z","logger":"chain","caller":"chain/sync.go:624","msg":"block validation","took":52.879034014,"height":"1975204","age":90048.048767089}
{"level":"info","ts":"2022-07-12T19:02:48.811Z","logger":"chain","caller":"chain/sync.go:624","msg":"block validation","took":53.641541227,"height":"1975204","age":90048.811311136}
{"level":"info","ts":"2022-07-12T19:02:48.813Z","logger":"chain","caller":"chain/sync.go:624","msg":"block validation","took":53.643734984,"height":"1975204","age":90048.813562939}
{"level":"info","ts":"2022-07-12T19:03:00.365Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":397,"want-count":64}
{"level":"info","ts":"2022-07-12T19:03:00.366Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":396,"want-count":64}
{"level":"info","ts":"2022-07-12T19:03:00.395Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":398,"want-count":64}
{"level":"info","ts":"2022-07-12T19:03:00.650Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":399,"want-count":17}
{"level":"info","ts":"2022-07-12T19:03:00.651Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":400,"want-count":64}
{"level":"info","ts":"2022-07-12T19:03:00.908Z","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":401,"want-count":1}

Sometimes it also logs this message:

{"level":"info","ts":"2022-07-12T19:05:01.540Z","logger":"net/identify","caller":"identify/id.go:364","msg":"failed negotiate identify protocol with peer","peer":"12D3KooWMRCPjWyb9DcMSStpgTN33diixv7D1aEJg8qi3euHBm9a","error":"stream reset"}

[Trevor-K-Smith]

Seeing this frequently in logs as well. Node seems to struggle to sync sometimes, lagging up to 10min.

{"level":"info","ts":"2022-07-20T23:52:00.682-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2732,"want-count":64}
{"level":"info","ts":"2022-07-20T23:52:01.119-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2733,"want-count":64}
{"level":"info","ts":"2022-07-20T23:52:31.252-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2734,"want-count":64}
{"level":"info","ts":"2022-07-20T23:52:31.252-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2736,"want-count":64}
{"level":"info","ts":"2022-07-20T23:52:31.252-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2735,"want-count":64}
{"level":"info","ts":"2022-07-20T23:52:31.296-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2737,"want-count":64}
{"level":"info","ts":"2022-07-20T23:53:01.907-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2738,"want-count":64}
{"level":"info","ts":"2022-07-20T23:53:01.981-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2739,"want-count":64}
{"level":"info","ts":"2022-07-20T23:53:31.747-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2740,"want-count":64}
{"level":"info","ts":"2022-07-20T23:53:32.489-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2741,"want-count":64}
{"level":"info","ts":"2022-07-20T23:54:00.243-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2742,"want-count":64}
{"level":"info","ts":"2022-07-20T23:54:00.305-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2743,"want-count":64}
{"level":"info","ts":"2022-07-20T23:54:00.384-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2744,"want-count":53}
{"level":"info","ts":"2022-07-20T23:54:00.471-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2745,"want-count":57}
{"level":"info","ts":"2022-07-20T23:54:07.475-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2746,"want-count":24}
{"level":"info","ts":"2022-07-20T23:54:31.679-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2747,"want-count":5}
{"level":"info","ts":"2022-07-20T23:55:00.475-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2748,"want-count":1}
{"level":"info","ts":"2022-07-20T23:55:00.707-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2749,"want-count":1}
{"level":"info","ts":"2022-07-21T00:01:00.829-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2750,"want-count":34}
{"level":"info","ts":"2022-07-21T00:01:00.830-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2751,"want-count":53}
{"level":"info","ts":"2022-07-21T00:01:00.871-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2752,"want-count":26}
{"level":"info","ts":"2022-07-21T00:01:00.969-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2753,"want-count":34}
{"level":"info","ts":"2022-07-21T00:01:00.969-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2754,"want-count":27}
{"level":"info","ts":"2022-07-21T00:04:00.436-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2755,"want-count":1}
{"level":"info","ts":"2022-07-21T00:05:29.695-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2756,"want-count":1}
{"level":"info","ts":"2022-07-21T00:05:30.696-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2757,"want-count":21}
{"level":"info","ts":"2022-07-21T00:06:02.813-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2758,"want-count":22}
{"level":"info","ts":"2022-07-21T00:06:02.967-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2759,"want-count":61}
{"level":"info","ts":"2022-07-21T00:06:03.040-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2760,"want-count":37}
{"level":"info","ts":"2022-07-21T00:06:03.264-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2761,"want-count":52}
{"level":"info","ts":"2022-07-21T00:06:05.396-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2762,"want-count":62}
{"level":"info","ts":"2022-07-21T00:06:32.530-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2763,"want-count":64}
{"level":"info","ts":"2022-07-21T00:06:32.713-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2764,"want-count":64}
{"level":"info","ts":"2022-07-21T00:06:32.714-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2765,"want-count":64}
{"level":"info","ts":"2022-07-21T00:06:32.745-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2766,"want-count":64}
{"level":"info","ts":"2022-07-21T00:06:32.747-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2767,"want-count":64}
{"level":"info","ts":"2022-07-21T00:06:32.748-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2768,"want-count":64}
{"level":"info","ts":"2022-07-21T00:06:32.750-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2769,"want-count":64}
{"level":"info","ts":"2022-07-21T00:06:39.710-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2770,"want-count":64}
{"level":"info","ts":"2022-07-21T00:07:05.022-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2771,"want-count":64}
{"level":"info","ts":"2022-07-21T00:07:05.076-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2772,"want-count":64}
{"level":"info","ts":"2022-07-21T00:07:30.482-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2773,"want-count":45}
{"level":"info","ts":"2022-07-21T00:07:30.505-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2774,"want-count":64}
{"level":"info","ts":"2022-07-21T00:07:30.512-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2775,"want-count":54}
{"level":"info","ts":"2022-07-21T00:07:30.513-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2776,"want-count":64}
{"level":"info","ts":"2022-07-21T00:07:30.522-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2777,"want-count":64}
{"level":"info","ts":"2022-07-21T00:07:31.097-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2778,"want-count":64}
{"level":"info","ts":"2022-07-21T00:07:31.160-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2779,"want-count":6}
{"level":"info","ts":"2022-07-21T00:08:00.595-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2780,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:00.621-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2781,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:00.631-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2782,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:00.635-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2783,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:00.635-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2784,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:00.636-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2785,"want-count":54}
{"level":"info","ts":"2022-07-21T00:08:01.579-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2786,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:01.887-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2787,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:30.643-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2788,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:31.295-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2789,"want-count":64}
{"level":"info","ts":"2022-07-21T00:08:31.413-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2790,"want-count":58}
{"level":"info","ts":"2022-07-21T00:08:31.521-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2791,"want-count":11}
{"level":"info","ts":"2022-07-21T00:09:01.249-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2792,"want-count":16}
{"level":"info","ts":"2022-07-21T00:11:30.276-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2793,"want-count":2}
{"level":"info","ts":"2022-07-21T00:11:30.385-0400","logger":"bs:sess","caller":"session/session.go:459","msg":"No peers - broadcasting","session":2794,"want-count":4}

[stuberman]

Ensure libp2p is properly set in config.toml
Obviously you need to make sure your network or CPU is not congested.
.lotus/config.toml handles block rewards and peer communication
.lotusminer/config.toml or .boost handles peer communication for storage and retrieval deals.

Run lotus net peers |wc -l for a lotus peer count

Connection settings determine your low and high settings - below are default settings

[Libp2p]
Binding address for the libp2p host - 0 means random port.
Format: multiaddress; see https://multiformats.io/multiaddr/

type: []string
env var: LOTUS_LIBP2P_LISTENADDRESSES
ListenAddresses = ["/ip4/0.0.0.0/tcp/0", "/ip6/::/tcp/0"]

Addresses to explicitally announce to other peers. If not specified,
all interface addresses are announced
Format: multiaddress

type: []string
env var: LOTUS_LIBP2P_ANNOUNCEADDRESSES
AnnounceAddresses = []

Addresses to not announce
Format: multiaddress

type: []string
env var: LOTUS_LIBP2P_NOANNOUNCEADDRESSES
NoAnnounceAddresses = []

When not disabled (default), lotus asks NAT devices (e.g., routers), to
open up an external port and forward it to the port lotus is running on.
When this works (i.e., when your router supports NAT port forwarding),
it makes the local lotus node accessible from the public internet

type: bool
env var: LOTUS_LIBP2P_DISABLENATPORTMAP
DisableNatPortMap = false

ConnMgrLow is the number of connections that the basic connection manager
will trim down to.

type: uint
env var: LOTUS_LIBP2P_CONNMGRLOW
ConnMgrLow = 150

ConnMgrHigh is the number of connections that, when exceeded, will trigger
a connection GC operation. Note: protected/recently formed connections don't
count towards this limit.

type: uint
env var: LOTUS_LIBP2P_CONNMGRHIGH
ConnMgrHigh = 180

ConnMgrGrace is a time duration that new connections are immune from being
closed by the connection manager.

type: Duration
env var: LOTUS_LIBP2P_CONNMGRGRACE
ConnMgrGrace = "20s"