Enshrouded Host does not allow others to join due to network error "Packet from 0 is smaller than the header"

[digby-chicken-caesar]

Hi @Detanup01,

The folks at NucleusCoop recommended that I share my findings with you!

I tried to add this research to the bottom of Issue #156, but i wasn't sure you would receive it. I apologize if it causes you extra noise.

Symptom: Unable to join dedicated servers when playing Enshrouded via GBE.
In NucleusCoop, the 2nd instance launches and can join player 1's game but will never load.

The Enshrouded devs re-introduced their Steam API changes in the most recent update,
https://enshrouded.com/news/enshrouded-thralls-of-twilight-update
"Re-enabled the current Steam API for network connections. Changes have been made to take into account users hosting on home networks."

Patch #7 v.0.8.01 "resolved" this issue originally caused by Update #5 by reverting their Steam API :
https://enshrouded.com/news/changelog-for-patch-7-v-0-8-0-1
"The previous version of the Steam API is now used again while we are investigating reports of lags and stuttery network connections when using the current Steam API version."

I found that we can review each instance's Enshrouded application logs while Nucleus is running.
In doing so I have found an error that occurs when Player2 joins Player1's game!

For me, logs were found in these directories while Nucleus was running; these appear to be copies of the game files found in "...\Steam\steamapps\common\Enshrouded"
C:\NucleusCoOp\content\Enshrouded\Instance0\enshrouded.log
C:\NucleusCoOp\content\Enshrouded\Instance1\enshrouded.log

In Enshrouded v0.8.1.0, it is clear that Player 2 is waiting for some action by Player 1, aka "Peer #0" in this case but automatically timeouts and cancels after 8 seconds...

I believe root cause resides in the difference between the old/new Steam APIs:
Deprecated: ISteamNetworking
Currently used: ISteamNetworkingSockets

[I 00:01:20,210] [online] Requested lobby data for lobby 109775242726233976.
[I 00:01:20,260] [online] Entered lobby (109775242726233976).
[I 00:01:20,260] [OnlineProviderSteam] 'JoinOrCreateGame' (up)!
[I 00:01:20,276] Initializing P2P api: NetworkingMessages
[I 00:01:20,276] [online] Added peer #0 (76561199023125438)
[I 00:01:20,276] [OnlineProviderSteam] 'SetLobbyData' (up)!
[I 00:01:20,276] [OnlineLocalPlayerSteam] started transition from 'SignedIn' to 'InGame' (current='<invalid>')!
[I 00:01:20,293] [OnlineLocalPlayerSteam] 'AddPlayerToLobby' (up)!
[I 00:01:20,293] [OnlineLocalPlayerSteam] finished transition from 'SignedIn' to 'InGame' (current='InGame')!
[I 00:01:20,293] [OnlineProviderSteam] 'JoinLocalPlayers' (up)!
[I 00:01:20,326] [online] Session accepted by peer #0
[I 00:01:22,512] [gameframework] Window became active ...
...
...omitting vulkan swap chain errors associated with vkQueuePresentKHR & vkAcquireNextImageKHR, as they occur for Instance0/Player1 as well.
...
[E 00:01:30,262] [online] Timeout for peer #0
[I 00:01:30,262] [online] Removed peer #0

I analyzed what happens when playing a normal v.0.8.1.0 online game through Steam:
Here, we can see some action from [OnlineProviderSteam] that takes place directly after "Session accepted by peer #0"

[I 00:00:46,535] Initializing P2P api: NetworkingMessages
[I 00:00:46,550] [online] Added peer #0 (76561197997223686)
[I 00:00:46,550] [OnlineProviderSteam] 'SetLobbyData' (up)!
[I 00:00:46,550] [OnlineLocalPlayerSteam] started transition from 'SignedIn' to 'InGame' (current='<invalid>')!
[I 00:00:46,552] [OnlineLocalPlayerSteam] 'AddPlayerToLobby' (up)!
[I 00:00:46,552] [OnlineLocalPlayerSteam] finished transition from 'SignedIn' to 'InGame' (current='InGame')!
[I 00:00:46,552] [OnlineProviderSteam] 'JoinLocalPlayers' (up)!
[I 00:00:47,202] [online] Session accepted by peer #0
[I 00:00:47,268] [OnlineProviderSteam] 'ConnectToPeers' (up)!
[I 00:00:47,268] [OnlineProviderSteam] finished transition from 'Initialized' to 'InGame' (current='InGame')!
[I 00:00:47,270] [Session] 'JoinOnline' (up)!
[I 00:00:47,334] [session] Swap player index 1 and 0.
[I 00:00:47,334] [SessionPlayer] started transition from 'Free' to 'Remote_InSession' (current='<invalid>')!
[I 00:00:47,334] [session] Remote player added. Player handle: 0(0)
[I 00:00:47,334] [SessionPlayer] 'JoinGame' (up)!
[I 00:00:47,334] [SessionPlayer] finished transition from 'Local' to 'Local_InSession' (current='Local_InSession')!
[I 00:00:47,334] [SessionPlayer] 'Reserve' (up)!
[I 00:00:47,334] [SessionPlayer] 'WaitForJoin' (up)!
[I 00:00:47,334] [SessionPlayer] finished transition from 'Free' to 'Remote_InSession' (current='Remote_InSession')!
[I 00:00:47,339] [Session] 'JoinPlayers' (up)!
[I 00:00:47,339] [Session] finished transition from 'Lobby' to 'Client_Online' (current='Client_Online')!
[I 00:00:47,352] [play] start creation step GameServerCreate
[I 00:00:47,352] [play] start creation step GameServerInit

I downgraded my game back to Update v.0.8.0.1 and had player2 join player1's game and saw a completely different process for joining the game successfully:

[I 00:00:18,307] [gameframework] Window became active ...
[I 00:00:23,350] [OnlineLocalPlayerSteam] started transition from 'SignedOut' to 'SignedIn' (current='<invalid>')!
[I 00:00:23,359] [OnlineLocalPlayerSteam] 'CheckSignInState' (up)!
[I 00:00:23,403] [OnlineLocalPlayerSteam] 'RequestAuthToken' (up)!
[I 00:00:23,403] [OnlineLocalPlayerSteam] finished transition from 'SignedOut' to 'SignedIn' (current='SignedIn')!
[I 00:00:23,404] [steam] Refreshing internet servers
[I 00:00:23,404] [online] Requested lobby data for lobby 109775241907953519.
[E 00:00:23,422] [online] No Dedicated Server Found
[E 00:00:23,422] [online] No Dedicated Server Found
[E 00:00:23,422] [online] No Dedicated Server Found
[I 00:00:26,298] [input] openVirtualKeyboard for user 0(1) (title:Enter password text:)
[I 00:00:30,288] [gameframework] Window became active ...
[I 00:00:33,665] -------------- Session ----------------
[I 00:00:33,665] Machines:
[I 00:00:33,665]   m#0(128): up 0 (0), down 0 (0), remote 0 (0), limit 2,048, lost 0, ping 9,223,372,036,854 ms, EstablishingBaseline
[I 00:00:33,665] ---------------------------------------
[I 00:00:35,367] [input] closeVirtualKeyboard for user 0(1)
[I 00:00:42,452] PregameFSM:  triggered 'Menu done'
[I 00:00:42,452] PregameFSM:        'Menu'::Exit #0
[I 00:00:42,452] 
[I 00:00:42,461] PregameFSM:        'ToPlayState'::Enter #0
[I 00:00:42,461] 
[I 00:00:42,461] [pregame] Start Play
[I 00:00:42,461] [pregame] start destruction step Search
[I 00:00:42,461] [pregame] start destruction step Init
[I 00:00:42,461] [play] start creation step Init
[I 00:00:42,461] [play] start creation step LoadingScreenStart
[I 00:00:42,461] [graphics] Reducing shader compilation task worker count in graphics system!
[I 00:00:42,461] [play] start creation step LoadSessionResources
[I 00:00:42,461] [play] start creation step Session
[I 00:00:42,466] [Session] started transition from 'Lobby' to 'Client_Online' (current='<invalid>')!
[I 00:00:42,466] [session] Swap machine index 1 and 0.
[I 00:00:42,466] [Session] 'PrepareGame' (up)!
[I 00:00:42,466] [SessionPlayer] started transition from 'Local' to 'Local_InSession' (current='<invalid>')!
[I 00:00:42,466] [OnlineProviderSteam] started transition from 'Initialized' to 'InGame' (current='<invalid>')!
[I 00:00:42,466] [SessionPlayer] 'ConnectLocalToGame' (up)!
[I 00:00:42,477] [online] Requested lobby data for lobby 109775241907953519.
[I 00:00:42,527] [online] Entered lobby (109775241907953519).
[I 00:00:42,527] [OnlineProviderSteam] 'JoinOrCreateGame' (up)!
[I 00:00:42,544] [online] Added Peer #0.
[I 00:00:42,544] [OnlineProviderSteam] 'SetLobbyData' (up)!
[I 00:00:42,544] [OnlineLocalPlayerSteam] started transition from 'SignedIn' to 'InGame' (current='<invalid>')!
[I 00:00:42,561] [OnlineLocalPlayerSteam] 'AddPlayerToLobby' (up)!
[I 00:00:42,561] [OnlineLocalPlayerSteam] finished transition from 'SignedIn' to 'InGame' (current='InGame')!
[I 00:00:42,561] [OnlineProviderSteam] 'JoinLocalPlayers' (up)!
[I 00:00:43,011] [OnlineProviderSteam] 'ConnectToPeers' (up)!
[I 00:00:43,011] [OnlineProviderSteam] finished transition from 'Initialized' to 'InGame' (current='InGame')!
[I 00:00:43,014] [Session] 'JoinOnline' (up)!
[I 00:00:43,032] [session] Swap player index 1 and 0.
[I 00:00:43,032] [SessionPlayer] started transition from 'Free' to 'Remote_InSession' (current='<invalid>')!
[I 00:00:43,032] [session] Remote player added. Player handle: 0(0)
[I 00:00:43,032] [SessionPlayer] 'JoinGame' (up)!
[I 00:00:43,032] [SessionPlayer] finished transition from 'Local' to 'Local_InSession' (current='Local_InSession')!
[I 00:00:43,032] [SessionPlayer] 'Reserve' (up)!
[I 00:00:43,032] [SessionPlayer] 'WaitForJoin' (up)!
[I 00:00:43,032] [SessionPlayer] finished transition from 'Free' to 'Remote_InSession' (current='Remote_InSession')!
[I 00:00:43,037] [Session] 'JoinPlayers' (up)!
[I 00:00:43,037] [Session] finished transition from 'Lobby' to 'Client_Online' (current='Client_Online')!
[I 00:00:43,044] [play] start creation step GameServerCreate
[I 00:00:43,044] [play] start creation step GameServerInit
[I 00:00:43,044] [play] start creation step GameClientCreate
[I 00:00:43,045] [play] start creation step GameClientInit

[Detanup01]

Basically game devs sucks implementing steam api properly? Not the first , and for these devs probably not even the last

[Detanup01]

Maybe the waittine is here.

gbe_fork/dll/steam_networking_sockets.cpp

Line 2015 in a7ec484

if (socket_conn->second.connect_requests_sent < 10 && socket_conn->second.status == CONNECT_SOCKET_CONNECTING && (std::chrono::duration_cast<std::chrono::milliseconds>(current_time - socket_conn->second.connect_request_last_sent).count() > 3000)) {

Change that to other high number and see if works (the last 5000 one)

[digby-chicken-caesar]

Aye aye captain

[gameclamp]

Maybe the waittine is here.

gbe_fork/dll/steam_networking_sockets.cpp

Line 2015 in a7ec484
if (socket_conn->second.connect_requests_sent < 10 && socket_conn->second.status == CONNECT_SOCKET_CONNECTING && (std::chrono::duration_caststd::chrono::milliseconds(current_time - socket_conn->second.connect_request_last_sent).count() > 3000)) {

Change that to other high number and see if works (the last 5000 one)

Change 3000 to 5000 no work.
The Dedicated Server log show this:

[I 00:01:41,171] [online] Session accepted with peer (steamid:76561199184610898)
[I 00:01:41,171] [online] Added peer #0 (steamid:76561199184610898)
[E 00:01:41,257] [session] Packet from 0 is smaller than what the header stated (2560).
[I 00:01:51,093] [online] Session failed for peer #0 with error 0
[I 00:01:51,094] [online] Removed peer #0

client log show this:

[I 00:01:31,752] [online] Session accepted by peer #0
[I 00:01:31,788] [online] Requested lobby data for lobby 109775241181658926.
[I 00:01:31,788] [online] Entered lobby (109775241181658926).
[I 00:01:31,788] [OnlineProviderSteam] 'JoinOrCreateGame' (up)!
[W 00:01:31,814] [online] Could not find local Player for received AuthToken.
[E 00:01:41,597] [online] Timeout for peer #0
[I 00:01:41,597] [online] Removed peer #0
[I 00:01:41,614] [user] Started User Interaction: JoinGameFailed

[universal963]

It would be good to also upload emu logs.

[gameclamp]

Here's the logs

Enshrouded_log.zip

[universal963]

I currently suspect ISteamNetworkingSockets interface is working flawlessly, but some other authentications are not. The logs state these respectively:

[E 00:01:41,257] [session] Packet from 0 is smaller than what the header stated (2560).
[I 00:01:51,093] [online] Session failed for peer #0 with error 0

[W 00:01:31,814] [online] Could not find local Player for received AuthToken.
[E 00:01:41,597] [online] Timeout for peer #0
[I 00:01:41,597] [online] Removed peer #0

I assume the problem is the dedicated server tries to verify some sort of ticket but size check fails, resulting not sending necessary info back, and client times out due to no such info received. Maybe try mess with new_app_ticket=1 and gc_token=1 options to see whether they would help? Though I don't think this problem will be so easily resolved.

[gameclamp]

I currently suspect ISteamNetworkingSockets interface is working flawlessly, but some other authentications are not. The logs state these respectively:

[E 00:01:41,257] [session] Packet from 0 is smaller than what the header stated (2560).
[I 00:01:51,093] [online] Session failed for peer #0 with error 0

[W 00:01:31,814] [online] Could not find local Player for received AuthToken.
[E 00:01:41,597] [online] Timeout for peer #0
[I 00:01:41,597] [online] Removed peer #0

I assume the problem is the dedicated server tries to verify some sort of ticket but size check fails, resulting not sending necessary info back, and client times out due to no such info received. Maybe try mess with new_app_ticket=1 and gc_token=1 options to see whether they would help? Though I don't think this problem will be so easily resolved.

I tried mess with new_app_ticket and gc_token. Nothing change.

[digby-chicken-caesar]

Hello friendly developer folks!

Is it possible that one of the dev's changes to the Enshrouded Steam API was to encrypt/decrypt the AuthToken during the P2P game initialization?

If so, could Commit #230 be related to our pain and suffering?

I tried to set up GittyGittyKit's commit to work with nucleuscoop/goldberg emu on my PC to test with brute force and ignorance but was unsuccessful.

I am going to try to use Wireshark to collect Steam API traffic when I join a proper online game in the latest Enshrouded version. Looks first I will need to get a Steam Web API Key.

[universal963]

Hello friendly developer folks!

Is it possible that one of the dev's changes to the Enshrouded Steam API was to encrypt/decrypt the AuthToken during the P2P game initialization?

If so, could Commit #230 be related to our pain and suffering?

I tried to set up GittyGittyKit's commit to work with nucleuscoop/goldberg emu on my PC to test with brute force and ignorance but was unsuccessful.

I am going to try to use Wireshark to collect Steam API traffic when I join a proper online game in the latest Enshrouded version. Looks first I will need to get a Steam Web API Key.

As far as I know, that PR alone will not work because the logs indicate the game completely does not use those apis to do verifications. I guess GetAuthTicketForWebApi() might be one of reasons but it seems to only be used for twitch drops verification. More investigations are needed.

[digby-chicken-caesar]

Found an old workaround for Enshrouded Update #5 v.0.8.0.0 (build: 635482): Similar issue in an older version but perhaps their findings can help?

The problem may be related to the undisclosed ports that the server is trying to open for the game. In this case, using the Docker host network can help: the server can use any (UDP) port and the connection will work.

https://steamcommunity.com/app/1203620/discussions/2/4206994473255561615/?ysclid=mb62nvirgn663214383

I had the client 'xxxx' not authenticated by steam (error 6) fixed on a dedicated server where I did the following:

To eliminate this error so that other players can join the server, it worked for me by first creating a server in-game and letting the players connect. I then uploaded the files “3ad85aea, 3ad85aea.info and characters” (created automatically) from the local save folder to the “Savegame” folder on the server, released ports and started the dedicated server. A connection was then possible without any problems.
Server runs as a Docker container.

[digby-chicken-caesar]

@gameclamp Where are the goldberg emu logs located? I'm working on getting pcaps + enshrouded logs.

[gameclamp]

@gameclamp Where are the goldberg emu logs located? I'm working on getting pcaps + enshrouded logs.

Use the debug version of the emu. Log files located in the same folder with steam_api64.dll.

[digby-chicken-caesar]

@gameclamp, @Detanup01, @universal963

I've reproduced the issue and attached gbe debug logs below:

logs_20250720.zip

Here's some snippets to help get you started! Please let me know if you need me to do it again while running pcaps with wireshark or something

P1 accepted session from P2 at 12:50:22 EDT
	~25365 ms mark on Instance0's GBE Debug logs.

Player1 SteamID: 76561199903957098
Player2 SteamID: 76561200028139034

##############################################################################################################

enshrouded.log: INSTANCE0 PLAYER1
[I 00:00:00,001] [GameFramework] Current UTC date: 2025.07.20 16:48:04
...
[I 00:02:18,361] [online] Session accepted with peer (steamid:76561200028139034)
[I 00:02:18,361] [online] Added peer #0 (steamid:76561200028139034)
[I 00:02:18,375] [online] Session accepted by peer #0
[E 00:02:18,407] [session] Packet from 0 is smaller than the header.



GBE DEBUG LOGS INSTANCE0 PLAYER1 "STEAM_LOG_39569118.log":
[25365 ms, 25365827 us] [tid 99272] Steam_Client::RunCallbacks() begin ------------------------------------------------------
[25365 ms, 25365858 us] [tid 99272] Networking::Run() RECV UDP
[25365 ms, 25365870 us] [tid 99272] Networking::Run() recv 40 172.24.144.1:47585
[25365 ms, 25365905 us] [tid 99272] Networking::new_connection() ADDED ID 85568398845554974
[25365 ms, 25365921 us] [tid 99272] Networking::handle_announce() new connection created: user 85568398845554974, appid 1203620
[25365 ms, 25365929 us] [tid 99272] Networking::handle_announce() Handle Announce: 1203620, 85568398845554974, 1203620, 0
[25365 ms, 25365938 us] [tid 99272] Networking::add_id_connection() ADDED ID 76561200028139034
[25365 ms, 25365946 us] [tid 99272] Networking::create_announce() ids length 2
[25365 ms, 25365955 us] [tid 99272] Networking::create_announce() Connection 1 85568399345274412 1203620
[25365 ms, 25365963 us] [tid 99272] Networking::create_announce() Connection 0 85568398845554974 1203620
[25365 ms, 25365979 us] [tid 99272] send_packet_to() send: 67 172.24.144.1:47585
[25365 ms, 25365988 us] [tid 99272] Mine_SendTo() 


##############################################################################################################
enshrouded.log: INSTANCE1 PLAYER2:
[I 00:00:00,001] [GameFramework] Current UTC date: 2025.07.20 16:48:29
...
[I 00:01:53,087] [online] Session accepted by peer #0
...
[E 00:02:03,032] [online] Timeout for peer #0
[I 00:02:03,033] [online] Removed peer #0


GBE DEBUG LOGS INSTANCE1 PLAYER2 "STEAM_LOG_2938826382.log"
[155 ms, 155486 us] [tid 127752] Networking::Run() RECV UDP
[155 ms, 155500 us] [tid 127752] Networking::Run() recv 67 172.24.144.1:47584
[155 ms, 155540 us] [tid 127752] Networking::new_connection() ADDED ID 85568399345274412
[155 ms, 155554 us] [tid 127752] Networking::handle_announce() new connection created: user 85568399345274412, appid 1203620
[155 ms, 155561 us] [tid 127752] Networking::handle_announce() Handle Announce: 1203620, 85568399345274412, 1203620, 1
[155 ms, 155570 us] [tid 127752] Networking::add_id_connection() ADDED ID 76561199903957098
[155 ms, 155579 us] [tid 127752] Networking::handle_announce() 000002581C7080F0 1203620 1203620 85568399345274412
[155 ms, 155591 us] [tid 127752] Networking::Run() recv 40 172.24.144.1:47584
[155 ms, 155601 us] [tid 127752] Networking::handle_announce() Handle Announce: 1203620, 85568399345274412, 1203620, 0
[155 ms, 155612 us] [tid 127752] Networking::create_announce() ids length 2
[155 ms, 155621 us] [tid 127752] Networking::create_announce() Connection 1 85568398845554974 1203620
[155 ms, 155629 us] [tid 127752] Networking::create_announce() Connection 1 85568399345274412 1203620
[155 ms, 155647 us] [tid 127752] send_packet_to() send: 92 172.24.144.1:47584
[155 ms, 155657 us] [tid 127752] Mine_SendTo()