Server closes the connection with a FIN packet immediately after sending a GO_AWAY frame. All accepted streams upto the lastStreamId are not getting processed

[Sumi264]

My application server using http2 reactive netty server (version: 1.0.26) closes the connection immediately after sending a GO_AWAY packet, without processing outstanding requests up to the lastStreamId.

+--- org.springframework.boot:spring-boot-starter-webflux:2.7.7
| +--- org.springframework.boot:spring-boot-starter:2.7.7 ()
| +--- org.springframework.boot:spring-boot-starter-json:2.7.7 ()
| +--- org.springframework.boot:spring-boot-starter-reactor-netty:2.7.7
| | --- io.projectreactor.netty:reactor-netty-http:1.0.26

https://www.rfc-editor.org/rfc/rfc7540#section-6.8 states that all "Activity on streams numbered lower or equal to the last stream identifier might still complete successfully. The sender of a GOAWAY frame might gracefully shut down a connection by sending a GOAWAY frame, maintaining the connection in an "open" state until all in-progress streams complete."

Does reactive netty server support processing of all accepted streams upto the lastStreamId sent in GO_AWAY frame before terminating the connection? If yes, then please advise if some configuration is needed to make reactive netty http2 server to ensure the processing of all streams up to the lastStreamId quoted in GO_AWAY frame.

[violetagg]

@Sumi264 Can you describe your scenario in more details? Is this a graceful shutdown of the server or some other connection close scenario?

[Sumi264]

@violetagg Yes, graceful shutdown is configured for the application server. The application is running in a containerized environment in a kubenetes pod. I'm deleting the pod to observe the behaviour of server in graceful shutdown scenario.

factory.addServerCustomizers(httpServer -> httpServer.idleTimeout(Duration.ofMillis(idleTimeout))); factory.addServerCustomizers(builder -> builder.protocol(HttpProtocol.H2C, HttpProtocol.HTTP11)); factory.setShutdown(Shutdown.GRACEFUL);

[Sumi264]

@violetagg I'm pasting the logs snippet where it's visible that GO_AWAY frame has lastStreamId=2127, and INBOUND DATA is seen for this streamId, but no OUTBOUND DATA. The connection gets closed as soon as the graceful shutdown is triggered with GO_AWAY frame, without processing this lastStream.

"reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] INBOUND DATA: streamId=2123 padding=0 endStream=false length=1648 bytes=7b0a20202020226e66496e7374616e63654964223a202263623539633438632d613266612d313165392d613261332d326132616532646263636534222c0a2020..." "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] INBOUND DATA: streamId=2123 padding=0 endStream=true length=0 bytes=" "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] OUTBOUND DATA: streamId=2123 padding=0 endStream=true length=18 bytes=7b44656661756c7420526573706f6e73657d" "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] INBOUND DATA: streamId=2125 padding=0 endStream=false length=1648 bytes=7b0a20202020226e66496e7374616e63654964223a202263623539633438632d613266612d313165392d613261332d326132616532646263636534222c0a2020..." "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] INBOUND DATA: streamId=2125 padding=0 endStream=true length=0 bytes=" "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] OUTBOUND DATA: streamId=2125 padding=0 endStream=true length=18 bytes=7b44656661756c7420526573706f6e73657d" "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] INBOUND DATA: streamId=2127 padding=0 endStream=false length=1648 bytes=7b0a20202020226e66496e7374616e63654964223a202263623539633438632d613266612d313165392d613261332d326132616532646263636534222c0a2020..." "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] INBOUND DATA: streamId=2127 padding=0 endStream=true length=0 bytes=" "reactor.netty.http.server.h2","message":"[id: 0xb7b87797, L:/192 .168.219.77:8080 - R:/10.75.213.193:21174] OUTBOUND GO_AWAY: lastStreamId=2127 errorCode=0 length=0 bytes=" "reactor.netty.http.server.HttpServer","message":"[b7b87797, L:/192.168.219.77:8080 - R:/10.75.213.193:21174] CLOSE" "reactor.netty.http.server.HttpServer","message":"[b7b87797, L:/192.168.219.77:8080 ! R:/10.75.213.193:21174] INACTIVE" "reactor.netty.http.server.HttpServer","message":"[b7b87797, L:/192.168.219.77:8080 ! R:/10.75.213.193:21174] UNREGISTERED"