Skip to content

Unclosed Span leads to OOM and breaks references #34

Open
@ledor473

Description

@ledor473

Using the OpenTracingChannelInterceptor class may cause the application to go in OOM because the Span gets started but are not always closed. Also, since the Scope remains active, the references (wrong parent).

In the code below, the Span is created and is made active in the ScopeManager.

It's supposed to be closed here:

Object scopeValue = message.getHeaders().get(SCOPE_HEADER);
if (scopeValue instanceof Scope) {
Span span = tracer.scopeManager().activeSpan();
closeResources(ex, (Scope) scopeValue, span);
}

That logic only works if the application is using a DirectChannel but it's unlikely to work with something like the ExecutorChannel.
Furthermore, it appears that Spring Cloud Stream has a DirectChannel implementation that is not actually "direct" and needs to be excluded according to the code in Sleuth.

Our issue was with the DirectWithAttributesChannel specifically, but the fix we are testing is to only activate the Span if it's a DirectChannel, pass both the Span and Scope in the headers and close both of them in the afterSendCompletion.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions