[FEATURE]: Passing sessionId argument of span from ai-sdk

[horita-yuya]

Package Name

llmobs

Package Version(s)

No response

Describe the feature you'd like

Now, the arguments of span is registered here.

https://github.com/DataDog/dd-trace-js/blob/master/packages/dd-trace/src/llmobs/plugins/base.js#L49

The registeredOptions is created here.

dd-trace-js/packages/dd-trace/src/llmobs/plugins/ai/index.js

Line 140 in e6e0689

return { kind, name: getLlmObsSpanName(operation, ctx.attributes['ai.telemetry.functionId']) }

It seems only "name" argument is generated from ai-sdk telemetry.

Is it possible to create "sessionId" argument from it?

The "sessionId" I'm describing is here. https://docs.datadoghq.com/llm_observability/instrumentation/sdk/?tab=nodejs#llm-calls

Is your feature request related to a problem?

No response

Describe alternatives you've considered

No response

Additional context

No response

[sabrenner]

Hi @horita-yuya, thank you for opening this issue! As I see it, there are a couple things possible:

1. You can add an annotationContext around your Vercel AI SDK calls, like this, which will apply the sessionId tag on all generated spans.

import { llmobs } from 'dd-trace'
const result = await llmobs.annotationContext({ tags: { session_id: '123456' } }, () => generateText(...))

2. We could add support to parse sessionId from the telemetry metadata, or in v7, the runtimeContext:

const result = await generateTex({
  ...rest,
  experimental_telemetry: {
    metadata: { sessionId: '123456' }, // dd-trace could parse this into the sessionId tag, but this does not exist now
  },
})

The second one we would need to support, while the first is possible today.

[horita-yuya]

@sabrenner

I tried no.1.
It works. Thank you!