Skip to content

Add OTel span for picker in scheduling pipeline#1732

Closed
chinmaychahar wants to merge 2 commits into
llm-d:mainfrom
chinmaychahar:add-picker-span
Closed

Add OTel span for picker in scheduling pipeline#1732
chinmaychahar wants to merge 2 commits into
llm-d:mainfrom
chinmaychahar:add-picker-span

Conversation

@chinmaychahar

@chinmaychahar chinmaychahar commented Jun 24, 2026

Copy link
Copy Markdown

Summary

  • Adds a pick_endpoints span around the picker plugin execution in runPickerPlugin, following the convention from observability: standardize OTel service, scope, and span naming #1565 (score_prefix_cache, pick_pd_profile)
  • Attributes: llm_d.epp.picker.candidate_endpoints, llm_d.epp.picker.selected_endpoints, gen_ai.request.model, gen_ai.request.id
  • Uses a local tracerScope constant (llm-d-router/pkg/epp/scheduling) with trace.WithSpanKind(trace.SpanKindInternal)

Fixes #1694 (sub-task of #1483)

@chinmaychahar
chinmaychahar requested a review from a team as a code owner June 24, 2026 02:42
@chinmaychahar
chinmaychahar requested review from ahg-g and elevran June 24, 2026 02:42
@github-actions github-actions Bot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Jun 24, 2026
@github-actions

Copy link
Copy Markdown
Contributor

🚨 Unsigned commits detected! Please sign your commits.

For instructions on how to set up GPG/SSH signing and verify your commits, please see GitHub Documentation.

Signed-off-by: chinmaychahar <chinmay.cc.06@gmail.com>
@ahg-g

ahg-g commented Jun 27, 2026

Copy link
Copy Markdown
Collaborator

this is addressed by #1708

@ahg-g ahg-g closed this Jun 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add span for picker

2 participants