Skip to content

OpenAI backend token logprobs propagation into responses #1990

@Zigfreidish

Description

@Zigfreidish

Child of #1384.

Replace the current explicit unsupported logprobs receipt with real token-logprob propagation from the backend into the logprobs/top_logprobs response fields, when the runtime reports them. Runtime-dependent.

Done when

  • When the backend reports token logprobs, they appear in the response with OpenAI-compatible shape.
  • When it does not, the explicit unsupported receipt remains rather than synthesizing values.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestrun-evidenceRun evidence, manifests, and reports

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions