Skip to content

Separate the logs of distinct lanuchees of a given launcher #157

@diegocastanibm

Description

@diegocastanibm

The launcher's REST API needs to have a way for the client to fetch a given child's output:

  • Since the norm for Kubernetes containers is to mix both STDOUT and STDERR in one log, that would be the right thing to do here.
  • Since the output grows over time and can be quite large, the API needs to be designed to return output in chunks. Perhaps something like this: the request has a starting position and a length limit.
  • We should also extend the requester so that the vLLM output can be relayed through it, so that a user of the server-requesting Pod sees the vLLM output in the requester's log.

CC. @MikeSpreitzer @lionelvillard

Sub-issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions