Skip to content

TRITON_CACHA_DIR will be set in rollout(vllm) when open complier, but it can be see in other train precess. #5577

@zhink

Description

@zhink

System Info

TRITON_CACHA_DIR will be set in rollout(vllm) when open complier, but it can be see in other train precess.I think TRITON_CACHA_DIR be changed just in vllm.

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction

TRITON_CACHA_DIR will be set in rollout(vllm) when open complier, but it can be see in other train precess.I think TRITON_CACHA_DIR be changed just in vllm.

Expected behavior

I think TRITON_CACHA_DIR be changed just in vllm.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions