Skip to content

情绪控制Triton + TensorRT-LLM #1629

@jxjpds

Description

@jxjpds

Triton + TensorRT-LLM 是不支持情绪控制吗。 不能使用instruct_text 去控制吗。api接口是只能调用Triton 接口吗; 如果支持,应该怎么去请求呢

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions