Skip to content

[Bug]: Does TensorRT-LLM support deploying glm-5 on A800 or A100, or are there any plans to support it? #12103

@yangzhipeng1108

Description

@yangzhipeng1108

System Info

Does TensorRT-LLM support deploying glm-5 on A800 or A100, or are there any plans to support it?

Who can help?

No response

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction

Does TensorRT-LLM support deploying glm-5 on A800 or A100, or are there any plans to support it?

Expected behavior

Does TensorRT-LLM support deploying glm-5 on A800 or A100, or are there any plans to support it?

actual behavior

Does TensorRT-LLM support deploying glm-5 on A800 or A100, or are there any plans to support it?

additional notes

Does TensorRT-LLM support deploying glm-5 on A800 or A100, or are there any plans to support it?

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Model customization<NV>Adding support for new model architectures or variantsbugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions