Skip to content

使用evalscope+mmlu-pro精度集测试vllm-ascend镜像,得分总是比vllm-ascend官方的ais-bench工具低了5-6分 #1401

@xuyucheng220

Description

@xuyucheng220

参考vllm-ascend社区的issue单号:vllm-project/vllm-ascend#10068
这个问题更有可能是evalscope工具的问题,请帮忙分析。

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions