Skip to content

[CANN]EP: CANN cannot complete inference on Atlas200DK #15677

Open
@Miao-537

Description

Describe the issue

I tried to use Atlas200DK for inference under ORT, but it never worked properly. There has been an error prompt:
CANN failure 507013: (look for ACL_ERROR_xxx in acl. h); NPU=0 ; hostname=davinci-mini ; expr=aclrtSynchronizeStream(GetStream(kCannStreamDefault));
Subsequently, it was learned that the aclrtMemcpyAsync interface was enabled and modified to aclrtMemcpy interface. This error no longer occurred, but the inference results of the resnet50 model were not correct. The possible issue may be related to Atlas200DK supporting only the RC mode and not the EP mode, which is incompatible with the CANN EP implemented in the EP mode.

Below is an error log for a certain time.

To reproduce

error.log

Urgency

No response

Platform

Linux

OS Version

Ubuntu 18.04

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

15

ONNX Runtime API

C++

Architecture

ARM64

Execution Provider

Other / Unknown

Execution Provider Library Version

CANN 6.0.RC1.alpha003

Metadata

Assignees

No one assigned

    Labels

    ep:CANNissues related to CANN EO

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions