[CANN]EP: CANN cannot complete inference on Atlas200DK #15677
Description
Describe the issue
I tried to use Atlas200DK for inference under ORT, but it never worked properly. There has been an error prompt:
CANN failure 507013: (look for ACL_ERROR_xxx in acl. h); NPU=0 ; hostname=davinci-mini ; expr=aclrtSynchronizeStream(GetStream(kCannStreamDefault));
Subsequently, it was learned that the aclrtMemcpyAsync interface was enabled and modified to aclrtMemcpy interface. This error no longer occurred, but the inference results of the resnet50 model were not correct. The possible issue may be related to Atlas200DK supporting only the RC mode and not the EP mode, which is incompatible with the CANN EP implemented in the EP mode.
Below is an error log for a certain time.
To reproduce
Urgency
No response
Platform
Linux
OS Version
Ubuntu 18.04
ONNX Runtime Installation
Built from Source
ONNX Runtime Version or Commit ID
15
ONNX Runtime API
C++
Architecture
ARM64
Execution Provider
Other / Unknown
Execution Provider Library Version
CANN 6.0.RC1.alpha003