-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Open
Labels
Description
Checklist:
- 查找历史相关issue寻求解答
- 翻阅FAQ
- 翻阅PaddleX 文档
- 确认bug是否在新版本里还未修复
描述问题
在昇腾910B3上启动小模型服务成功,但是真正推理时报错ACL error,500001
想请教是什么原因
复现
- 服务化部署
按照文档https://github.com/PaddlePaddle/PaddleX/blob/release/3.3/docs/other_devices_support/paddlepaddle_install_NPU.md部署
验证python -c "import paddle; paddle.utils.run_check()"时
报错
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.10/dist-packages/paddle/utils/install_check.py", line 274, in run_check
_run_dygraph_single(use_cuda, use_xpu, use_custom, custom_device_name)
File "/usr/local/lib/python3.10/dist-packages/paddle/utils/install_check.py", line 120, in _run_dygraph_single
opt.step()
File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/usr/local/lib/python3.10/dist-packages/paddle/base/dygraph/base.py", line 380, in __impl__
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
File "/usr/local/lib/python3.10/dist-packages/paddle/base/wrapped_decorator.py", line 40, in __impl__
return wrapped_func(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/paddle/base/framework.py", line 736, in __impl__
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/paddle/optimizer/adam.py", line 526, in step
optimize_ops = self._apply_optimize(
File "/usr/local/lib/python3.10/dist-packages/paddle/optimizer/optimizer.py", line 1701, in _apply_optimize
optimize_ops = self._create_optimization_pass(
File "/usr/local/lib/python3.10/dist-packages/paddle/optimizer/optimizer.py", line 1368, in _create_optimization_pass
self._append_optimize_op(
File "/usr/local/lib/python3.10/dist-packages/paddle/optimizer/adam.py", line 387, in _append_optimize_op
_, _, _, _, _, _, _ = _C_ops.adam_(
OSError: (External) ACL error, the error code is : 500001. (at /paddle/backends/npu/kernels/funcs/npu_op_runner.cc:445)
环境
-
请提供您使用的PaddlePaddle、PaddleX版本号、Python版本号
paddlepaddle 3.3.0 dev
paddlepaddle-3.3.0.dev20251105-cp313-cp313-linux_aarch64.whl
paddle_custom_npu-3.0.0.dev20251105-cp310-cp310-linux_aarch64.whl或
paddle_custom_npu-3.0.0.dev20251023-cp310-cp310-linux_aarch64.whl都会报错
paddlex 3.3.5
python 3.10 -
请提供您使用的操作系统信息,如Linux/Windows/MacOS
linux、 910B3、npu-smi 24.1.0.3