You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/execution-providers/QNN-ExecutionProvider.md
+6-5Lines changed: 6 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -449,16 +449,17 @@ Profiling data is available with the HTP backend. Enabling QNN profiling will ge
449
449
If onnxruntime is compiled with a more recent QAIRT SDK (2.39 or later), then a _qnn.log file will also be generated alongside the .csv file. This .log file is parsable by [qnn-profile-viewer](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-10/general_tools.html#qnn-profile-viewer), which is provided in the SDK.
450
450
451
451
### General Usage
452
-
To utilize QNN profiling, simply set the EP options profiling_level to basic, detailed, or optrace. Additionally, the EP option profiling_file_path must also be defined to the output .csv filepath you would like write data to:
452
+
To utilize QNN profiling, simply set the EP option profiling_level to basic, detailed, or optrace. Additionally, the EP option profiling_file_path must also be set to the output .csv filepath you would like to write data to:
453
453
```python
454
454
# Python on Windows on Snapdragon device
455
455
import onnxruntime as ort
456
456
import numpy as np
457
457
458
458
provider_options = [
459
+
"backend_path": "path/to/QnnHtp.dll", # Use libQnnHtp.so if on Linux
459
460
"htp_performance_mode": "burst",
460
461
"device_id": "0",
461
-
"htp_graph_finalization_optimization_mode":"3"
462
+
"htp_graph_finalization_optimization_mode":"3",
462
463
"soc_model": "60",
463
464
"htp_arch": "73",
464
465
"vtcm_mv": "8",
@@ -503,9 +504,10 @@ import onnxruntime as ort
503
504
import numpy as np
504
505
505
506
provider_options = [
507
+
"backend_path": "path/to/QnnHtp.dll", # Use libQnnHtp.so if on Linux
model_ctx.onnx is an onnx model with a node that points to the model_qnn.bin context binary, which will be used by the HTP backend for execution. The _schematic.bin file will be used by qnn-profile-viewer to generate QHAS data.
0 commit comments